2023-05-21T16:41:34.821 INFO:root:teuthology version: 0.0.1.dev100+g01abd1e 2023-05-21T16:41:34.822 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887 --owner scheduled_yuriw@teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/orig.config.yaml 2023-05-21T16:41:34.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-21T16:41:34.952 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887 branch: wip-yuri7-testing-2023-05-18-0655 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7281887' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri7-testing-2023-05-18-0655 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2023-05-18-0655 sha1: 5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6431 sha1: 5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri7-testing-2023-05-18-0655 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 01abd1ed90624b09fd81d9cb3a79e2834351f0ca timestamp: 2023-05-21_14:52:38 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-21T16:41:34.952 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa; will attempt to use it 2023-05-21T16:41:34.953 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks 2023-05-21T16:41:34.953 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-21T16:41:34.955 INFO:teuthology.task.internal:Checking packages... 2023-05-21T16:41:34.985 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1' 2023-05-21T16:41:34.985 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-21T16:41:34.986 INFO:teuthology.packaging:ref: None 2023-05-21T16:41:34.986 INFO:teuthology.packaging:tag: None 2023-05-21T16:41:34.986 INFO:teuthology.packaging:branch: wip-yuri7-testing-2023-05-18-0655 2023-05-21T16:41:34.987 INFO:teuthology.packaging:sha1: 5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 2023-05-21T16:41:34.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri7-testing-2023-05-18-0655 2023-05-21T16:41:35.130 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:41:35.130 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-21T16:41:35.143 INFO:teuthology.task.internal:no buildpackages task found 2023-05-21T16:41:35.144 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-21T16:41:35.160 INFO:teuthology.task.internal:Saving configuration 2023-05-21T16:41:35.175 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-21T16:41:35.182 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-21T16:41:35.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-21 16:35:30.320329', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-05-21T16:41:35.236 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-21 16:35:30.318400', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-05-21T16:41:35.237 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-21T16:41:35.243 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-21T16:41:35.244 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-21T16:41:35.244 INFO:teuthology.run_tasks:Running task console_log... 2023-05-21T16:41:35.320 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f39ef690ee0>, signals=[15]) 2023-05-21T16:41:35.321 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-21T16:41:35.327 INFO:teuthology.task.internal:Opening connections... 2023-05-21T16:41:35.328 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:41:35.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:41:35.380 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:41:35.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:41:35.428 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-21T16:41:35.437 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-05-21T16:41:35.457 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-05-21T16:41:35.457 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-05-21T16:41:35.463 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2023-05-21T16:41:35.463 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-05-21T16:41:35.463 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="20.04" 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-21T16:41:35.464 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-21T16:41:35.465 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=focal 2023-05-21T16:41:35.465 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=focal 2023-05-21T16:41:35.465 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-05-21T16:41:35.491 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-05-21T16:41:35.509 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-05-21T16:41:35.509 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-05-21T16:41:35.514 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2023-05-21T16:41:35.514 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-05-21T16:41:35.514 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2023-05-21T16:41:35.514 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2023-05-21T16:41:35.514 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-05-21T16:41:35.514 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="20.04" 2023-05-21T16:41:35.515 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-21T16:41:35.515 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-21T16:41:35.515 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-21T16:41:35.515 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-21T16:41:35.515 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=focal 2023-05-21T16:41:35.515 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=focal 2023-05-21T16:41:35.516 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-05-21T16:41:35.540 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-21T16:41:35.548 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-21T16:41:35.553 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-21T16:41:35.553 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2023-05-21T16:41:35.556 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-05-21T16:41:35.561 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-21T16:41:35.566 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-21T16:41:35.567 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2023-05-21T16:41:35.604 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-05-21T16:41:35.638 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-21T16:41:35.695 INFO:teuthology.run_tasks:Running task kernel... 2023-05-21T16:41:35.717 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-05-21T16:41:35.718 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-05-21T16:41:35.718 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-21T16:41:35.719 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-21T16:41:35.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:41:35.724 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-05-21T16:41:35.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:41:35.726 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-05-21T16:41:35.731 INFO:teuthology.orchestra.run.smithi046.stdout:5.4.0-124-generic 2023-05-21T16:41:35.732 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.4.0-124-generic 2023-05-21T16:41:35.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get clean 2023-05-21T16:41:35.733 INFO:teuthology.orchestra.run.smithi142.stdout:5.4.0-124-generic 2023-05-21T16:41:35.733 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.4.0-124-generic 2023-05-21T16:41:35.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2023-05-21T16:41:35.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2023-05-21T16:41:35.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get update 2023-05-21T16:41:36.177 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-21T16:41:36.178 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-05-21T16:41:36.238 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-05-21T16:41:36.336 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-21T16:41:36.337 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-05-21T16:41:36.337 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-05-21T16:41:36.581 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-05-21T16:41:36.650 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [591 kB] 2023-05-21T16:41:36.671 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-05-21T16:41:36.790 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,550 kB] 2023-05-21T16:41:36.791 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [591 kB] 2023-05-21T16:41:36.927 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [819 kB] 2023-05-21T16:41:37.003 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,170 kB] 2023-05-21T16:41:37.115 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,170 kB] 2023-05-21T16:41:37.186 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [351 kB] 2023-05-21T16:41:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [12.9 kB] 2023-05-21T16:41:37.201 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-05-21T16:41:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,749 kB] 2023-05-21T16:41:37.242 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [819 kB] 2023-05-21T16:41:37.248 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,550 kB] 2023-05-21T16:41:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [432 kB] 2023-05-21T16:41:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [245 kB] 2023-05-21T16:41:37.269 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.5 kB] 2023-05-21T16:41:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-05-21T16:41:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,855 kB] 2023-05-21T16:41:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [596 kB] 2023-05-21T16:41:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [837 kB] 2023-05-21T16:41:37.298 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [351 kB] 2023-05-21T16:41:37.312 INFO:teuthology.orchestra.run.smithi046.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [12.9 kB] 2023-05-21T16:41:37.313 INFO:teuthology.orchestra.run.smithi046.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-05-21T16:41:37.314 INFO:teuthology.orchestra.run.smithi046.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,749 kB] 2023-05-21T16:41:37.334 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-05-21T16:41:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [261 kB] 2023-05-21T16:41:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-05-21T16:41:37.375 INFO:teuthology.orchestra.run.smithi046.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [245 kB] 2023-05-21T16:41:37.381 INFO:teuthology.orchestra.run.smithi046.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-05-21T16:41:37.381 INFO:teuthology.orchestra.run.smithi046.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [596 kB] 2023-05-21T16:41:37.394 INFO:teuthology.orchestra.run.smithi046.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [837 kB] 2023-05-21T16:41:37.419 INFO:teuthology.orchestra.run.smithi046.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [432 kB] 2023-05-21T16:41:37.432 INFO:teuthology.orchestra.run.smithi046.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.5 kB] 2023-05-21T16:41:37.432 INFO:teuthology.orchestra.run.smithi046.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-05-21T16:41:37.434 INFO:teuthology.orchestra.run.smithi046.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,855 kB] 2023-05-21T16:41:37.462 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [171 kB] 2023-05-21T16:41:37.490 INFO:teuthology.orchestra.run.smithi046.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [261 kB] 2023-05-21T16:41:37.496 INFO:teuthology.orchestra.run.smithi046.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-05-21T16:41:37.504 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [727 kB] 2023-05-21T16:41:37.573 INFO:teuthology.orchestra.run.smithi046.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [171 kB] 2023-05-21T16:41:37.660 INFO:teuthology.orchestra.run.smithi046.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [727 kB] 2023-05-21T16:41:37.868 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [17.7 kB] 2023-05-21T16:41:37.875 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-05-21T16:41:37.882 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-05-21T16:41:37.885 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-05-21T16:41:37.887 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-05-21T16:41:37.978 INFO:teuthology.orchestra.run.smithi046.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [17.7 kB] 2023-05-21T16:41:37.984 INFO:teuthology.orchestra.run.smithi046.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-05-21T16:41:37.987 INFO:teuthology.orchestra.run.smithi046.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-05-21T16:41:37.995 INFO:teuthology.orchestra.run.smithi046.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-05-21T16:41:37.996 INFO:teuthology.orchestra.run.smithi046.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-05-21T16:41:38.088 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,062 kB] 2023-05-21T16:41:38.195 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [252 kB] 2023-05-21T16:41:38.215 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [24.3 kB] 2023-05-21T16:41:38.217 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-05-21T16:41:38.219 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-05-21T16:41:38.219 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-05-21T16:41:38.220 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-05-21T16:41:38.220 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-05-21T16:41:38.222 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-05-21T16:41:38.226 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-05-21T16:41:38.243 INFO:teuthology.orchestra.run.smithi046.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,062 kB] 2023-05-21T16:41:38.350 INFO:teuthology.orchestra.run.smithi046.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [252 kB] 2023-05-21T16:41:38.370 INFO:teuthology.orchestra.run.smithi046.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [24.3 kB] 2023-05-21T16:41:38.372 INFO:teuthology.orchestra.run.smithi046.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-05-21T16:41:38.374 INFO:teuthology.orchestra.run.smithi046.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-05-21T16:41:38.374 INFO:teuthology.orchestra.run.smithi046.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-05-21T16:41:38.375 INFO:teuthology.orchestra.run.smithi046.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-05-21T16:41:38.375 INFO:teuthology.orchestra.run.smithi046.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-05-21T16:41:38.377 INFO:teuthology.orchestra.run.smithi046.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-05-21T16:41:38.381 INFO:teuthology.orchestra.run.smithi046.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-05-21T16:41:38.390 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-05-21T16:41:38.545 INFO:teuthology.orchestra.run.smithi046.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-05-21T16:41:38.574 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-05-21T16:41:38.596 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-05-21T16:41:38.728 INFO:teuthology.orchestra.run.smithi046.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-05-21T16:41:38.751 INFO:teuthology.orchestra.run.smithi046.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-05-21T16:41:40.692 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 15.3 MB in 3s (5,342 kB/s) 2023-05-21T16:41:40.902 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 15.3 MB in 3s (5,323 kB/s) 2023-05-21T16:41:42.013 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:41:42.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-21T16:41:42.109 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:41:42.285 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2023-05-21T16:41:42.286 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2023-05-21T16:41:42.292 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:41:42.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-21T16:41:42.400 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:41:42.447 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2023-05-21T16:41:42.448 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-5.4.0-148 linux-headers-5.4.0-148-generic 2023-05-21T16:41:42.448 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-generic linux-image-5.4.0-148-generic 2023-05-21T16:41:42.448 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-5.4.0-148-generic linux-modules-extra-5.4.0-148-generic 2023-05-21T16:41:42.448 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2023-05-21T16:41:42.449 INFO:teuthology.orchestra.run.smithi142.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-05-21T16:41:42.449 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2023-05-21T16:41:42.449 INFO:teuthology.orchestra.run.smithi142.stdout: thermald 2023-05-21T16:41:42.500 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2023-05-21T16:41:42.501 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-5.4.0-148 linux-headers-5.4.0-148-generic 2023-05-21T16:41:42.501 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-148-generic linux-modules-5.4.0-148-generic 2023-05-21T16:41:42.501 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-extra-5.4.0-148-generic 2023-05-21T16:41:42.502 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2023-05-21T16:41:42.502 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-21T16:41:42.554 INFO:teuthology.orchestra.run.smithi142.stdout:3 upgraded, 5 newly installed, 0 to remove and 182 not upgraded. 2023-05-21T16:41:42.554 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 77.1 MB of archives. 2023-05-21T16:41:42.554 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 380 MB of additional disk space will be used. 2023-05-21T16:41:42.554 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-148-generic amd64 5.4.0-148.165 [15.0 MB] 2023-05-21T16:41:42.599 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2023-05-21T16:41:42.600 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2023-05-21T16:41:42.788 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2023-05-21T16:41:42.789 INFO:teuthology.orchestra.run.smithi046.stdout: linux-generic linux-headers-5.4.0-148 linux-headers-5.4.0-148-generic 2023-05-21T16:41:42.789 INFO:teuthology.orchestra.run.smithi046.stdout: linux-headers-generic linux-image-5.4.0-148-generic 2023-05-21T16:41:42.789 INFO:teuthology.orchestra.run.smithi046.stdout: linux-modules-5.4.0-148-generic linux-modules-extra-5.4.0-148-generic 2023-05-21T16:41:42.790 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2023-05-21T16:41:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-05-21T16:41:42.790 INFO:teuthology.orchestra.run.smithi046.stdout:Recommended packages: 2023-05-21T16:41:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: thermald 2023-05-21T16:41:42.859 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-148-generic amd64 5.4.0-148.165 [10.5 MB] 2023-05-21T16:41:42.860 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2023-05-21T16:41:42.860 INFO:teuthology.orchestra.run.smithi046.stdout: linux-headers-5.4.0-148 linux-headers-5.4.0-148-generic 2023-05-21T16:41:42.860 INFO:teuthology.orchestra.run.smithi046.stdout: linux-image-5.4.0-148-generic linux-modules-5.4.0-148-generic 2023-05-21T16:41:42.861 INFO:teuthology.orchestra.run.smithi046.stdout: linux-modules-extra-5.4.0-148-generic 2023-05-21T16:41:42.862 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages will be upgraded: 2023-05-21T16:41:42.862 INFO:teuthology.orchestra.run.smithi046.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-21T16:41:42.956 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-148-generic amd64 5.4.0-148.165 [39.2 MB] 2023-05-21T16:41:43.046 INFO:teuthology.orchestra.run.smithi046.stdout:3 upgraded, 5 newly installed, 0 to remove and 182 not upgraded. 2023-05-21T16:41:43.047 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 77.1 MB of archives. 2023-05-21T16:41:43.047 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 380 MB of additional disk space will be used. 2023-05-21T16:41:43.047 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-148-generic amd64 5.4.0-148.165 [15.0 MB] 2023-05-21T16:41:43.427 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.148.146 [1,900 B] 2023-05-21T16:41:43.427 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.148.146 [2,496 B] 2023-05-21T16:41:43.428 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-148 all 5.4.0-148.165 [11.0 MB] 2023-05-21T16:41:43.519 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-148-generic amd64 5.4.0-148.165 [1,368 kB] 2023-05-21T16:41:43.529 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.148.146 [2,372 B] 2023-05-21T16:41:44.157 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-148-generic amd64 5.4.0-148.165 [10.5 MB] 2023-05-21T16:41:44.203 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 77.1 MB in 1s (75.6 MB/s) 2023-05-21T16:41:44.391 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-5.4.0-148-generic. 2023-05-21T16:41:44.428 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-148-generic amd64 5.4.0-148.165 [39.2 MB] 2023-05-21T16:41:45.675 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.148.146 [1,900 B] 2023-05-21T16:41:45.676 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.148.146 [2,496 B] 2023-05-21T16:41:45.676 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-148 all 5.4.0-148.165 [11.0 MB] 2023-05-21T16:41:45.990 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-148-generic amd64 5.4.0-148.165 [1,368 kB] 2023-05-21T16:41:46.025 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.148.146 [2,372 B] 2023-05-21T16:41:46.086 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-05-21T16:41:46.091 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../0-linux-modules-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:41:46.171 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:41:46.793 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 77.1 MB in 3s (24.4 MB/s) 2023-05-21T16:41:46.960 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-modules-5.4.0-148-generic. 2023-05-21T16:41:48.120 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-image-5.4.0-148-generic. 2023-05-21T16:41:48.133 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../1-linux-image-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:41:48.235 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:41:48.651 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-05-21T16:41:48.656 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../0-linux-modules-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:41:48.765 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-modules-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:41:49.281 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-148-generic. 2023-05-21T16:41:49.294 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:41:49.339 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-extra-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:41:50.825 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-image-5.4.0-148-generic. 2023-05-21T16:41:50.842 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../1-linux-image-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:41:50.941 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:41:52.061 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-148-generic. 2023-05-21T16:41:52.076 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:41:52.120 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-modules-extra-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:41:54.013 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../3-linux-generic_5.4.0.148.146_amd64.deb ... 2023-05-21T16:41:54.140 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-21T16:41:54.502 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.148.146_amd64.deb ... 2023-05-21T16:41:54.627 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-21T16:41:54.955 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-5.4.0-148. 2023-05-21T16:41:54.969 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../5-linux-headers-5.4.0-148_5.4.0-148.165_all.deb ... 2023-05-21T16:41:55.004 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-5.4.0-148 (5.4.0-148.165) ... 2023-05-21T16:41:57.164 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../3-linux-generic_5.4.0.148.146_amd64.deb ... 2023-05-21T16:41:57.289 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-21T16:41:57.665 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.148.146_amd64.deb ... 2023-05-21T16:41:57.801 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-image-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-21T16:41:58.120 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-headers-5.4.0-148. 2023-05-21T16:41:58.134 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../5-linux-headers-5.4.0-148_5.4.0-148.165_all.deb ... 2023-05-21T16:41:58.170 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-headers-5.4.0-148 (5.4.0-148.165) ... 2023-05-21T16:42:00.260 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-5.4.0-148-generic. 2023-05-21T16:42:00.283 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../6-linux-headers-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:42:00.327 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:02.890 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.148.146_amd64.deb ... 2023-05-21T16:42:03.017 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-21T16:42:03.350 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:03.623 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-headers-5.4.0-148-generic. 2023-05-21T16:42:03.646 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../6-linux-headers-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-21T16:42:03.689 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-headers-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:04.530 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-5.4.0-148 (5.4.0-148.165) ... 2023-05-21T16:42:04.647 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:05.790 INFO:teuthology.orchestra.run.smithi142.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-148-generic 2023-05-21T16:42:05.790 INFO:teuthology.orchestra.run.smithi142.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:05.926 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:06.052 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-extra-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:06.744 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.148.146_amd64.deb ... 2023-05-21T16:42:06.864 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-headers-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-21T16:42:07.214 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-modules-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:07.245 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-generic (5.4.0.148.146) ... 2023-05-21T16:42:07.371 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-generic (5.4.0.148.146) ... 2023-05-21T16:42:07.497 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-generic (5.4.0.148.146) ... 2023-05-21T16:42:07.623 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:07.696 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-21T16:42:07.696 INFO:teuthology.orchestra.run.smithi142.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:08.460 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-headers-5.4.0-148 (5.4.0-148.165) ... 2023-05-21T16:42:08.586 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:09.805 INFO:teuthology.orchestra.run.smithi046.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-148-generic 2023-05-21T16:42:09.805 INFO:teuthology.orchestra.run.smithi046.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:09.963 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-headers-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:10.089 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-modules-extra-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:11.458 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-image-generic (5.4.0.148.146) ... 2023-05-21T16:42:11.592 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-headers-generic (5.4.0.148.146) ... 2023-05-21T16:42:11.743 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-generic (5.4.0.148.146) ... 2023-05-21T16:42:11.886 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-21T16:42:11.962 INFO:teuthology.orchestra.run.smithi046.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-21T16:42:11.962 INFO:teuthology.orchestra.run.smithi046.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:30.222 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-21T16:42:30.222 INFO:teuthology.orchestra.run.smithi142.stdout:Sourcing file `/etc/default/grub' 2023-05-21T16:42:30.237 INFO:teuthology.orchestra.run.smithi142.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-21T16:42:30.250 INFO:teuthology.orchestra.run.smithi142.stdout:Generating grub configuration file ... 2023-05-21T16:42:30.566 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-5.4.0-148-generic 2023-05-21T16:42:30.587 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:30.973 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-05-21T16:42:30.985 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-05-21T16:42:33.252 INFO:teuthology.orchestra.run.smithi142.stdout:done 2023-05-21T16:42:33.645 DEBUG:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2023-05-21T16:42:33.688 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 19 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2023-05-21T16:42:33.689 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 5.4.0.148.146 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-5.4.0-148-generic, linux-modules-extra-5.4.0-148-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2023-05-21T16:42:33.690 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2023-05-21T16:42:33.691 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-148-generic 2023-05-21T16:42:33.691 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-21T16:42:33.692 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-21T16:42:33.692 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-05-21T16:42:33.692 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2023-05-21T16:42:33.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2023-05-21T16:42:33.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2023-05-21T16:42:33.900 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-05-21T16:42:33.908 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-21T16:42:33.925 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-05-21T16:42:33.942 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-05-21T16:42:35.153 INFO:teuthology.orchestra.run.smithi046.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-21T16:42:35.153 INFO:teuthology.orchestra.run.smithi046.stdout:Sourcing file `/etc/default/grub' 2023-05-21T16:42:35.162 INFO:teuthology.orchestra.run.smithi046.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-21T16:42:35.174 INFO:teuthology.orchestra.run.smithi046.stdout:Generating grub configuration file ... 2023-05-21T16:42:35.579 INFO:teuthology.orchestra.run.smithi046.stdout:Found linux image: /boot/vmlinuz-5.4.0-148-generic 2023-05-21T16:42:35.592 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:42:35.604 INFO:teuthology.orchestra.run.smithi046.stdout:Found initrd image: /boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:35.617 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-21T16:42:35.681 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:42:35.874 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2023-05-21T16:42:35.875 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2023-05-21T16:42:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-05-21T16:42:36.081 INFO:teuthology.orchestra.run.smithi142.stdout:linux-image-generic is already the newest version (5.4.0.148.146). 2023-05-21T16:42:36.081 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 0 newly installed, 0 to remove and 182 not upgraded. 2023-05-21T16:42:36.083 DEBUG:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2023-05-21T16:42:36.086 INFO:teuthology.orchestra.run.smithi046.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-05-21T16:42:36.101 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2023-05-21T16:42:36.101 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2023-05-21T16:42:36.101 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2023-05-21T16:42:36.101 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2023-05-21T16:42:36.101 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 19 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 5.4.0.148.146 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-5.4.0-148-generic, linux-modules-extra-5.4.0-148-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2023-05-21T16:42:36.102 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2023-05-21T16:42:36.103 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2023-05-21T16:42:36.103 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2023-05-21T16:42:36.104 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-05-21T16:42:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.0DACT3vOQP 2023-05-21T16:42:36.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub/grub.cfg /tmp/tmp.0DACT3vOQP 2023-05-21T16:42:36.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.0DACT3vOQP 2023-05-21T16:42:36.201 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.0DACT3vOQP is 9KB 2023-05-21T16:42:36.214 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.0DACT3vOQP 2023-05-21T16:42:36.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-21T16:42:36.275 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:42:36.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-21T16:42:36.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-21T16:42:36.304 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-148-generic 2023-05-21T16:42:36.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo update-grub 2023-05-21T16:42:37.548 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2023-05-21T16:42:37.561 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-21T16:42:37.577 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-05-21T16:42:37.819 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-148-generic 2023-05-21T16:42:37.831 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:38.182 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-05-21T16:42:38.194 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-05-21T16:42:38.821 INFO:teuthology.orchestra.run.smithi046.stdout:done 2023-05-21T16:42:39.238 DEBUG:teuthology.orchestra.run.smithi046:> dpkg -s linux-image-generic 2023-05-21T16:42:39.278 INFO:teuthology.orchestra.run.smithi046.stdout:Package: linux-image-generic 2023-05-21T16:42:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:Status: install ok installed 2023-05-21T16:42:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:Priority: optional 2023-05-21T16:42:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:Section: kernel 2023-05-21T16:42:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:Installed-Size: 19 2023-05-21T16:42:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:Maintainer: Ubuntu Kernel Team 2023-05-21T16:42:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: amd64 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:Source: linux-meta 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:Version: 5.4.0.148.146 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:Depends: linux-image-5.4.0-148-generic, linux-modules-extra-5.4.0-148-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:Recommends: thermald 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:Description: Generic Linux kernel image 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout: This package will always depend on the latest generic kernel image 2023-05-21T16:42:39.280 INFO:teuthology.orchestra.run.smithi046.stdout: available. 2023-05-21T16:42:39.281 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-148-generic 2023-05-21T16:42:39.281 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-21T16:42:39.282 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-21T16:42:39.282 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-05-21T16:42:39.282 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2023-05-21T16:42:39.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get clean 2023-05-21T16:42:39.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get update 2023-05-21T16:42:39.392 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-05-21T16:42:39.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2023-05-21T16:42:39.515 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-21T16:42:39.521 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-05-21T16:42:39.538 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-05-21T16:42:39.634 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-05-21T16:42:41.261 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:42:41.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-21T16:42:41.358 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:42:41.556 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2023-05-21T16:42:41.556 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2023-05-21T16:42:41.781 INFO:teuthology.orchestra.run.smithi046.stdout:linux-image-generic is already the newest version (5.4.0.148.146). 2023-05-21T16:42:41.781 INFO:teuthology.orchestra.run.smithi046.stdout:0 upgraded, 0 newly installed, 0 to remove and 182 not upgraded. 2023-05-21T16:42:41.783 DEBUG:teuthology.orchestra.run.smithi046:> dpkg -s linux-image-generic 2023-05-21T16:42:41.802 INFO:teuthology.orchestra.run.smithi046.stdout:Package: linux-image-generic 2023-05-21T16:42:41.802 INFO:teuthology.orchestra.run.smithi046.stdout:Status: install ok installed 2023-05-21T16:42:41.802 INFO:teuthology.orchestra.run.smithi046.stdout:Priority: optional 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Section: kernel 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Installed-Size: 19 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Maintainer: Ubuntu Kernel Team 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: amd64 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Source: linux-meta 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Version: 5.4.0.148.146 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-05-21T16:42:41.803 INFO:teuthology.orchestra.run.smithi046.stdout:Depends: linux-image-5.4.0-148-generic, linux-modules-extra-5.4.0-148-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-21T16:42:41.804 INFO:teuthology.orchestra.run.smithi046.stdout:Recommends: thermald 2023-05-21T16:42:41.804 INFO:teuthology.orchestra.run.smithi046.stdout:Description: Generic Linux kernel image 2023-05-21T16:42:41.804 INFO:teuthology.orchestra.run.smithi046.stdout: This package will always depend on the latest generic kernel image 2023-05-21T16:42:41.804 INFO:teuthology.orchestra.run.smithi046.stdout: available. 2023-05-21T16:42:41.805 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-05-21T16:42:41.853 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.I0OxBPq91R 2023-05-21T16:42:41.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub/grub.cfg /tmp/tmp.I0OxBPq91R 2023-05-21T16:42:41.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.I0OxBPq91R 2023-05-21T16:42:41.900 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.I0OxBPq91R is 9KB 2023-05-21T16:42:41.912 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.I0OxBPq91R 2023-05-21T16:42:41.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-21T16:42:41.973 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:42:41.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-21T16:42:41.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-21T16:42:42.007 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-148-generic 2023-05-21T16:42:42.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo update-grub 2023-05-21T16:42:43.388 INFO:teuthology.orchestra.run.smithi046.stderr:Sourcing file `/etc/default/grub' 2023-05-21T16:42:43.400 INFO:teuthology.orchestra.run.smithi046.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-21T16:42:43.410 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2023-05-21T16:42:43.712 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-5.4.0-148-generic 2023-05-21T16:42:43.724 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initrd.img-5.4.0-148-generic 2023-05-21T16:42:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-05-21T16:42:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-05-21T16:42:45.815 INFO:teuthology.orchestra.run.smithi046.stderr:done 2023-05-21T16:42:45.817 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2023-05-21T16:43:09.419 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-21T16:43:09.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-05-21T16:43:09.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:43:15.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-21T16:43:15.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-05-21T16:43:15.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:43:27.984 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-05-21T16:43:34.384 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-05-21T16:43:58.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-05-21T16:43:58.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:44:04.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-05-21T16:44:04.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:44:07.440 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-05-21T16:44:13.301 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-05-21T16:44:37.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-05-21T16:44:37.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:44:38.121 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-05-21T16:44:38.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-05-21T16:44:38.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-148-generic"... 2023-05-21T16:44:38.986 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-05-21T16:44:38.992 INFO:teuthology.orchestra.run.smithi046.stdout:5.4.0-148-generic 2023-05-21T16:44:38.992 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-148-generic vs 5.4.0-148-generic 2023-05-21T16:44:38.992 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-21T16:44:38.992 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-21T16:44:39.993 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-21T16:44:39.993 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-21T16:44:40.091 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2023-05-21T16:44:40.123 DEBUG:teuthology.parallel:result is None 2023-05-21T16:44:43.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-05-21T16:44:43.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:44:43.508 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-05-21T16:44:44.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-05-21T16:44:44.105 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-148-generic"... 2023-05-21T16:44:44.106 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-05-21T16:44:44.154 INFO:teuthology.orchestra.run.smithi142.stdout:5.4.0-148-generic 2023-05-21T16:44:44.154 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-148-generic vs 5.4.0-148-generic 2023-05-21T16:44:44.155 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-21T16:44:44.155 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-21T16:44:45.156 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-21T16:44:45.156 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-21T16:44:45.258 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2023-05-21T16:44:45.295 DEBUG:teuthology.parallel:result is None 2023-05-21T16:44:45.296 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-21T16:44:45.305 INFO:teuthology.task.internal:Creating test directory... 2023-05-21T16:44:45.306 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-21T16:44:45.308 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-21T16:44:45.314 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-21T16:44:45.322 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-21T16:44:45.333 INFO:teuthology.task.internal:Creating archive directory... 2023-05-21T16:44:45.333 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-21T16:44:45.335 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-21T16:44:45.380 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-21T16:44:45.388 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-21T16:44:45.388 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-21T16:44:45.390 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-21T16:44:45.407 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-21T16:44:45.417 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-21T16:44:45.417 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-21T16:44:45.427 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-21T16:44:45.429 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-21T16:44:45.438 INFO:teuthology.task.internal:Configuring sudo... 2023-05-21T16:44:45.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-21T16:44:45.475 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-21T16:44:45.492 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-21T16:44:45.506 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-21T16:44:45.507 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-21T16:44:45.510 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-21T16:44:45.516 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-21T16:44:45.524 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-21T16:44:45.572 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:44:45.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-21T16:44:45.598 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-21T16:44:45.605 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-21T16:44:45.613 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:44:45.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-21T16:44:45.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2023-05-21T16:44:45.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-05-21T16:44:45.741 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-21T16:44:45.751 INFO:teuthology.task.internal:Starting timer... 2023-05-21T16:44:45.752 INFO:teuthology.run_tasks:Running task pcp... 2023-05-21T16:44:45.766 INFO:teuthology.run_tasks:Running task selinux... 2023-05-21T16:44:45.774 DEBUG:teuthology.task.selinux:Excluding smithi046: OS 'ubuntu' does not support SELinux 2023-05-21T16:44:45.775 DEBUG:teuthology.task.selinux:Excluding smithi142: OS 'ubuntu' does not support SELinux 2023-05-21T16:44:45.775 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-21T16:44:45.775 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-05-21T16:44:45.776 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-21T16:44:45.776 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-21T16:44:45.799 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-21T16:44:45.805 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-21T16:44:45.969 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-21T16:44:46.028 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-21T16:44:46.029 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-21T16:50:16.648 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2023-05-21T16:50:16.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-05-21T16:50:16.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:50:16.715 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-05-21T16:50:16.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-05-21T16:50:16.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-21T16:50:16.895 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-05-21T16:50:17.017 INFO:teuthology.run_tasks:Running task clock... 2023-05-21T16:50:17.030 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-21T16:50:17.030 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-21T16:50:17.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-21T16:50:17.033 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-21T16:50:17.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-21T16:50:17.067 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-05-21T16:50:17.067 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Command line: ntpd -gq 2023-05-21T16:50:17.068 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: proto: precision = 0.120 usec (-23) 2023-05-21T16:50:17.069 INFO:teuthology.orchestra.run.smithi046.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-21T16:50:17.069 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-21T16:50:17.070 INFO:teuthology.orchestra.run.smithi046.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-21T16:50:17.070 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: restrict ::: KOD does nothing without LIMITED. 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listen and drop on 0 v6wildcard [::]:123 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listen normally on 2 lo 127.0.0.1:123 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listen normally on 3 ens1f0 172.21.15.46:123 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listen normally on 4 lo [::1]:123 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15f8%4]:123 2023-05-21T16:50:17.071 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:17 ntpd[21799]: Listening on routing socket on fd #22 for interface updates 2023-05-21T16:50:17.092 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-05-21T16:50:17.092 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Command line: ntpd -gq 2023-05-21T16:50:17.093 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: proto: precision = 0.117 usec (-23) 2023-05-21T16:50:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-21T16:50:17.094 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-21T16:50:17.094 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: restrict ::: KOD does nothing without LIMITED. 2023-05-21T16:50:17.094 INFO:teuthology.orchestra.run.smithi142.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-21T16:50:17.095 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listen and drop on 0 v6wildcard [::]:123 2023-05-21T16:50:17.095 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-21T16:50:17.095 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listen normally on 2 lo 127.0.0.1:123 2023-05-21T16:50:17.096 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listen normally on 3 enp3s0f1 172.21.15.142:123 2023-05-21T16:50:17.096 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listen normally on 4 lo [::1]:123 2023-05-21T16:50:17.096 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e0d%5]:123 2023-05-21T16:50:17.096 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:17 ntpd[21881]: Listening on routing socket on fd #22 for interface updates 2023-05-21T16:50:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:18.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:18 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:18.092 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:18 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:18.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:18 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:19.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:19 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:19.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:19 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:19.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:19 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:19.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:19 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:19.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:19 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:19.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:19 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:19.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:19 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:19.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:19 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:20.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:20.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:20.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:20.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:20.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:20 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:21 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:21 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:21 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:21 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:21 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:21.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:21 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:22.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:22 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:22.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:22.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:22.095 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:22 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:23.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:23 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:23.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:23 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:23.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:23 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:23.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:23 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:23.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:23 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:23.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:23 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:24.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:24.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:24.070 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:24.070 INFO:teuthology.orchestra.run.smithi046.stdout:21 May 16:50:24 ntpd[21799]: ntpd: time slew +0.003855 s 2023-05-21T16:50:24.071 INFO:teuthology.orchestra.run.smithi046.stdout:ntpd: time slew +0.003855s 2023-05-21T16:50:24.071 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-21T16:50:24.071 INFO:teuthology.orchestra.run.smithi046.stderr:21 May 16:50:24 ntpd[21799]: can't open /var/log/ntpstats/loopstats.20230521: Permission denied 2023-05-21T16:50:24.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:24.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:24.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:24.095 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:24.095 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:24.095 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:24 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: remote refid st t when poll reach delay offset jitter 2023-05-21T16:50:24.232 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================== 2023-05-21T16:50:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:25.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:25.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:25.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-21T16:50:25.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: can't open /var/log/ntpstats/rawstats.20230521: Permission denied 2023-05-21T16:50:25.093 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-21T16:50:25.094 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: can't open /var/log/ntpstats/peerstats.20230521: Permission denied 2023-05-21T16:50:25.094 INFO:teuthology.orchestra.run.smithi142.stdout:21 May 16:50:25 ntpd[21881]: ntpd: time slew +0.005858 s 2023-05-21T16:50:25.094 INFO:teuthology.orchestra.run.smithi142.stdout:ntpd: time slew +0.005858s 2023-05-21T16:50:25.095 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-21T16:50:25.095 INFO:teuthology.orchestra.run.smithi142.stderr:21 May 16:50:25 ntpd[21881]: can't open /var/log/ntpstats/loopstats.20230521: Permission denied 2023-05-21T16:50:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2023-05-21T16:50:25.158 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2023-05-21T16:50:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:25.159 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-21T16:50:25.159 INFO:teuthology.run_tasks:Running task install... 2023-05-21T16:50:25.168 DEBUG:teuthology.task.install:project ceph 2023-05-21T16:50:25.169 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1'}} 2023-05-21T16:50:25.169 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1'} 2023-05-21T16:50:25.169 INFO:teuthology.task.install:Using flavor: default 2023-05-21T16:50:25.175 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-21T16:50:25.175 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-21T16:50:25.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-key list | grep Ceph 2023-05-21T16:50:25.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-key list | grep Ceph 2023-05-21T16:50:25.278 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-05-21T16:50:25.278 INFO:teuthology.orchestra.run.smithi046.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-05-21T16:50:25.337 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-21T16:50:25.337 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph.com (release key) 2023-05-21T16:50:25.338 INFO:teuthology.orchestra.run.smithi046.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-21T16:50:25.338 INFO:teuthology.orchestra.run.smithi046.stdout:uid [ unknown] Ceph.com (release key) 2023-05-21T16:50:25.339 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-21T16:50:25.339 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-21T16:50:25.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 2023-05-21T16:50:25.344 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-21T16:50:25.344 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-21T16:50:25.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 2023-05-21T16:50:25.478 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default/ 2023-05-21T16:50:25.478 INFO:teuthology.task.install.deb:Package version is 18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:50:25.496 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default/ 2023-05-21T16:50:25.496 INFO:teuthology.task.install.deb:Package version is 18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:50:25.591 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:50:25.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-21T16:50:25.599 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:50:25.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-21T16:50:25.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2023-05-21T16:50:25.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get update 2023-05-21T16:50:25.791 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-21T16:50:25.797 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-05-21T16:50:25.812 INFO:teuthology.orchestra.run.smithi046.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal InRelease 2023-05-21T16:50:25.814 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-05-21T16:50:25.834 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-05-21T16:50:25.849 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal InRelease 2023-05-21T16:50:25.858 INFO:teuthology.orchestra.run.smithi046.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal Release.gpg 2023-05-21T16:50:25.871 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-05-21T16:50:25.887 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-21T16:50:25.887 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main i386 Packages [3,414 B] 2023-05-21T16:50:25.897 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal Release.gpg 2023-05-21T16:50:25.904 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-05-21T16:50:25.910 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-05-21T16:50:25.918 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-05-21T16:50:25.926 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-05-21T16:50:25.955 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main i386 Packages [3,414 B] 2023-05-21T16:50:25.956 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-05-21T16:50:26.299 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-05-21T16:50:26.432 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 142 kB in 1s (230 kB/s) 2023-05-21T16:50:26.694 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 364 kB in 1s (399 kB/s) 2023-05-21T16:50:27.414 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:50:27.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3996-g5ca1fdcf-1focal cephadm=18.0.0-3996-g5ca1fdcf-1focal ceph-mds=18.0.0-3996-g5ca1fdcf-1focal ceph-mgr=18.0.0-3996-g5ca1fdcf-1focal ceph-common=18.0.0-3996-g5ca1fdcf-1focal ceph-fuse=18.0.0-3996-g5ca1fdcf-1focal ceph-test=18.0.0-3996-g5ca1fdcf-1focal ceph-volume=18.0.0-3996-g5ca1fdcf-1focal radosgw=18.0.0-3996-g5ca1fdcf-1focal python3-rados=18.0.0-3996-g5ca1fdcf-1focal python3-rgw=18.0.0-3996-g5ca1fdcf-1focal python3-cephfs=18.0.0-3996-g5ca1fdcf-1focal python3-rbd=18.0.0-3996-g5ca1fdcf-1focal libcephfs2=18.0.0-3996-g5ca1fdcf-1focal libcephfs-dev=18.0.0-3996-g5ca1fdcf-1focal librados2=18.0.0-3996-g5ca1fdcf-1focal librbd1=18.0.0-3996-g5ca1fdcf-1focal rbd-fuse=18.0.0-3996-g5ca1fdcf-1focal python3-cephfs=18.0.0-3996-g5ca1fdcf-1focal cephfs-shell=18.0.0-3996-g5ca1fdcf-1focal cephfs-top=18.0.0-3996-g5ca1fdcf-1focal cephfs-mirror=18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:50:27.506 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:50:27.677 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2023-05-21T16:50:27.678 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2023-05-21T16:50:27.698 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:50:27.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3996-g5ca1fdcf-1focal cephadm=18.0.0-3996-g5ca1fdcf-1focal ceph-mds=18.0.0-3996-g5ca1fdcf-1focal ceph-mgr=18.0.0-3996-g5ca1fdcf-1focal ceph-common=18.0.0-3996-g5ca1fdcf-1focal ceph-fuse=18.0.0-3996-g5ca1fdcf-1focal ceph-test=18.0.0-3996-g5ca1fdcf-1focal ceph-volume=18.0.0-3996-g5ca1fdcf-1focal radosgw=18.0.0-3996-g5ca1fdcf-1focal python3-rados=18.0.0-3996-g5ca1fdcf-1focal python3-rgw=18.0.0-3996-g5ca1fdcf-1focal python3-cephfs=18.0.0-3996-g5ca1fdcf-1focal python3-rbd=18.0.0-3996-g5ca1fdcf-1focal libcephfs2=18.0.0-3996-g5ca1fdcf-1focal libcephfs-dev=18.0.0-3996-g5ca1fdcf-1focal librados2=18.0.0-3996-g5ca1fdcf-1focal librbd1=18.0.0-3996-g5ca1fdcf-1focal rbd-fuse=18.0.0-3996-g5ca1fdcf-1focal python3-cephfs=18.0.0-3996-g5ca1fdcf-1focal cephfs-shell=18.0.0-3996-g5ca1fdcf-1focal cephfs-top=18.0.0-3996-g5ca1fdcf-1focal cephfs-mirror=18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:50:27.794 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:50:27.838 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2023-05-21T16:50:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-05-21T16:50:27.839 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-21T16:50:27.839 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2023-05-21T16:50:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-21T16:50:27.839 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-05-21T16:50:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-05-21T16:50:27.840 INFO:teuthology.orchestra.run.smithi142.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-05-21T16:50:27.841 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-05-21T16:50:27.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-05-21T16:50:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-05-21T16:50:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-05-21T16:50:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-05-21T16:50:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-21T16:50:27.843 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2023-05-21T16:50:27.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-05-21T16:50:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-05-21T16:50:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-05-21T16:50:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-05-21T16:50:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-05-21T16:50:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-05-21T16:50:27.844 INFO:teuthology.orchestra.run.smithi142.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-05-21T16:50:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-05-21T16:50:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-05-21T16:50:27.845 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2023-05-21T16:50:27.845 INFO:teuthology.orchestra.run.smithi142.stdout: btrfs-tools 2023-05-21T16:50:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2023-05-21T16:50:27.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-21T16:50:27.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-21T16:50:27.963 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-21T16:50:27.963 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-05-21T16:50:27.963 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-05-21T16:50:27.964 INFO:teuthology.orchestra.run.smithi142.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-05-21T16:50:27.964 INFO:teuthology.orchestra.run.smithi142.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-05-21T16:50:27.964 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-05-21T16:50:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-05-21T16:50:27.966 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-05-21T16:50:27.967 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-05-21T16:50:27.967 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-05-21T16:50:27.967 INFO:teuthology.orchestra.run.smithi142.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-05-21T16:50:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2023-05-21T16:50:27.967 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 librbd1 2023-05-21T16:50:27.992 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2023-05-21T16:50:27.992 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2023-05-21T16:50:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:2 upgraded, 116 newly installed, 0 to remove and 164 not upgraded. 2023-05-21T16:50:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 201 MB of archives. 2023-05-21T16:50:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-05-21T16:50:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-05-21T16:50:28.047 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-05-21T16:50:28.054 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-05-21T16:50:28.080 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-05-21T16:50:28.109 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-05-21T16:50:28.112 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-05-21T16:50:28.113 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-3996-g5ca1fdcf-1focal [3,431 kB] 2023-05-21T16:50:28.125 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-05-21T16:50:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-05-21T16:50:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-05-21T16:50:28.174 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2023-05-21T16:50:28.175 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-05-21T16:50:28.175 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-21T16:50:28.176 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2023-05-21T16:50:28.176 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-21T16:50:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-05-21T16:50:28.177 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-05-21T16:50:28.177 INFO:teuthology.orchestra.run.smithi046.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-05-21T16:50:28.178 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-05-21T16:50:28.179 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-05-21T16:50:28.180 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-05-21T16:50:28.180 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-05-21T16:50:28.180 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-05-21T16:50:28.180 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-05-21T16:50:28.180 INFO:teuthology.orchestra.run.smithi046.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi046.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi046.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi046.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-05-21T16:50:28.181 INFO:teuthology.orchestra.run.smithi046.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-05-21T16:50:28.182 INFO:teuthology.orchestra.run.smithi046.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-05-21T16:50:28.182 INFO:teuthology.orchestra.run.smithi046.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-05-21T16:50:28.182 INFO:teuthology.orchestra.run.smithi046.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-05-21T16:50:28.182 INFO:teuthology.orchestra.run.smithi046.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-05-21T16:50:28.182 INFO:teuthology.orchestra.run.smithi046.stdout:Recommended packages: 2023-05-21T16:50:28.182 INFO:teuthology.orchestra.run.smithi046.stdout: btrfs-tools 2023-05-21T16:50:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-05-21T16:50:28.287 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-05-21T16:50:28.291 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-05-21T16:50:28.298 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2023-05-21T16:50:28.298 INFO:teuthology.orchestra.run.smithi046.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-21T16:50:28.299 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-21T16:50:28.299 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-21T16:50:28.299 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-05-21T16:50:28.300 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-05-21T16:50:28.300 INFO:teuthology.orchestra.run.smithi046.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-05-21T16:50:28.300 INFO:teuthology.orchestra.run.smithi046.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-05-21T16:50:28.300 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-05-21T16:50:28.300 INFO:teuthology.orchestra.run.smithi046.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-05-21T16:50:28.301 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-05-21T16:50:28.302 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-05-21T16:50:28.303 INFO:teuthology.orchestra.run.smithi046.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-05-21T16:50:28.303 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages will be upgraded: 2023-05-21T16:50:28.303 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 librbd1 2023-05-21T16:50:28.318 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-3996-g5ca1fdcf-1focal [3,986 kB] 2023-05-21T16:50:28.327 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-05-21T16:50:28.329 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-05-21T16:50:28.335 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-05-21T16:50:28.337 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-05-21T16:50:28.338 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-05-21T16:50:28.338 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-05-21T16:50:28.341 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-21T16:50:28.341 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-05-21T16:50:28.376 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-05-21T16:50:28.440 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-3996-g5ca1fdcf-1focal [724 kB] 2023-05-21T16:50:28.443 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-05-21T16:50:28.448 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-05-21T16:50:28.462 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-05-21T16:50:28.464 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-3996-g5ca1fdcf-1focal [377 kB] 2023-05-21T16:50:28.475 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-05-21T16:50:28.476 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-3996-g5ca1fdcf-1focal [22.5 kB] 2023-05-21T16:50:28.477 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-3996-g5ca1fdcf-1focal [191 kB] 2023-05-21T16:50:28.477 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-05-21T16:50:28.483 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-3996-g5ca1fdcf-1focal [48.3 kB] 2023-05-21T16:50:28.485 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-3996-g5ca1fdcf-1focal [354 kB] 2023-05-21T16:50:28.493 INFO:teuthology.orchestra.run.smithi046.stdout:2 upgraded, 116 newly installed, 0 to remove and 164 not upgraded. 2023-05-21T16:50:28.493 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 201 MB of archives. 2023-05-21T16:50:28.493 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-05-21T16:50:28.493 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-05-21T16:50:28.497 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-3996-g5ca1fdcf-1focal [6,573 kB] 2023-05-21T16:50:28.502 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-05-21T16:50:28.503 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-05-21T16:50:28.504 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-05-21T16:50:28.505 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-05-21T16:50:28.508 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-05-21T16:50:28.527 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-3996-g5ca1fdcf-1focal [3,431 kB] 2023-05-21T16:50:28.546 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-05-21T16:50:28.576 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-05-21T16:50:28.610 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-05-21T16:50:28.638 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-05-21T16:50:28.640 INFO:teuthology.orchestra.run.smithi142.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-05-21T16:50:28.649 INFO:teuthology.orchestra.run.smithi142.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-05-21T16:50:28.658 INFO:teuthology.orchestra.run.smithi142.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-05-21T16:50:28.660 INFO:teuthology.orchestra.run.smithi142.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-05-21T16:50:28.661 INFO:teuthology.orchestra.run.smithi142.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-21T16:50:28.662 INFO:teuthology.orchestra.run.smithi142.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-05-21T16:50:28.668 INFO:teuthology.orchestra.run.smithi142.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-05-21T16:50:28.672 INFO:teuthology.orchestra.run.smithi142.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-05-21T16:50:28.675 INFO:teuthology.orchestra.run.smithi142.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-05-21T16:50:28.710 INFO:teuthology.orchestra.run.smithi142.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-05-21T16:50:28.723 INFO:teuthology.orchestra.run.smithi142.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-3996-g5ca1fdcf-1focal [104 kB] 2023-05-21T16:50:28.726 INFO:teuthology.orchestra.run.smithi142.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-3996-g5ca1fdcf-1focal [467 kB] 2023-05-21T16:50:28.734 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-05-21T16:50:28.741 INFO:teuthology.orchestra.run.smithi142.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-3996-g5ca1fdcf-1focal [25.1 MB] 2023-05-21T16:50:28.750 INFO:teuthology.orchestra.run.smithi142.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-05-21T16:50:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-05-21T16:50:28.889 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-05-21T16:50:28.916 INFO:teuthology.orchestra.run.smithi142.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-05-21T16:50:28.931 INFO:teuthology.orchestra.run.smithi142.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-05-21T16:50:28.951 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-05-21T16:50:28.989 INFO:teuthology.orchestra.run.smithi142.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-05-21T16:50:29.008 INFO:teuthology.orchestra.run.smithi142.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-05-21T16:50:29.008 INFO:teuthology.orchestra.run.smithi142.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-05-21T16:50:29.009 INFO:teuthology.orchestra.run.smithi142.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-05-21T16:50:29.009 INFO:teuthology.orchestra.run.smithi142.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-05-21T16:50:29.009 INFO:teuthology.orchestra.run.smithi142.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-05-21T16:50:29.010 INFO:teuthology.orchestra.run.smithi142.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-05-21T16:50:29.044 INFO:teuthology.orchestra.run.smithi142.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-05-21T16:50:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-05-21T16:50:29.114 INFO:teuthology.orchestra.run.smithi142.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-05-21T16:50:29.119 INFO:teuthology.orchestra.run.smithi142.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-05-21T16:50:29.148 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-05-21T16:50:29.152 INFO:teuthology.orchestra.run.smithi142.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-05-21T16:50:29.159 INFO:teuthology.orchestra.run.smithi046.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-05-21T16:50:29.160 INFO:teuthology.orchestra.run.smithi142.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-05-21T16:50:29.166 INFO:teuthology.orchestra.run.smithi142.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-05-21T16:50:29.168 INFO:teuthology.orchestra.run.smithi142.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-05-21T16:50:29.178 INFO:teuthology.orchestra.run.smithi142.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-05-21T16:50:29.183 INFO:teuthology.orchestra.run.smithi142.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-05-21T16:50:29.183 INFO:teuthology.orchestra.run.smithi142.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-05-21T16:50:29.185 INFO:teuthology.orchestra.run.smithi046.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-05-21T16:50:29.195 INFO:teuthology.orchestra.run.smithi046.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-05-21T16:50:29.243 INFO:teuthology.orchestra.run.smithi142.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-05-21T16:50:29.341 INFO:teuthology.orchestra.run.smithi142.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-05-21T16:50:29.352 INFO:teuthology.orchestra.run.smithi142.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-05-21T16:50:29.360 INFO:teuthology.orchestra.run.smithi046.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-05-21T16:50:29.427 INFO:teuthology.orchestra.run.smithi142.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-05-21T16:50:29.428 INFO:teuthology.orchestra.run.smithi142.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-05-21T16:50:29.428 INFO:teuthology.orchestra.run.smithi142.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-05-21T16:50:29.428 INFO:teuthology.orchestra.run.smithi142.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-05-21T16:50:29.429 INFO:teuthology.orchestra.run.smithi142.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-05-21T16:50:29.430 INFO:teuthology.orchestra.run.smithi142.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-05-21T16:50:29.441 INFO:teuthology.orchestra.run.smithi142.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-05-21T16:50:29.442 INFO:teuthology.orchestra.run.smithi142.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-21T16:50:29.505 INFO:teuthology.orchestra.run.smithi142.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-05-21T16:50:29.540 INFO:teuthology.orchestra.run.smithi142.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-05-21T16:50:29.584 INFO:teuthology.orchestra.run.smithi142.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-05-21T16:50:29.594 INFO:teuthology.orchestra.run.smithi142.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-05-21T16:50:29.596 INFO:teuthology.orchestra.run.smithi142.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-05-21T16:50:29.610 INFO:teuthology.orchestra.run.smithi142.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-05-21T16:50:29.613 INFO:teuthology.orchestra.run.smithi142.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-05-21T16:50:29.719 INFO:teuthology.orchestra.run.smithi046.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-05-21T16:50:29.737 INFO:teuthology.orchestra.run.smithi046.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-05-21T16:50:29.802 INFO:teuthology.orchestra.run.smithi142.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-3996-g5ca1fdcf-1focal [10.9 MB] 2023-05-21T16:50:29.879 INFO:teuthology.orchestra.run.smithi046.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-3996-g5ca1fdcf-1focal [3,986 kB] 2023-05-21T16:50:29.913 INFO:teuthology.orchestra.run.smithi046.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-05-21T16:50:29.923 INFO:teuthology.orchestra.run.smithi046.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-05-21T16:50:29.956 INFO:teuthology.orchestra.run.smithi046.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-05-21T16:50:29.962 INFO:teuthology.orchestra.run.smithi046.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-05-21T16:50:29.965 INFO:teuthology.orchestra.run.smithi046.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-05-21T16:50:29.968 INFO:teuthology.orchestra.run.smithi046.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-05-21T16:50:29.977 INFO:teuthology.orchestra.run.smithi046.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-21T16:50:29.978 INFO:teuthology.orchestra.run.smithi046.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-05-21T16:50:30.122 INFO:teuthology.orchestra.run.smithi142.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-3996-g5ca1fdcf-1focal [223 kB] 2023-05-21T16:50:30.125 INFO:teuthology.orchestra.run.smithi142.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3996-g5ca1fdcf-1focal [133 kB] 2023-05-21T16:50:30.128 INFO:teuthology.orchestra.run.smithi142.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-3996-g5ca1fdcf-1focal [1,552 kB] 2023-05-21T16:50:30.143 INFO:teuthology.orchestra.run.smithi046.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-05-21T16:50:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-3996-g5ca1fdcf-1focal [9,387 kB] 2023-05-21T16:50:30.459 INFO:teuthology.orchestra.run.smithi046.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-05-21T16:50:30.482 INFO:teuthology.orchestra.run.smithi046.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-05-21T16:50:30.533 INFO:teuthology.orchestra.run.smithi142.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-3996-g5ca1fdcf-1focal [31.3 MB] 2023-05-21T16:50:30.553 INFO:teuthology.orchestra.run.smithi046.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-05-21T16:50:30.615 INFO:teuthology.orchestra.run.smithi046.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-05-21T16:50:30.620 INFO:teuthology.orchestra.run.smithi046.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-3996-g5ca1fdcf-1focal [724 kB] 2023-05-21T16:50:30.624 INFO:teuthology.orchestra.run.smithi046.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-05-21T16:50:30.695 INFO:teuthology.orchestra.run.smithi046.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-3996-g5ca1fdcf-1focal [377 kB] 2023-05-21T16:50:30.744 INFO:teuthology.orchestra.run.smithi046.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-05-21T16:50:30.744 INFO:teuthology.orchestra.run.smithi046.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-05-21T16:50:30.748 INFO:teuthology.orchestra.run.smithi046.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-05-21T16:50:30.752 INFO:teuthology.orchestra.run.smithi046.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-05-21T16:50:30.759 INFO:teuthology.orchestra.run.smithi046.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-3996-g5ca1fdcf-1focal [22.5 kB] 2023-05-21T16:50:30.761 INFO:teuthology.orchestra.run.smithi046.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-3996-g5ca1fdcf-1focal [191 kB] 2023-05-21T16:50:30.763 INFO:teuthology.orchestra.run.smithi046.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-05-21T16:50:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-3996-g5ca1fdcf-1focal [48.3 kB] 2023-05-21T16:50:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-3996-g5ca1fdcf-1focal [354 kB] 2023-05-21T16:50:30.832 INFO:teuthology.orchestra.run.smithi046.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-3996-g5ca1fdcf-1focal [6,573 kB] 2023-05-21T16:50:30.949 INFO:teuthology.orchestra.run.smithi046.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-05-21T16:50:31.395 INFO:teuthology.orchestra.run.smithi046.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-05-21T16:50:31.407 INFO:teuthology.orchestra.run.smithi046.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-05-21T16:50:31.452 INFO:teuthology.orchestra.run.smithi046.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-05-21T16:50:31.495 INFO:teuthology.orchestra.run.smithi046.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-05-21T16:50:31.504 INFO:teuthology.orchestra.run.smithi046.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-05-21T16:50:31.509 INFO:teuthology.orchestra.run.smithi046.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-21T16:50:31.513 INFO:teuthology.orchestra.run.smithi046.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-05-21T16:50:31.540 INFO:teuthology.orchestra.run.smithi046.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-05-21T16:50:31.561 INFO:teuthology.orchestra.run.smithi046.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-05-21T16:50:31.572 INFO:teuthology.orchestra.run.smithi046.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-05-21T16:50:31.621 INFO:teuthology.orchestra.run.smithi046.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-3996-g5ca1fdcf-1focal [104 kB] 2023-05-21T16:50:31.624 INFO:teuthology.orchestra.run.smithi046.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-3996-g5ca1fdcf-1focal [467 kB] 2023-05-21T16:50:31.639 INFO:teuthology.orchestra.run.smithi046.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-3996-g5ca1fdcf-1focal [25.1 MB] 2023-05-21T16:50:31.738 INFO:teuthology.orchestra.run.smithi046.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-05-21T16:50:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-05-21T16:50:32.175 INFO:teuthology.orchestra.run.smithi142.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-3996-g5ca1fdcf-1focal [3,812 B] 2023-05-21T16:50:32.175 INFO:teuthology.orchestra.run.smithi142.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-3996-g5ca1fdcf-1focal [832 kB] 2023-05-21T16:50:32.189 INFO:teuthology.orchestra.run.smithi142.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-3996-g5ca1fdcf-1focal [2,292 kB] 2023-05-21T16:50:32.331 INFO:teuthology.orchestra.run.smithi142.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-3996-g5ca1fdcf-1focal [97.8 kB] 2023-05-21T16:50:32.333 INFO:teuthology.orchestra.run.smithi142.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-3996-g5ca1fdcf-1focal [122 kB] 2023-05-21T16:50:32.336 INFO:teuthology.orchestra.run.smithi142.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-3996-g5ca1fdcf-1focal [1,775 kB] 2023-05-21T16:50:32.381 INFO:teuthology.orchestra.run.smithi142.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3996-g5ca1fdcf-1focal [7,884 kB] 2023-05-21T16:50:32.704 INFO:teuthology.orchestra.run.smithi046.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-05-21T16:50:32.776 INFO:teuthology.orchestra.run.smithi046.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-05-21T16:50:32.779 INFO:teuthology.orchestra.run.smithi046.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-05-21T16:50:32.826 INFO:teuthology.orchestra.run.smithi046.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-05-21T16:50:32.826 INFO:teuthology.orchestra.run.smithi046.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-05-21T16:50:32.827 INFO:teuthology.orchestra.run.smithi046.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-05-21T16:50:32.828 INFO:teuthology.orchestra.run.smithi046.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-05-21T16:50:32.829 INFO:teuthology.orchestra.run.smithi046.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-05-21T16:50:32.830 INFO:teuthology.orchestra.run.smithi046.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-05-21T16:50:32.909 INFO:teuthology.orchestra.run.smithi142.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-3996-g5ca1fdcf-1focal [3,932 B] 2023-05-21T16:50:32.910 INFO:teuthology.orchestra.run.smithi142.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-3996-g5ca1fdcf-1focal [43.8 MB] 2023-05-21T16:50:32.994 INFO:teuthology.orchestra.run.smithi046.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-05-21T16:50:33.313 INFO:teuthology.orchestra.run.smithi046.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-05-21T16:50:33.326 INFO:teuthology.orchestra.run.smithi046.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-05-21T16:50:33.405 INFO:teuthology.orchestra.run.smithi046.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-05-21T16:50:33.406 INFO:teuthology.orchestra.run.smithi046.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-3996-g5ca1fdcf-1focal [10.9 MB] 2023-05-21T16:50:33.518 INFO:teuthology.orchestra.run.smithi046.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-05-21T16:50:33.568 INFO:teuthology.orchestra.run.smithi046.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-05-21T16:50:33.595 INFO:teuthology.orchestra.run.smithi046.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-05-21T16:50:33.604 INFO:teuthology.orchestra.run.smithi046.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-05-21T16:50:33.647 INFO:teuthology.orchestra.run.smithi046.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-05-21T16:50:33.678 INFO:teuthology.orchestra.run.smithi046.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-05-21T16:50:33.680 INFO:teuthology.orchestra.run.smithi046.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-05-21T16:50:33.963 INFO:teuthology.orchestra.run.smithi046.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-05-21T16:50:34.039 INFO:teuthology.orchestra.run.smithi046.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-3996-g5ca1fdcf-1focal [223 kB] 2023-05-21T16:50:34.044 INFO:teuthology.orchestra.run.smithi046.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3996-g5ca1fdcf-1focal [133 kB] 2023-05-21T16:50:34.063 INFO:teuthology.orchestra.run.smithi046.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-3996-g5ca1fdcf-1focal [1,552 kB] 2023-05-21T16:50:34.147 INFO:teuthology.orchestra.run.smithi046.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-3996-g5ca1fdcf-1focal [9,387 kB] 2023-05-21T16:50:34.432 INFO:teuthology.orchestra.run.smithi046.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-05-21T16:50:34.487 INFO:teuthology.orchestra.run.smithi046.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-05-21T16:50:34.754 INFO:teuthology.orchestra.run.smithi046.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-3996-g5ca1fdcf-1focal [31.3 MB] 2023-05-21T16:50:34.835 INFO:teuthology.orchestra.run.smithi046.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-05-21T16:50:34.837 INFO:teuthology.orchestra.run.smithi046.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-05-21T16:50:34.838 INFO:teuthology.orchestra.run.smithi046.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-05-21T16:50:34.839 INFO:teuthology.orchestra.run.smithi046.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-05-21T16:50:34.839 INFO:teuthology.orchestra.run.smithi046.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-05-21T16:50:34.841 INFO:teuthology.orchestra.run.smithi046.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-05-21T16:50:34.880 INFO:teuthology.orchestra.run.smithi046.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-05-21T16:50:34.881 INFO:teuthology.orchestra.run.smithi046.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-21T16:50:35.045 INFO:teuthology.orchestra.run.smithi046.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-05-21T16:50:35.212 INFO:teuthology.orchestra.run.smithi046.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-05-21T16:50:35.426 INFO:teuthology.orchestra.run.smithi046.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-05-21T16:50:35.473 INFO:teuthology.orchestra.run.smithi046.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-05-21T16:50:35.486 INFO:teuthology.orchestra.run.smithi046.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-05-21T16:50:35.549 INFO:teuthology.orchestra.run.smithi046.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-05-21T16:50:35.563 INFO:teuthology.orchestra.run.smithi046.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-05-21T16:50:36.065 INFO:teuthology.orchestra.run.smithi142.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-3996-g5ca1fdcf-1focal [226 kB] 2023-05-21T16:50:36.069 INFO:teuthology.orchestra.run.smithi142.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-3996-g5ca1fdcf-1focal [253 kB] 2023-05-21T16:50:36.075 INFO:teuthology.orchestra.run.smithi142.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-3996-g5ca1fdcf-1focal [23.3 kB] 2023-05-21T16:50:36.075 INFO:teuthology.orchestra.run.smithi142.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-3996-g5ca1fdcf-1focal [12.9 kB] 2023-05-21T16:50:36.076 INFO:teuthology.orchestra.run.smithi142.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-3996-g5ca1fdcf-1focal [28.0 kB] 2023-05-21T16:50:36.077 INFO:teuthology.orchestra.run.smithi142.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-3996-g5ca1fdcf-1focal [13.4 MB] 2023-05-21T16:50:36.835 INFO:teuthology.orchestra.run.smithi046.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-3996-g5ca1fdcf-1focal [3,812 B] 2023-05-21T16:50:36.836 INFO:teuthology.orchestra.run.smithi046.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-3996-g5ca1fdcf-1focal [832 kB] 2023-05-21T16:50:36.837 INFO:teuthology.orchestra.run.smithi142.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-3996-g5ca1fdcf-1focal [97.2 kB] 2023-05-21T16:50:36.851 INFO:teuthology.orchestra.run.smithi046.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-3996-g5ca1fdcf-1focal [2,292 kB] 2023-05-21T16:50:36.868 INFO:teuthology.orchestra.run.smithi046.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-3996-g5ca1fdcf-1focal [97.8 kB] 2023-05-21T16:50:36.871 INFO:teuthology.orchestra.run.smithi046.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-3996-g5ca1fdcf-1focal [122 kB] 2023-05-21T16:50:36.874 INFO:teuthology.orchestra.run.smithi046.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-3996-g5ca1fdcf-1focal [1,775 kB] 2023-05-21T16:50:36.934 INFO:teuthology.orchestra.run.smithi046.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3996-g5ca1fdcf-1focal [7,884 kB] 2023-05-21T16:50:37.193 INFO:teuthology.orchestra.run.smithi046.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-3996-g5ca1fdcf-1focal [3,932 B] 2023-05-21T16:50:37.193 INFO:teuthology.orchestra.run.smithi046.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-3996-g5ca1fdcf-1focal [43.8 MB] 2023-05-21T16:50:37.474 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 201 MB in 9s (22.7 MB/s) 2023-05-21T16:50:37.615 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-21T16:50:37.672 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141757 files and directories currently installed.) 2023-05-21T16:50:37.677 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-05-21T16:50:37.713 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-05-21T16:50:38.049 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-21T16:50:38.066 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-05-21T16:50:38.107 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-05-21T16:50:38.452 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cmd2. 2023-05-21T16:50:38.470 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-05-21T16:50:38.510 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-05-21T16:50:38.860 INFO:teuthology.orchestra.run.smithi046.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-3996-g5ca1fdcf-1focal [226 kB] 2023-05-21T16:50:38.864 INFO:teuthology.orchestra.run.smithi046.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-3996-g5ca1fdcf-1focal [253 kB] 2023-05-21T16:50:38.869 INFO:teuthology.orchestra.run.smithi046.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-3996-g5ca1fdcf-1focal [23.3 kB] 2023-05-21T16:50:38.870 INFO:teuthology.orchestra.run.smithi046.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-3996-g5ca1fdcf-1focal [12.9 kB] 2023-05-21T16:50:38.870 INFO:teuthology.orchestra.run.smithi046.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-3996-g5ca1fdcf-1focal [28.0 kB] 2023-05-21T16:50:38.871 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-05-21T16:50:38.871 INFO:teuthology.orchestra.run.smithi046.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-3996-g5ca1fdcf-1focal [13.4 MB] 2023-05-21T16:50:38.888 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-05-21T16:50:38.971 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-05-21T16:50:39.198 INFO:teuthology.orchestra.run.smithi046.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-05-18-0655/5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-3996-g5ca1fdcf-1focal [97.2 kB] 2023-05-21T16:50:39.316 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-21T16:50:39.335 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-05-21T16:50:39.374 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-05-21T16:50:39.727 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-21T16:50:39.744 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-05-21T16:50:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-05-21T16:50:39.832 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 201 MB in 11s (18.5 MB/s) 2023-05-21T16:50:39.953 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-21T16:50:40.010 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141757 files and directories currently installed.) 2023-05-21T16:50:40.015 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-05-21T16:50:40.051 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-05-21T16:50:40.289 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-21T16:50:40.304 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-21T16:50:40.357 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:50:40.379 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-21T16:50:40.397 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-05-21T16:50:40.437 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-05-21T16:50:40.723 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cmd2. 2023-05-21T16:50:40.740 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-05-21T16:50:40.782 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-05-21T16:50:40.883 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-21T16:50:40.900 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-21T16:50:40.941 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:50:41.109 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-05-21T16:50:41.127 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-05-21T16:50:41.193 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-05-21T16:50:41.311 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-21T16:50:41.330 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-21T16:50:41.369 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:50:41.496 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-21T16:50:41.513 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-05-21T16:50:41.555 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-05-21T16:50:41.789 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-05-21T16:50:41.807 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-05-21T16:50:41.865 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-05-21T16:50:41.907 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-21T16:50:41.924 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-05-21T16:50:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-05-21T16:50:42.251 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../010-librbd1_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:42.366 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librbd1 (18.0.0-3996-g5ca1fdcf-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-05-21T16:50:42.436 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-21T16:50:42.455 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-21T16:50:42.504 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:50:42.997 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-21T16:50:43.013 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-21T16:50:43.055 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:50:43.079 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../011-librados2_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librados2 (18.0.0-3996-g5ca1fdcf-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-05-21T16:50:43.416 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-21T16:50:43.433 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-21T16:50:43.475 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:50:43.902 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-05-21T16:50:43.921 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-05-21T16:50:43.961 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-05-21T16:50:44.091 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs2. 2023-05-21T16:50:44.110 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:44.224 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:44.316 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../010-librbd1_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:44.431 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librbd1 (18.0.0-3996-g5ca1fdcf-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-05-21T16:50:44.552 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rados. 2023-05-21T16:50:44.570 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../013-python3-rados_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:44.610 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rados (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:44.959 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-21T16:50:44.978 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:50:45.009 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-argparse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:45.151 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../011-librados2_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:45.276 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librados2 (18.0.0-3996-g5ca1fdcf-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-05-21T16:50:45.304 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cephfs. 2023-05-21T16:50:45.321 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:45.362 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cephfs (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:45.714 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-21T16:50:45.734 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:50:45.772 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:45.972 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libcephfs2. 2023-05-21T16:50:45.991 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:46.022 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libcephfs2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:46.155 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-prettytable. 2023-05-21T16:50:46.174 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-05-21T16:50:46.217 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-05-21T16:50:46.370 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rados. 2023-05-21T16:50:46.388 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../013-python3-rados_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:46.428 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rados (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:46.471 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rbd. 2023-05-21T16:50:46.487 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:46.546 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rbd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:46.790 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-21T16:50:46.806 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:50:46.849 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-ceph-argparse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-05-21T16:50:46.940 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-05-21T16:50:46.982 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-05-21T16:50:47.101 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cephfs. 2023-05-21T16:50:47.119 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:47.159 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cephfs (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-05-21T16:50:47.397 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-05-21T16:50:47.435 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-05-21T16:50:47.512 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-21T16:50:47.529 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:50:47.570 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:47.797 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-21T16:50:47.813 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-05-21T16:50:47.855 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-05-21T16:50:47.873 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-prettytable. 2023-05-21T16:50:47.892 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-05-21T16:50:47.923 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-05-21T16:50:48.177 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rbd. 2023-05-21T16:50:48.196 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:48.209 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librgw2. 2023-05-21T16:50:48.225 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../022-librgw2_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:48.235 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rbd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:48.292 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librgw2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:48.571 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-05-21T16:50:48.591 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-05-21T16:50:48.629 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-05-21T16:50:48.950 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-05-21T16:50:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-05-21T16:50:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-05-21T16:50:49.161 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rgw. 2023-05-21T16:50:49.180 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:49.219 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:49.320 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-21T16:50:49.340 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-05-21T16:50:49.404 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-05-21T16:50:49.605 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liboath0. 2023-05-21T16:50:49.625 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-05-21T16:50:49.688 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-05-21T16:50:49.749 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librgw2. 2023-05-21T16:50:49.765 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../022-librgw2_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:49.807 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librgw2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:49.974 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libradosstriper1. 2023-05-21T16:50:49.994 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:50.066 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libradosstriper1 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:50.536 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-common. 2023-05-21T16:50:50.555 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../026-ceph-common_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:50.593 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:50.651 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rgw. 2023-05-21T16:50:50.671 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:50.701 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:51.029 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liboath0. 2023-05-21T16:50:51.048 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-05-21T16:50:51.087 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-05-21T16:50:51.400 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libradosstriper1. 2023-05-21T16:50:51.417 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:51.458 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libradosstriper1 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:51.861 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-common. 2023-05-21T16:50:51.880 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../026-ceph-common_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:51.936 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:53.115 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-base. 2023-05-21T16:50:53.134 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../027-ceph-base_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:53.204 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-base (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:54.442 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-base. 2023-05-21T16:50:54.458 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../027-ceph-base_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:50:54.510 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-base (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:50:54.686 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-21T16:50:54.706 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-05-21T16:50:54.744 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-05-21T16:50:55.106 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-natsort. 2023-05-21T16:50:55.126 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-05-21T16:50:55.164 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-05-21T16:50:55.500 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-logutils. 2023-05-21T16:50:55.518 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-05-21T16:50:55.558 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-05-21T16:50:55.886 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-21T16:50:55.906 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-05-21T16:50:55.944 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-05-21T16:50:56.004 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-21T16:50:56.021 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-05-21T16:50:56.062 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-05-21T16:50:56.305 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-mako. 2023-05-21T16:50:56.321 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-05-21T16:50:56.388 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-05-21T16:50:56.407 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-natsort. 2023-05-21T16:50:56.423 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-05-21T16:50:56.490 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-05-21T16:50:56.756 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-21T16:50:56.775 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-21T16:50:56.785 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-logutils. 2023-05-21T16:50:56.804 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-05-21T16:50:56.813 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-21T16:50:56.835 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-05-21T16:50:57.071 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-21T16:50:57.087 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-05-21T16:50:57.137 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-05-21T16:50:57.145 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-21T16:50:57.165 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-05-21T16:50:57.203 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-05-21T16:50:57.440 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-mako. 2023-05-21T16:50:57.460 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-05-21T16:50:57.498 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-05-21T16:50:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webob. 2023-05-21T16:50:57.538 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-05-21T16:50:57.578 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-05-21T16:50:57.841 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-21T16:50:57.857 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-21T16:50:57.902 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-21T16:50:57.922 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-soupsieve. 2023-05-21T16:50:57.942 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-05-21T16:50:57.980 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-05-21T16:50:58.164 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-21T16:50:58.183 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-05-21T16:50:58.214 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-05-21T16:50:58.283 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bs4. 2023-05-21T16:50:58.299 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-05-21T16:50:58.333 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-05-21T16:50:58.522 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-webob. 2023-05-21T16:50:58.540 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-05-21T16:50:58.572 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-05-21T16:50:58.653 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-waitress. 2023-05-21T16:50:58.672 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-05-21T16:50:58.706 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-05-21T16:50:58.891 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-soupsieve. 2023-05-21T16:50:58.907 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-05-21T16:50:58.949 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-05-21T16:50:58.981 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempita. 2023-05-21T16:50:58.999 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-05-21T16:50:59.030 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-05-21T16:50:59.285 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-bs4. 2023-05-21T16:50:59.302 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-05-21T16:50:59.333 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-paste. 2023-05-21T16:50:59.343 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-05-21T16:50:59.349 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-05-21T16:50:59.391 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-05-21T16:50:59.705 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-waitress. 2023-05-21T16:50:59.724 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-05-21T16:50:59.767 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-05-21T16:51:00.101 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-tempita. 2023-05-21T16:51:00.117 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-05-21T16:51:00.158 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-05-21T16:51:00.445 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-paste. 2023-05-21T16:51:00.464 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-05-21T16:51:00.494 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-05-21T16:51:00.562 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-21T16:51:00.579 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-05-21T16:51:00.620 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-05-21T16:51:00.931 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-21T16:51:00.950 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-05-21T16:51:01.014 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-05-21T16:51:01.317 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webtest. 2023-05-21T16:51:01.335 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-05-21T16:51:01.392 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-05-21T16:51:01.448 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-21T16:51:01.468 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-05-21T16:51:01.506 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-05-21T16:51:01.671 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pecan. 2023-05-21T16:51:01.691 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-05-21T16:51:01.738 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-05-21T16:51:01.826 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-21T16:51:01.842 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-05-21T16:51:01.884 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-05-21T16:51:02.084 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-21T16:51:02.103 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-05-21T16:51:02.134 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-05-21T16:51:02.187 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-webtest. 2023-05-21T16:51:02.207 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-05-21T16:51:02.245 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-05-21T16:51:02.462 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-21T16:51:02.480 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:02.520 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:02.590 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pecan. 2023-05-21T16:51:02.606 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-05-21T16:51:02.648 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-05-21T16:51:02.926 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-21T16:51:02.946 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:02.984 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:03.019 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-21T16:51:03.039 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-05-21T16:51:03.077 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-05-21T16:51:03.337 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cryptography. 2023-05-21T16:51:03.355 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-21T16:51:03.357 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-05-21T16:51:03.372 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:03.395 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-05-21T16:51:03.413 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:03.819 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-21T16:51:03.833 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-openssl. 2023-05-21T16:51:03.837 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:03.851 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-05-21T16:51:03.877 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:03.890 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-05-21T16:51:04.205 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cryptography. 2023-05-21T16:51:04.222 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-05-21T16:51:04.252 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr. 2023-05-21T16:51:04.268 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:04.288 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-05-21T16:51:04.310 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:04.667 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-openssl. 2023-05-21T16:51:04.687 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-05-21T16:51:04.725 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-05-21T16:51:04.830 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mon. 2023-05-21T16:51:04.847 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:04.913 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mon (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:05.095 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr. 2023-05-21T16:51:05.113 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:05.153 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:05.623 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mon. 2023-05-21T16:51:05.642 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mon (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:06.167 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-osd. 2023-05-21T16:51:06.186 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:06.225 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-osd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:06.993 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-osd. 2023-05-21T16:51:07.010 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:07.051 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-osd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:09.269 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph. 2023-05-21T16:51:09.289 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../053-ceph_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:09.327 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:09.655 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-fuse. 2023-05-21T16:51:09.675 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:09.738 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:10.183 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mds. 2023-05-21T16:51:10.200 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:10.212 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph. 2023-05-21T16:51:10.231 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../053-ceph_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:10.241 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mds (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:10.271 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:10.573 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-fuse. 2023-05-21T16:51:10.592 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:10.631 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:10.819 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephadm. 2023-05-21T16:51:10.836 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../056-cephadm_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:10.877 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:11.085 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mds. 2023-05-21T16:51:11.104 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:11.143 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mds (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:11.239 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-21T16:51:11.256 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-05-21T16:51:11.297 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-05-21T16:51:11.671 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephadm. 2023-05-21T16:51:11.689 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../056-cephadm_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:11.691 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jinja2. 2023-05-21T16:51:11.708 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-05-21T16:51:11.750 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-05-21T16:51:11.762 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:12.073 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-21T16:51:12.090 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-05-21T16:51:12.102 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-21T16:51:12.120 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:12.148 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-05-21T16:51:12.185 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:12.493 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jinja2. 2023-05-21T16:51:12.510 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-05-21T16:51:12.539 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-21T16:51:12.542 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-05-21T16:51:12.559 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-05-21T16:51:12.597 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-05-21T16:51:12.871 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-21T16:51:12.889 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:12.925 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jwt. 2023-05-21T16:51:12.928 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:12.943 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-05-21T16:51:12.983 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-05-21T16:51:13.273 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-21T16:51:13.290 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-05-21T16:51:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-21T16:51:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-05-21T16:51:13.331 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-05-21T16:51:13.369 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-21T16:51:13.638 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjs-underscore. 2023-05-21T16:51:13.658 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-05-21T16:51:13.659 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jwt. 2023-05-21T16:51:13.675 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-05-21T16:51:13.696 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-05-21T16:51:13.717 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-05-21T16:51:13.990 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-05-21T16:51:14.010 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-05-21T16:51:14.048 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-05-21T16:51:14.062 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-21T16:51:14.080 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-05-21T16:51:14.112 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-21T16:51:14.348 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libjs-underscore. 2023-05-21T16:51:14.365 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-05-21T16:51:14.384 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-routes. 2023-05-21T16:51:14.401 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-05-21T16:51:14.406 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-05-21T16:51:14.442 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-05-21T16:51:14.708 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-05-21T16:51:14.725 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-05-21T16:51:14.766 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-05-21T16:51:14.804 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-21T16:51:14.820 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:14.862 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:15.086 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-routes. 2023-05-21T16:51:15.102 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-05-21T16:51:15.144 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-05-21T16:51:15.399 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-decorator. 2023-05-21T16:51:15.416 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-05-21T16:51:15.457 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-05-21T16:51:15.480 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-21T16:51:15.500 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:15.538 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:16.017 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-decorator. 2023-05-21T16:51:16.036 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-05-21T16:51:16.075 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-05-21T16:51:16.135 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-05-21T16:51:16.152 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-05-21T16:51:16.193 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-05-21T16:51:16.420 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-05-21T16:51:16.437 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-05-21T16:51:16.477 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-05-21T16:51:16.563 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-scipy. 2023-05-21T16:51:16.579 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-05-21T16:51:16.621 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-05-21T16:51:16.780 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-scipy. 2023-05-21T16:51:16.800 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-05-21T16:51:17.147 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-05-21T16:51:17.971 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-05-21T16:51:17.990 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-05-21T16:51:18.021 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-05-21T16:51:18.464 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-05-21T16:51:18.480 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-05-21T16:51:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-05-21T16:51:18.583 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-joblib. 2023-05-21T16:51:18.599 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-05-21T16:51:18.641 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-05-21T16:51:19.028 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn. 2023-05-21T16:51:19.044 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-05-21T16:51:19.067 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-joblib. 2023-05-21T16:51:19.085 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-05-21T16:51:19.086 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-05-21T16:51:19.116 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-05-21T16:51:19.537 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-sklearn. 2023-05-21T16:51:19.554 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-05-21T16:51:19.594 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-05-21T16:51:19.794 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-21T16:51:19.812 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:19.852 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:20.269 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-21T16:51:20.287 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:20.327 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:21.013 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cachetools. 2023-05-21T16:51:21.030 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-05-21T16:51:21.072 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-05-21T16:51:21.383 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-21T16:51:21.399 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-05-21T16:51:21.441 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-05-21T16:51:21.489 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cachetools. 2023-05-21T16:51:21.508 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-05-21T16:51:21.546 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-05-21T16:51:21.794 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-21T16:51:21.812 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-05-21T16:51:21.852 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-05-21T16:51:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-21T16:51:21.901 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-05-21T16:51:21.941 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-05-21T16:51:22.188 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rsa. 2023-05-21T16:51:22.205 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-05-21T16:51:22.246 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rsa (4.0-3) ... 2023-05-21T16:51:22.278 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-21T16:51:22.294 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-05-21T16:51:22.336 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-05-21T16:51:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-google-auth. 2023-05-21T16:51:22.584 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-05-21T16:51:22.624 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-05-21T16:51:22.680 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rsa. 2023-05-21T16:51:22.696 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-05-21T16:51:22.738 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rsa (4.0-3) ... 2023-05-21T16:51:22.977 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-blinker. 2023-05-21T16:51:22.997 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-05-21T16:51:23.035 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-05-21T16:51:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-google-auth. 2023-05-21T16:51:23.066 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-05-21T16:51:23.132 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-05-21T16:51:23.346 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-oauthlib. 2023-05-21T16:51:23.366 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-05-21T16:51:23.404 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-05-21T16:51:23.436 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-blinker. 2023-05-21T16:51:23.452 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-05-21T16:51:23.494 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-05-21T16:51:23.796 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-oauthlib. 2023-05-21T16:51:23.816 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-05-21T16:51:23.835 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-21T16:51:23.846 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-05-21T16:51:23.852 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-05-21T16:51:23.885 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-05-21T16:51:24.214 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-websocket. 2023-05-21T16:51:24.229 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-05-21T16:51:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-21T16:51:24.272 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-05-21T16:51:24.277 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-05-21T16:51:24.318 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-05-21T16:51:24.617 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-21T16:51:24.633 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-05-21T16:51:24.663 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-websocket. 2023-05-21T16:51:24.675 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-05-21T16:51:24.684 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-05-21T16:51:24.725 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-05-21T16:51:25.058 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-21T16:51:25.077 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-05-21T16:51:25.116 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-05-21T16:51:25.264 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-21T16:51:25.281 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:25.322 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:25.621 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-21T16:51:25.638 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:25.666 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-21T16:51:25.684 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-05-21T16:51:25.713 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:25.725 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-05-21T16:51:26.032 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-21T16:51:26.050 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-05-21T16:51:26.091 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-05-21T16:51:26.111 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-21T16:51:26.128 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:51:26.294 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:51:26.469 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-21T16:51:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:51:26.527 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:51:26.564 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package jq. 2023-05-21T16:51:26.581 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:51:26.647 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:51:26.796 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package jq. 2023-05-21T16:51:26.813 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:51:26.854 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:51:26.900 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package socat. 2023-05-21T16:51:26.919 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-05-21T16:51:26.982 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking socat (1.7.3.3-2) ... 2023-05-21T16:51:27.140 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package socat. 2023-05-21T16:51:27.158 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-05-21T16:51:27.198 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking socat (1.7.3.3-2) ... 2023-05-21T16:51:27.308 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package xmlstarlet. 2023-05-21T16:51:27.327 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-05-21T16:51:27.369 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-05-21T16:51:27.518 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package xmlstarlet. 2023-05-21T16:51:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-05-21T16:51:27.576 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-05-21T16:51:27.724 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-test. 2023-05-21T16:51:27.740 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../090-ceph-test_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:27.781 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-test (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:27.947 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-test. 2023-05-21T16:51:27.968 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../090-ceph-test_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:28.005 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-test (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:31.744 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-volume. 2023-05-21T16:51:31.761 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:31.827 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-volume (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:31.984 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-volume. 2023-05-21T16:51:32.002 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:32.051 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-volume (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:32.173 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-21T16:51:32.191 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:32.231 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-mirror (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:32.389 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-21T16:51:32.406 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:32.447 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephfs-mirror (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:32.576 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-colorama. 2023-05-21T16:51:32.595 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-05-21T16:51:32.633 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-05-21T16:51:32.783 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-colorama. 2023-05-21T16:51:32.802 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-05-21T16:51:32.841 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-05-21T16:51:32.903 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-shell. 2023-05-21T16:51:32.920 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:32.961 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-shell (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:33.119 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephfs-shell. 2023-05-21T16:51:33.138 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:33.177 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephfs-shell (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:33.223 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-top. 2023-05-21T16:51:33.239 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:33.280 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-top (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:33.429 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephfs-top. 2023-05-21T16:51:33.449 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-3996-g5ca1fdcf-1focal_all.deb ... 2023-05-21T16:51:33.487 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephfs-top (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:33.558 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package fonts-mathjax. 2023-05-21T16:51:33.578 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-05-21T16:51:33.616 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:33.756 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package fonts-mathjax. 2023-05-21T16:51:33.774 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-05-21T16:51:33.806 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:34.128 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-21T16:51:34.145 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:34.186 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs-dev (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:34.385 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-21T16:51:34.402 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:34.451 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libcephfs-dev (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:34.631 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package nvme-cli. 2023-05-21T16:51:34.647 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-05-21T16:51:34.707 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-05-21T16:51:34.846 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package nvme-cli. 2023-05-21T16:51:34.863 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-05-21T16:51:34.947 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-05-21T16:51:35.052 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-21T16:51:35.069 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-05-21T16:51:35.110 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-05-21T16:51:35.242 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-21T16:51:35.260 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-05-21T16:51:35.308 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-05-21T16:51:35.505 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjs-mathjax. 2023-05-21T16:51:35.523 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-05-21T16:51:35.563 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:35.695 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libjs-mathjax. 2023-05-21T16:51:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-05-21T16:51:35.753 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-natsort-doc. 2023-05-21T16:51:37.196 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-05-21T16:51:37.267 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-05-21T16:51:37.409 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python-natsort-doc. 2023-05-21T16:51:37.428 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-05-21T16:51:37.485 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-05-21T16:51:37.629 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-atomicwrites. 2023-05-21T16:51:37.645 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-05-21T16:51:37.687 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-05-21T16:51:37.804 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-atomicwrites. 2023-05-21T16:51:37.821 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-05-21T16:51:37.853 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-05-21T16:51:38.015 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-attr. 2023-05-21T16:51:38.032 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-05-21T16:51:38.073 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-05-21T16:51:38.189 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-attr. 2023-05-21T16:51:38.207 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-05-21T16:51:38.248 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-05-21T16:51:38.442 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webencodings. 2023-05-21T16:51:38.461 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-05-21T16:51:38.500 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-05-21T16:51:38.576 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-webencodings. 2023-05-21T16:51:38.593 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-05-21T16:51:38.634 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-05-21T16:51:38.820 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-html5lib. 2023-05-21T16:51:38.837 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-05-21T16:51:38.878 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-05-21T16:51:38.970 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-html5lib. 2023-05-21T16:51:38.987 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-05-21T16:51:39.028 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-05-21T16:51:39.256 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-05-21T16:51:39.273 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-05-21T16:51:39.333 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-05-21T16:51:39.348 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-05-21T16:51:39.365 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-05-21T16:51:39.406 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-05-21T16:51:39.834 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-packaging. 2023-05-21T16:51:39.852 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-05-21T16:51:39.868 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-packaging. 2023-05-21T16:51:39.885 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-05-21T16:51:39.900 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-packaging (20.3-1) ... 2023-05-21T16:51:39.926 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-packaging (20.3-1) ... 2023-05-21T16:51:40.228 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastescript. 2023-05-21T16:51:40.245 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-05-21T16:51:40.253 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pastescript. 2023-05-21T16:51:40.271 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-05-21T16:51:40.286 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-21T16:51:40.311 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-21T16:51:40.598 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pluggy. 2023-05-21T16:51:40.619 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-05-21T16:51:40.640 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pluggy. 2023-05-21T16:51:40.648 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-05-21T16:51:40.658 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-05-21T16:51:40.722 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-05-21T16:51:40.984 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-psutil. 2023-05-21T16:51:41.004 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-05-21T16:51:41.042 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-05-21T16:51:41.043 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-psutil. 2023-05-21T16:51:41.060 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-05-21T16:51:41.101 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-05-21T16:51:41.387 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-py. 2023-05-21T16:51:41.405 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-05-21T16:51:41.445 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-05-21T16:51:41.446 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-py. 2023-05-21T16:51:41.465 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-05-21T16:51:41.528 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-05-21T16:51:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-21T16:51:41.803 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-05-21T16:51:41.840 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-21T16:51:41.861 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-05-21T16:51:41.873 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-05-21T16:51:41.898 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-05-21T16:51:42.226 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pytest. 2023-05-21T16:51:42.234 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pytest. 2023-05-21T16:51:42.243 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-05-21T16:51:42.252 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-05-21T16:51:42.284 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-05-21T16:51:42.292 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-05-21T16:51:42.648 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplejson. 2023-05-21T16:51:42.665 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-05-21T16:51:42.681 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-simplejson. 2023-05-21T16:51:42.701 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-05-21T16:51:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-05-21T16:51:42.739 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-05-21T16:51:43.008 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-21T16:51:43.017 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-21T16:51:43.025 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-05-21T16:51:43.034 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-05-21T16:51:43.066 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-05-21T16:51:43.075 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-05-21T16:51:43.804 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package radosgw. 2023-05-21T16:51:43.822 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../116-radosgw_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:43.829 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package radosgw. 2023-05-21T16:51:43.847 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../116-radosgw_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:43.861 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking radosgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:43.887 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking radosgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:45.248 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package rbd-fuse. 2023-05-21T16:51:45.265 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:45.290 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-fuse. 2023-05-21T16:51:45.306 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking rbd-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:45.307 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-3996-g5ca1fdcf-1focal_amd64.deb ... 2023-05-21T16:51:45.348 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:45.634 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-attr (19.3.0-2) ... 2023-05-21T16:51:45.678 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-attr (19.3.0-2) ... 2023-05-21T16:51:45.970 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-05-21T16:51:45.979 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-05-21T16:51:46.121 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-05-21T16:51:46.121 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-05-21T16:51:46.246 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-05-21T16:51:46.247 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-05-21T16:51:46.457 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:46.464 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:47.143 INFO:teuthology.orchestra.run.smithi046.stdout:Adding system user cephadm....done 2023-05-21T16:51:47.322 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-05-21T16:51:47.481 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user cephadm....done 2023-05-21T16:51:47.646 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:47.772 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-05-21T16:51:47.866 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-21T16:51:48.191 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-21T16:51:48.483 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:48.534 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-05-21T16:51:48.651 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-05-21T16:51:48.685 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-05-21T16:51:48.777 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-05-21T16:51:48.811 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-05-21T16:51:49.129 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-05-21T16:51:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-05-21T16:51:49.539 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-05-21T16:51:49.575 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-05-21T16:51:49.841 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-05-21T16:51:49.874 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-05-21T16:51:50.150 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-05-21T16:51:50.208 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-05-21T16:51:50.418 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-05-21T16:51:50.534 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-05-21T16:51:50.702 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-05-21T16:51:50.844 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-05-21T16:51:51.003 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-ceph-argparse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:51.146 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-argparse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:51.314 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-05-21T16:51:51.438 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-05-21T16:51:51.439 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-05-21T16:51:51.564 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-05-21T16:51:51.733 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-05-21T16:51:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-05-21T16:51:52.050 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-05-21T16:51:52.133 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-05-21T16:51:52.343 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-05-21T16:51:52.435 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-05-21T16:51:52.494 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-05-21T16:51:52.561 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-05-21T16:51:52.870 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-05-21T16:51:52.928 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-05-21T16:51:53.171 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-05-21T16:51:53.230 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-05-21T16:51:53.456 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-05-21T16:51:53.490 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-05-21T16:51:53.816 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-05-21T16:51:53.866 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-05-21T16:51:54.101 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-05-21T16:51:54.175 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-05-21T16:51:54.452 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-05-21T16:51:54.535 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-05-21T16:51:54.744 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-packaging (20.3-1) ... 2023-05-21T16:51:54.819 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-packaging (20.3-1) ... 2023-05-21T16:51:55.070 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-05-21T16:51:55.145 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-05-21T16:51:55.196 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-05-21T16:51:55.304 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-05-21T16:51:55.322 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-05-21T16:51:55.432 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-05-21T16:51:55.623 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-05-21T16:51:55.718 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-05-21T16:51:56.045 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-05-21T16:51:56.128 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-05-21T16:51:56.380 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-05-21T16:51:56.429 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-05-21T16:51:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-05-21T16:51:56.780 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-05-21T16:51:57.132 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up socat (1.7.3.3-2) ... 2023-05-21T16:51:57.133 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up socat (1.7.3.3-2) ... 2023-05-21T16:51:57.258 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:57.267 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:51:57.601 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:51:57.635 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:51:57.769 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-05-21T16:51:57.770 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-05-21T16:51:58.104 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-05-21T16:51:58.113 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-05-21T16:51:58.230 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-05-21T16:51:58.239 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-05-21T16:51:58.378 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-05-21T16:51:58.398 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-05-21T16:51:58.682 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-05-21T16:51:58.708 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-05-21T16:51:59.033 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:51:59.035 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:51:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-05-21T16:51:59.193 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-05-21T16:51:59.303 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-05-21T16:51:59.319 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-05-21T16:51:59.624 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-05-21T16:51:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-05-21T16:51:59.906 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-05-21T16:51:59.908 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-05-21T16:52:00.226 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-05-21T16:52:00.244 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-05-21T16:52:00.352 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-21T16:52:00.378 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-21T16:52:00.637 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-05-21T16:52:00.671 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-05-21T16:52:00.921 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-05-21T16:52:00.965 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-05-21T16:52:01.239 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-05-21T16:52:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-05-21T16:52:01.601 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-05-21T16:52:01.679 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-05-21T16:52:01.910 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-05-21T16:52:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-05-21T16:52:02.054 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-05-21T16:52:02.069 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-05-21T16:52:02.396 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-05-21T16:52:02.398 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-05-21T16:52:02.749 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-05-21T16:52:02.755 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-05-21T16:52:02.881 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-05-21T16:52:02.910 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-05-21T16:52:03.024 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-05-21T16:52:03.036 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-05-21T16:52:03.358 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-05-21T16:52:03.371 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-05-21T16:52:03.676 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-05-21T16:52:03.689 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-05-21T16:52:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:52:05.203 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:52:05.266 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-05-21T16:52:05.329 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-05-21T16:52:05.668 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-05-21T16:52:05.738 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-05-21T16:52:05.985 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-05-21T16:52:06.065 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-05-21T16:52:06.261 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:52:06.366 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-21T16:52:06.387 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-05-21T16:52:06.491 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-05-21T16:52:06.763 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-05-21T16:52:06.834 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-05-21T16:52:07.115 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-05-21T16:52:07.178 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-05-21T16:52:07.550 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-05-21T16:52:07.563 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-05-21T16:52:07.881 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-05-21T16:52:07.918 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-05-21T16:52:08.980 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-05-21T16:52:08.993 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-05-21T16:52:09.090 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-05-21T16:52:09.119 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-05-21T16:52:09.216 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:52:09.236 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-05-21T16:52:09.376 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rsa (4.0-3) ... 2023-05-21T16:52:09.396 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rsa (4.0-3) ... 2023-05-21T16:52:09.677 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-05-21T16:52:09.680 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-05-21T16:52:09.803 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-05-21T16:52:09.806 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-05-21T16:52:10.102 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-05-21T16:52:10.146 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-05-21T16:52:10.412 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-21T16:52:10.438 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-21T16:52:10.729 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-05-21T16:52:10.801 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-05-21T16:52:11.090 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librados2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.187 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librados2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.312 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-05-21T16:52:11.407 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-05-21T16:52:11.471 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librgw2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.533 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librgw2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.597 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.661 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.723 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.787 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libcephfs2 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:11.866 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-routes (2.4.1-2) ... 2023-05-21T16:52:11.947 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-routes (2.4.1-2) ... 2023-05-21T16:52:12.167 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libradosstriper1 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.231 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libradosstriper1 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.327 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-05-21T16:52:12.357 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-05-21T16:52:12.629 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librbd1 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.676 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librbd1 (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.746 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-modules-core (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.802 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-modules-core (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.897 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:12.936 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:13.125 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-21T16:52:13.125 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-21T16:52:13.167 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-21T16:52:13.168 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-21T16:52:13.582 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs-dev (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:13.629 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libcephfs-dev (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:13.708 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rados (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:13.789 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rados (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-top (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:13.931 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephfs-top (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:14.027 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-05-21T16:52:14.057 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-05-21T16:52:14.980 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rbd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.045 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rbd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.090 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up rbd-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-fuse (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.216 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.297 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.367 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cephfs (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.423 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cephfs (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.495 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-shell (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.549 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephfs-shell (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.646 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:15.700 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-common (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:16.207 INFO:teuthology.orchestra.run.smithi142.stdout:Adding group ceph....done 2023-05-21T16:52:16.236 INFO:teuthology.orchestra.run.smithi046.stdout:Adding group ceph....done 2023-05-21T16:52:16.608 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user ceph....done 2023-05-21T16:52:16.621 INFO:teuthology.orchestra.run.smithi046.stdout:Adding system user ceph....done 2023-05-21T16:52:16.793 INFO:teuthology.orchestra.run.smithi142.stdout:Setting system user ceph properties....done 2023-05-21T16:52:16.797 INFO:teuthology.orchestra.run.smithi046.stdout:Setting system user ceph properties....done 2023-05-21T16:52:16.818 INFO:teuthology.orchestra.run.smithi142.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-21T16:52:16.818 INFO:teuthology.orchestra.run.smithi046.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-21T16:52:16.960 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-21T16:52:16.972 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-21T16:52:17.291 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-21T16:52:17.312 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-21T16:52:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephfs-mirror (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:17.797 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-mirror (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:17.902 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-test (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:17.923 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-test (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:18.029 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up radosgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:18.048 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up radosgw (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-21T16:52:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-21T16:52:18.357 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-21T16:52:18.358 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-21T16:52:18.939 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-base (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:19.017 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-base (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:19.425 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-21T16:52:19.860 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-21T16:52:19.961 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mds (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-21T16:52:20.243 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-21T16:52:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mds (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:20.539 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-21T16:52:20.540 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-21T16:52:20.830 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:21.010 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:21.060 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-21T16:52:21.060 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-21T16:52:21.255 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-21T16:52:21.255 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-21T16:52:21.506 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-osd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:21.694 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-osd (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:22.004 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-21T16:52:22.004 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-21T16:52:22.188 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-21T16:52:22.189 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-21T16:52:22.483 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:22.609 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:22.629 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:22.780 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:22.911 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mon (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:22.923 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mon (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:23.152 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-21T16:52:23.153 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-21T16:52:23.216 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-21T16:52:23.217 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-21T16:52:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:23.663 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-cephadm (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:23.734 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:23.805 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:23.860 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-dashboard (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:23.956 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-dashboard (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:24.003 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-volume (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:24.107 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-volume (18.0.0-3996-g5ca1fdcf-1focal) ... 2023-05-21T16:52:24.146 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-05-21T16:52:24.261 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-05-21T16:52:24.298 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-05-21T16:52:24.419 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-05-21T16:52:24.574 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-05-21T16:52:24.712 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-05-21T16:52:27.573 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-05-21T16:52:27.727 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-05-21T16:52:28.167 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-21T16:52:28.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-21T16:52:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-05-21T16:52:28.325 INFO:teuthology.orchestra.run.smithi046.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-21T16:52:28.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-21T16:52:28.401 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:52:28.430 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2023-05-21T16:52:28.431 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2023-05-21T16:52:28.603 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2023-05-21T16:52:28.604 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2023-05-21T16:52:28.612 INFO:teuthology.orchestra.run.smithi142.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:flex is already the newest version (2.6.4-6.2). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:52:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2023-05-21T16:52:28.614 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-05-21T16:52:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-21T16:52:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2023-05-21T16:52:28.614 INFO:teuthology.orchestra.run.smithi142.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-05-21T16:52:28.615 INFO:teuthology.orchestra.run.smithi142.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-05-21T16:52:28.615 INFO:teuthology.orchestra.run.smithi142.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-05-21T16:52:28.615 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-05-21T16:52:28.616 INFO:teuthology.orchestra.run.smithi142.stdout: wpasupplicant 2023-05-21T16:52:28.616 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2023-05-21T16:52:28.616 INFO:teuthology.orchestra.run.smithi142.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-05-21T16:52:28.616 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-05-21T16:52:28.671 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2023-05-21T16:52:28.672 INFO:teuthology.orchestra.run.smithi142.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-05-21T16:52:28.672 INFO:teuthology.orchestra.run.smithi142.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-05-21T16:52:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-05-21T16:52:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-05-21T16:52:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-05-21T16:52:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-21T16:52:28.674 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2023-05-21T16:52:28.675 INFO:teuthology.orchestra.run.smithi142.stdout: libssl1.1 2023-05-21T16:52:28.748 INFO:teuthology.orchestra.run.smithi142.stdout:1 upgraded, 31 newly installed, 0 to remove and 163 not upgraded. 2023-05-21T16:52:28.748 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 24.0 MB of archives. 2023-05-21T16:52:28.749 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-05-21T16:52:28.749 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.18 [1,322 kB] 2023-05-21T16:52:28.791 INFO:teuthology.orchestra.run.smithi046.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-05-21T16:52:28.791 INFO:teuthology.orchestra.run.smithi046.stdout:flex is already the newest version (2.6.4-6.2). 2023-05-21T16:52:28.791 INFO:teuthology.orchestra.run.smithi046.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-05-21T16:52:28.791 INFO:teuthology.orchestra.run.smithi046.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-05-21T16:52:28.792 INFO:teuthology.orchestra.run.smithi046.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-05-21T16:52:28.792 INFO:teuthology.orchestra.run.smithi046.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:52:28.792 INFO:teuthology.orchestra.run.smithi046.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:52:28.792 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2023-05-21T16:52:28.793 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-05-21T16:52:28.793 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-21T16:52:28.793 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2023-05-21T16:52:28.793 INFO:teuthology.orchestra.run.smithi046.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-05-21T16:52:28.794 INFO:teuthology.orchestra.run.smithi046.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-05-21T16:52:28.794 INFO:teuthology.orchestra.run.smithi046.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-05-21T16:52:28.794 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-05-21T16:52:28.794 INFO:teuthology.orchestra.run.smithi046.stdout: wpasupplicant 2023-05-21T16:52:28.794 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2023-05-21T16:52:28.794 INFO:teuthology.orchestra.run.smithi046.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-05-21T16:52:28.795 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-05-21T16:52:28.846 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2023-05-21T16:52:28.847 INFO:teuthology.orchestra.run.smithi046.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-05-21T16:52:28.847 INFO:teuthology.orchestra.run.smithi046.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-05-21T16:52:28.848 INFO:teuthology.orchestra.run.smithi046.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-05-21T16:52:28.848 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-05-21T16:52:28.848 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-05-21T16:52:28.848 INFO:teuthology.orchestra.run.smithi046.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-21T16:52:28.849 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages will be upgraded: 2023-05-21T16:52:28.849 INFO:teuthology.orchestra.run.smithi046.stdout: libssl1.1 2023-05-21T16:52:28.885 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-05-21T16:52:28.887 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-05-21T16:52:28.890 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-05-21T16:52:28.892 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-05-21T16:52:28.893 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-05-21T16:52:28.895 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-05-21T16:52:28.896 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-05-21T16:52:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-05-21T16:52:28.898 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-05-21T16:52:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-05-21T16:52:28.937 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-05-21T16:52:29.034 INFO:teuthology.orchestra.run.smithi046.stdout:1 upgraded, 31 newly installed, 0 to remove and 163 not upgraded. 2023-05-21T16:52:29.034 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 24.0 MB of archives. 2023-05-21T16:52:29.034 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-05-21T16:52:29.034 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.18 [1,322 kB] 2023-05-21T16:52:29.042 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.14-0ubuntu0.20.04.1 [116 kB] 2023-05-21T16:52:29.046 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-05-21T16:52:29.071 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-05-21T16:52:29.072 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.18 [1,586 kB] 2023-05-21T16:52:29.098 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-05-21T16:52:29.098 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-05-21T16:52:29.107 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-05-21T16:52:29.117 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-05-21T16:52:29.132 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-05-21T16:52:29.135 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-05-21T16:52:29.170 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-05-21T16:52:29.211 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-05-21T16:52:29.221 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.14-0ubuntu0.20.04.1 [1,053 kB] 2023-05-21T16:52:29.298 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-05-21T16:52:29.301 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.14-0ubuntu0.20.04.1 [13.5 MB] 2023-05-21T16:52:29.419 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-05-21T16:52:29.488 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-05-21T16:52:29.488 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-05-21T16:52:29.489 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-05-21T16:52:29.489 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-05-21T16:52:29.687 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-05-21T16:52:29.689 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-05-21T16:52:29.695 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-05-21T16:52:29.699 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-05-21T16:52:29.700 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-05-21T16:52:29.701 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-05-21T16:52:29.704 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-05-21T16:52:29.710 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-05-21T16:52:29.710 INFO:teuthology.orchestra.run.smithi046.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-05-21T16:52:29.768 INFO:teuthology.orchestra.run.smithi046.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-05-21T16:52:29.893 INFO:teuthology.orchestra.run.smithi142.stdout:Preconfiguring packages ... 2023-05-21T16:52:29.933 INFO:teuthology.orchestra.run.smithi046.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-05-21T16:52:30.088 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 24.0 MB in 1s (29.7 MB/s) 2023-05-21T16:52:30.401 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152860 files and directories currently installed.) 2023-05-21T16:52:30.405 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.18_amd64.deb ... 2023-05-21T16:52:30.434 INFO:teuthology.orchestra.run.smithi046.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.14-0ubuntu0.20.04.1 [116 kB] 2023-05-21T16:52:30.452 INFO:teuthology.orchestra.run.smithi046.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-05-21T16:52:30.574 INFO:teuthology.orchestra.run.smithi046.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-05-21T16:52:30.574 INFO:teuthology.orchestra.run.smithi046.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.18 [1,586 kB] 2023-05-21T16:52:30.597 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.18) over (1.1.1f-1ubuntu2.16) ... 2023-05-21T16:52:30.694 INFO:teuthology.orchestra.run.smithi046.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-05-21T16:52:30.694 INFO:teuthology.orchestra.run.smithi046.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-05-21T16:52:30.727 INFO:teuthology.orchestra.run.smithi046.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-05-21T16:52:30.762 INFO:teuthology.orchestra.run.smithi046.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-05-21T16:52:30.808 INFO:teuthology.orchestra.run.smithi046.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-05-21T16:52:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-05-21T16:52:30.981 INFO:teuthology.orchestra.run.smithi046.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-05-21T16:52:31.125 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-21T16:52:31.142 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-05-21T16:52:31.171 INFO:teuthology.orchestra.run.smithi046.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-05-21T16:52:31.183 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-05-21T16:52:31.221 INFO:teuthology.orchestra.run.smithi046.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.14-0ubuntu0.20.04.1 [1,053 kB] 2023-05-21T16:52:31.539 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package dump. 2023-05-21T16:52:31.557 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-05-21T16:52:31.597 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking dump (0.4b46-6) ... 2023-05-21T16:52:31.598 INFO:teuthology.orchestra.run.smithi046.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-05-21T16:52:31.614 INFO:teuthology.orchestra.run.smithi046.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.14-0ubuntu0.20.04.1 [13.5 MB] 2023-05-21T16:52:31.984 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package indent. 2023-05-21T16:52:32.004 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-05-21T16:52:32.059 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking indent (2.2.12-1) ... 2023-05-21T16:52:32.090 INFO:teuthology.orchestra.run.smithi046.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-05-21T16:52:32.090 INFO:teuthology.orchestra.run.smithi046.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-05-21T16:52:32.091 INFO:teuthology.orchestra.run.smithi046.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-05-21T16:52:32.091 INFO:teuthology.orchestra.run.smithi046.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-05-21T16:52:32.092 INFO:teuthology.orchestra.run.smithi046.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-05-21T16:52:32.396 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-21T16:52:32.413 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-05-21T16:52:32.454 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-05-21T16:52:32.504 INFO:teuthology.orchestra.run.smithi046.stdout:Preconfiguring packages ... 2023-05-21T16:52:32.710 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 24.0 MB in 3s (7,409 kB/s) 2023-05-21T16:52:32.807 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-21T16:52:32.824 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-05-21T16:52:32.865 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-05-21T16:52:33.037 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152860 files and directories currently installed.) 2023-05-21T16:52:33.041 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.18_amd64.deb ... 2023-05-21T16:52:33.168 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-21T16:52:33.187 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-05-21T16:52:33.225 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.18) over (1.1.1f-1ubuntu2.16) ... 2023-05-21T16:52:33.293 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-05-21T16:52:33.729 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-21T16:52:33.731 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-21T16:52:33.747 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-05-21T16:52:33.749 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:33.779 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-05-21T16:52:33.806 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:52:34.084 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-21T16:52:34.101 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:34.107 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package dump. 2023-05-21T16:52:34.124 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-05-21T16:52:34.166 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking dump (0.4b46-6) ... 2023-05-21T16:52:34.167 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:52:34.506 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package indent. 2023-05-21T16:52:34.520 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-21T16:52:34.523 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-05-21T16:52:34.537 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:34.564 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking indent (2.2.12-1) ... 2023-05-21T16:52:34.578 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:52:34.875 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-21T16:52:34.895 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-05-21T16:52:34.956 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-21T16:52:34.965 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-05-21T16:52:34.973 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-05-21T16:52:35.014 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-05-21T16:52:35.375 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-21T16:52:35.395 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-05-21T16:52:35.433 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-05-21T16:52:35.530 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-21T16:52:35.547 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-05-21T16:52:35.622 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-05-21T16:52:35.829 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-21T16:52:35.846 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../12-libpq5_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:52:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-21T16:52:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-05-21T16:52:35.912 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:35.932 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-05-21T16:52:36.273 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-21T16:52:36.292 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:36.331 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:52:36.344 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-21T16:52:36.365 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:36.402 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:52:36.657 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-21T16:52:36.675 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:36.692 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-21T16:52:36.710 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:36.715 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:52:36.750 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:52:37.028 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-21T16:52:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.18_amd64.deb ... 2023-05-21T16:52:37.068 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-21T16:52:37.086 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.18) ... 2023-05-21T16:52:37.089 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:37.126 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:52:37.525 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-21T16:52:37.545 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-05-21T16:52:37.595 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-05-21T16:52:37.606 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-21T16:52:37.623 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-05-21T16:52:37.681 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-05-21T16:52:37.923 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-21T16:52:37.940 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-05-21T16:52:37.981 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-05-21T16:52:38.067 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package modemmanager. 2023-05-21T16:52:38.087 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:38.144 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:52:38.411 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-21T16:52:38.428 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../12-libpq5_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:52:38.477 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:38.864 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-21T16:52:38.883 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:38.922 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:52:39.091 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package wpasupplicant. 2023-05-21T16:52:39.111 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-05-21T16:52:39.149 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-05-21T16:52:39.249 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-21T16:52:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:39.307 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:52:39.560 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-21T16:52:39.580 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.18_amd64.deb ... 2023-05-21T16:52:39.618 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.18) ... 2023-05-21T16:52:39.729 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package network-manager. 2023-05-21T16:52:39.748 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-05-21T16:52:39.845 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-05-21T16:52:40.155 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-21T16:52:40.172 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-05-21T16:52:40.213 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-05-21T16:52:40.578 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ppp. 2023-05-21T16:52:40.597 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-05-21T16:52:40.776 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package modemmanager. 2023-05-21T16:52:40.797 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-05-21T16:52:40.844 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:52:40.867 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-05-21T16:52:41.258 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package pptp-linux. 2023-05-21T16:52:41.279 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-05-21T16:52:41.316 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-05-21T16:52:41.515 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package wpasupplicant. 2023-05-21T16:52:41.532 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-05-21T16:52:41.573 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-05-21T16:52:41.719 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-21T16:52:41.737 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-05-21T16:52:41.795 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-05-21T16:52:42.097 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-21T16:52:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-05-21T16:52:42.155 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-05-21T16:52:42.162 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package network-manager. 2023-05-21T16:52:42.182 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-05-21T16:52:42.244 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-05-21T16:52:42.484 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client-12. 2023-05-21T16:52:42.501 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../24-postgresql-client-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:52:42.542 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:43.019 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ppp. 2023-05-21T16:52:43.036 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-05-21T16:52:43.197 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-common. 2023-05-21T16:52:43.216 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-05-21T16:52:43.279 INFO:teuthology.orchestra.run.smithi142.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-21T16:52:43.313 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-05-21T16:52:43.332 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-05-21T16:52:43.674 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package pptp-linux. 2023-05-21T16:52:43.691 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-05-21T16:52:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-05-21T16:52:43.930 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-12. 2023-05-21T16:52:43.947 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../26-postgresql-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:52:44.011 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:44.077 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-21T16:52:44.094 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-05-21T16:52:44.144 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-05-21T16:52:44.430 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-21T16:52:44.447 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-05-21T16:52:44.488 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-05-21T16:52:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-client-12. 2023-05-21T16:52:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../24-postgresql-client-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:52:44.859 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:45.505 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-common. 2023-05-21T16:52:45.523 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-05-21T16:52:45.585 INFO:teuthology.orchestra.run.smithi046.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-21T16:52:45.598 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-05-21T16:52:45.665 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql. 2023-05-21T16:52:45.684 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-05-21T16:52:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-05-21T16:52:45.992 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client. 2023-05-21T16:52:46.010 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-05-21T16:52:46.050 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-05-21T16:52:46.319 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-21T16:52:46.336 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-05-21T16:52:46.369 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-05-21T16:52:46.414 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-12. 2023-05-21T16:52:46.432 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../26-postgresql-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-05-21T16:52:46.475 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:46.647 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-21T16:52:46.665 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-05-21T16:52:46.705 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-05-21T16:52:47.108 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-21T16:52:47.125 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-05-21T16:52:47.202 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-05-21T16:52:47.496 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-05-21T16:52:47.730 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.18) ... 2023-05-21T16:52:48.023 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:48.149 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-05-21T16:52:48.150 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql. 2023-05-21T16:52:48.168 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-05-21T16:52:48.208 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-05-21T16:52:48.309 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-05-21T16:52:48.434 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-05-21T16:52:48.461 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-client. 2023-05-21T16:52:48.481 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-05-21T16:52:48.535 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-05-21T16:52:48.805 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-21T16:52:48.826 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-05-21T16:52:48.859 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-21T16:52:48.859 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-21T16:52:48.863 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-05-21T16:52:49.107 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-21T16:52:49.126 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-05-21T16:52:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-05-21T16:52:49.576 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-21T16:52:49.594 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-05-21T16:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-05-21T16:52:49.822 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:49.983 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-05-21T16:52:50.183 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.18) ... 2023-05-21T16:52:50.517 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:50.652 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-05-21T16:52:50.703 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-21T16:52:50.786 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-05-21T16:52:50.820 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-05-21T16:52:50.929 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-05-21T16:52:50.929 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-05-21T16:52:51.357 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-21T16:52:51.357 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-21T16:52:51.899 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:52.032 INFO:teuthology.orchestra.run.smithi142.stdout:Adding user postgres to group ssl-cert 2023-05-21T16:52:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:52.290 INFO:teuthology.orchestra.run.smithi142.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-21T16:52:52.543 INFO:teuthology.orchestra.run.smithi142.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-21T16:52:52.543 INFO:teuthology.orchestra.run.smithi142.stdout:Removing obsolete dictionary files: 2023-05-21T16:52:52.792 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-21T16:52:52.870 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-21T16:52:52.890 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-05-21T16:52:53.041 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-05-21T16:52:53.680 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.18) ... 2023-05-21T16:52:53.823 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-05-21T16:52:53.974 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-05-21T16:52:54.066 INFO:teuthology.orchestra.run.smithi046.stdout:Adding user postgres to group ssl-cert 2023-05-21T16:52:54.100 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-05-21T16:52:54.226 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-05-21T16:52:54.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:52:54.351 INFO:teuthology.orchestra.run.smithi046.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-21T16:52:54.609 INFO:teuthology.orchestra.run.smithi046.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-21T16:52:54.610 INFO:teuthology.orchestra.run.smithi046.stdout:Removing obsolete dictionary files: 2023-05-21T16:52:54.954 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-21T16:52:55.225 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-05-21T16:52:55.448 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up dump (0.4b46-6) ... 2023-05-21T16:52:55.546 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-21T16:52:55.608 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:52:55.725 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.18) ... 2023-05-21T16:52:55.767 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-05-21T16:52:55.851 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-05-21T16:52:55.893 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up indent (2.2.12-1) ... 2023-05-21T16:52:55.977 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-05-21T16:52:56.028 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-05-21T16:52:56.095 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-05-21T16:52:56.229 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-05-21T16:52:56.254 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-05-21T16:52:56.355 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:56.747 INFO:teuthology.orchestra.run.smithi142.stdout:Creating new PostgreSQL cluster 12/main ... 2023-05-21T16:52:56.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-05-21T16:52:56.814 INFO:teuthology.orchestra.run.smithi142.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-21T16:52:56.815 INFO:teuthology.orchestra.run.smithi142.stdout:This user must also own the server process. 2023-05-21T16:52:56.815 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:56.815 INFO:teuthology.orchestra.run.smithi142.stdout:The database cluster will be initialized with locale "en_US". 2023-05-21T16:52:56.815 INFO:teuthology.orchestra.run.smithi142.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-21T16:52:56.815 INFO:teuthology.orchestra.run.smithi142.stdout:The default text search configuration will be set to "english". 2023-05-21T16:52:56.815 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:56.816 INFO:teuthology.orchestra.run.smithi142.stdout:Data page checksums are disabled. 2023-05-21T16:52:56.816 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:56.816 INFO:teuthology.orchestra.run.smithi142.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-05-21T16:52:56.816 INFO:teuthology.orchestra.run.smithi142.stdout:creating subdirectories ... ok 2023-05-21T16:52:56.817 INFO:teuthology.orchestra.run.smithi142.stdout:selecting dynamic shared memory implementation ... posix 2023-05-21T16:52:56.835 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default max_connections ... 100 2023-05-21T16:52:56.857 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default shared_buffers ... 128MB 2023-05-21T16:52:56.864 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default time zone ... Etc/UTC 2023-05-21T16:52:56.864 INFO:teuthology.orchestra.run.smithi142.stdout:creating configuration files ... ok 2023-05-21T16:52:56.969 INFO:teuthology.orchestra.run.smithi142.stdout:running bootstrap script ... ok 2023-05-21T16:52:57.247 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-05-21T16:52:57.499 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up dump (0.4b46-6) ... 2023-05-21T16:52:57.522 INFO:teuthology.orchestra.run.smithi142.stdout:performing post-bootstrap initialization ... ok 2023-05-21T16:52:57.582 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-21T16:52:57.644 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:52:57.770 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-05-21T16:52:57.896 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up indent (2.2.12-1) ... 2023-05-21T16:52:58.031 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-05-21T16:52:58.241 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-05-21T16:52:58.336 INFO:teuthology.orchestra.run.smithi142.stdout:syncing data to disk ... ok 2023-05-21T16:52:58.336 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:58.336 INFO:teuthology.orchestra.run.smithi142.stdout:Success. You can now start the database server using: 2023-05-21T16:52:58.336 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:58.336 INFO:teuthology.orchestra.run.smithi142.stdout: pg_ctlcluster 12 main start 2023-05-21T16:52:58.336 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:52:58.350 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-05-21T16:52:58.667 INFO:teuthology.orchestra.run.smithi142.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-05-21T16:52:58.668 INFO:teuthology.orchestra.run.smithi142.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-05-21T16:52:58.705 INFO:teuthology.orchestra.run.smithi046.stdout:Creating new PostgreSQL cluster 12/main ... 2023-05-21T16:52:58.720 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-05-21T16:52:58.746 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout:This user must also own the server process. 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout:The database cluster will be initialized with locale "en_US". 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout:The default text search configuration will be set to "english". 2023-05-21T16:52:58.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:52:58.767 INFO:teuthology.orchestra.run.smithi046.stdout:Data page checksums are disabled. 2023-05-21T16:52:58.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:52:58.767 INFO:teuthology.orchestra.run.smithi046.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-05-21T16:52:58.767 INFO:teuthology.orchestra.run.smithi046.stdout:creating subdirectories ... ok 2023-05-21T16:52:58.768 INFO:teuthology.orchestra.run.smithi046.stdout:selecting dynamic shared memory implementation ... posix 2023-05-21T16:52:58.784 INFO:teuthology.orchestra.run.smithi046.stdout:selecting default max_connections ... 100 2023-05-21T16:52:58.809 INFO:teuthology.orchestra.run.smithi046.stdout:selecting default shared_buffers ... 128MB 2023-05-21T16:52:58.816 INFO:teuthology.orchestra.run.smithi046.stdout:selecting default time zone ... Etc/UTC 2023-05-21T16:52:58.817 INFO:teuthology.orchestra.run.smithi046.stdout:creating configuration files ... ok 2023-05-21T16:52:58.924 INFO:teuthology.orchestra.run.smithi046.stdout:running bootstrap script ... ok 2023-05-21T16:52:59.449 INFO:teuthology.orchestra.run.smithi046.stdout:performing post-bootstrap initialization ... ok 2023-05-21T16:53:00.103 INFO:teuthology.orchestra.run.smithi046.stdout:syncing data to disk ... ok 2023-05-21T16:53:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:00.104 INFO:teuthology.orchestra.run.smithi046.stdout:Success. You can now start the database server using: 2023-05-21T16:53:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: pg_ctlcluster 12 main start 2023-05-21T16:53:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:00.446 INFO:teuthology.orchestra.run.smithi046.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-05-21T16:53:00.447 INFO:teuthology.orchestra.run.smithi046.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-05-21T16:53:00.532 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-21T16:53:01.828 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:53:01.954 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-05-21T16:53:02.139 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-05-21T16:53:02.265 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-05-21T16:53:03.018 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:03.019 INFO:teuthology.orchestra.run.smithi142.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-21T16:53:03.019 INFO:teuthology.orchestra.run.smithi142.stdout:which means they are currently configured by ifupdown: 2023-05-21T16:53:03.019 INFO:teuthology.orchestra.run.smithi142.stdout:- enp3s0f1 2023-05-21T16:53:03.019 INFO:teuthology.orchestra.run.smithi142.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-21T16:53:03.020 INFO:teuthology.orchestra.run.smithi142.stdout:remove their configuration from /etc/network/interfaces. 2023-05-21T16:53:03.020 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:03.180 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-21T16:53:03.500 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-21T16:53:03.532 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:53:03.649 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-05-21T16:53:03.784 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-05-21T16:53:03.885 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-05-21T16:53:04.021 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-21T16:53:04.509 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:53:04.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:04.645 INFO:teuthology.orchestra.run.smithi046.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-21T16:53:04.645 INFO:teuthology.orchestra.run.smithi046.stdout:which means they are currently configured by ifupdown: 2023-05-21T16:53:04.645 INFO:teuthology.orchestra.run.smithi046.stdout:- ens1f0 2023-05-21T16:53:04.645 INFO:teuthology.orchestra.run.smithi046.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-21T16:53:04.645 INFO:teuthology.orchestra.run.smithi046.stdout:remove their configuration from /etc/network/interfaces. 2023-05-21T16:53:04.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:04.669 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-05-21T16:53:04.795 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-05-21T16:53:04.815 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-21T16:53:04.946 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-05-21T16:53:05.072 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:53:05.134 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-21T16:53:05.198 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:53:05.349 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:53:05.607 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-21T16:53:05.608 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-21T16:53:05.674 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-21T16:53:06.118 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-21T16:53:06.171 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-05-21T16:53:06.253 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-05-21T16:53:06.306 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-05-21T16:53:06.429 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-05-21T16:53:06.449 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-05-21T16:53:06.625 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-05-21T16:53:06.714 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-05-21T16:53:06.751 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:53:06.877 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-05-21T16:53:06.994 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-05-21T16:53:07.255 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-21T16:53:07.256 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-21T16:53:07.763 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-21T16:53:07.923 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-05-21T16:53:08.074 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-05-21T16:53:08.367 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-05-21T16:53:13.059 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-05-21T16:53:13.167 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-05-21T16:53:13.993 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-21T16:53:13.996 DEBUG:teuthology.parallel:result is None 2023-05-21T16:53:14.555 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-05-21T16:53:14.655 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-05-21T16:53:15.454 INFO:teuthology.orchestra.run.smithi046.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-21T16:53:15.456 DEBUG:teuthology.parallel:result is None 2023-05-21T16:53:15.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 2023-05-21T16:53:15.605 DEBUG:teuthology.orchestra.run.smithi046:> dpkg-query -W -f '${Version}' ceph 2023-05-21T16:53:15.629 INFO:teuthology.orchestra.run.smithi046.stdout:18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:53:15.629 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:53:15.630 INFO:teuthology.task.install:The correct ceph version 18.0.0-3996-g5ca1fdcf-1focal is installed. 2023-05-21T16:53:15.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1 2023-05-21T16:53:15.771 DEBUG:teuthology.orchestra.run.smithi142:> dpkg-query -W -f '${Version}' ceph 2023-05-21T16:53:15.795 INFO:teuthology.orchestra.run.smithi142.stdout:18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:53:15.795 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3996-g5ca1fdcf-1focal 2023-05-21T16:53:15.796 INFO:teuthology.task.install:The correct ceph version 18.0.0-3996-g5ca1fdcf-1focal is installed. 2023-05-21T16:53:15.796 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-21T16:53:15.796 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:15.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-21T16:53:15.814 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:15.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-21T16:53:15.852 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-21T16:53:15.852 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:15.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2023-05-21T16:53:15.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-21T16:53:15.926 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:15.927 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-05-21T16:53:15.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-21T16:53:15.952 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-21T16:53:15.952 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:15.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-21T16:53:15.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-21T16:53:16.031 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:16.031 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-21T16:53:16.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-21T16:53:16.053 INFO:teuthology.run_tasks:Running task ceph... 2023-05-21T16:53:16.128 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-21T16:53:16.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2023-05-21T16:53:16.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2023-05-21T16:53:16.144 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-21T16:53:16.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-21T16:53:16.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-21T16:53:16.200 INFO:tasks.ceph:Creating extra log directories... 2023-05-21T16:53:16.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-21T16:53:16.203 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-21T16:53:16.222 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-21T16:53:16.222 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-21T16:53:16.233 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-21T16:53:16.234 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:16.234 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-21T16:53:16.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-21T16:53:16.296 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:16.297 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-21T16:53:16.304 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-21T16:53:16.345 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-21T16:53:16.346 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-21T16:53:16.346 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887', 'branch': 'wip-yuri7-testing-2023-05-18-0655', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7281887', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2023-05-18-0655'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2023-05-18-0655', 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6431, 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri7-testing-2023-05-18-0655', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '01abd1ed90624b09fd81d9cb3a79e2834351f0ca', 'timestamp': '2023-05-21_14:52:38', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-21T16:53:16.347 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-21T16:53:16.349 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-21T16:53:16.390 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2023-05-21T16:53:16.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2023-05-21T16:53:16.406 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:16.407 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2023-05-21T16:53:16.453 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-21T16:53:16.454 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2023-05-21T16:53:16.460 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-21T16:53:16.460 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.460 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-05-21T16:53:16.461 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.461 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-05-21 16:48:45.420772097 +0000 2023-05-21T16:53:16.461 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-05-21 16:48:45.112779195 +0000 2023-05-21T16:53:16.461 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-05-21 16:48:45.112779195 +0000 2023-05-21T16:53:16.461 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-05-21T16:53:16.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-21T16:53:16.473 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-05-21T16:53:16.473 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-05-21T16:53:16.474 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000308236 s, 1.7 MB/s 2023-05-21T16:53:16.475 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-21T16:53:16.482 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2023-05-21T16:53:16.486 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-21T16:53:16.486 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.487 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-05-21T16:53:16.487 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.487 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-05-21 16:48:45.948759926 +0000 2023-05-21T16:53:16.487 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-05-21 16:48:45.652766748 +0000 2023-05-21T16:53:16.487 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-05-21 16:48:45.652766748 +0000 2023-05-21T16:53:16.487 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-05-21T16:53:16.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-21T16:53:16.542 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-05-21T16:53:16.543 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-05-21T16:53:16.543 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000298963 s, 1.7 MB/s 2023-05-21T16:53:16.544 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-21T16:53:16.552 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2023-05-21T16:53:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-21T16:53:16.603 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-05-21T16:53:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.603 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-05-21 16:48:46.444748494 +0000 2023-05-21T16:53:16.604 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-05-21 16:48:46.152755225 +0000 2023-05-21T16:53:16.604 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-05-21 16:48:46.152755225 +0000 2023-05-21T16:53:16.604 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-05-21T16:53:16.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-21T16:53:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-05-21T16:53:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-05-21T16:53:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000299553 s, 1.7 MB/s 2023-05-21T16:53:16.618 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-21T16:53:16.625 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2023-05-21T16:53:16.674 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-21T16:53:16.674 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.674 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-05-21T16:53:16.674 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.675 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-05-21 16:48:46.924737429 +0000 2023-05-21T16:53:16.675 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-05-21 16:48:46.652743699 +0000 2023-05-21T16:53:16.675 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-05-21 16:48:46.652743699 +0000 2023-05-21T16:53:16.675 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2023-05-21T16:53:16.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-21T16:53:16.686 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-05-21T16:53:16.686 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-05-21T16:53:16.686 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000284257 s, 1.8 MB/s 2023-05-21T16:53:16.687 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-21T16:53:16.694 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:16.695 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:16.695 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-05-21T16:53:16.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-21T16:53:16.702 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-05-21T16:53:16.751 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-21T16:53:16.751 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.751 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-05-21T16:53:16.751 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.752 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-05-21 16:48:37.242668906 +0000 2023-05-21T16:53:16.752 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-05-21 16:48:37.238668999 +0000 2023-05-21T16:53:16.752 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-05-21 16:48:37.238668999 +0000 2023-05-21T16:53:16.752 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-05-21T16:53:16.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-21T16:53:16.763 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-05-21T16:53:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-05-21T16:53:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000423851 s, 1.2 MB/s 2023-05-21T16:53:16.765 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-21T16:53:16.774 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-05-21T16:53:16.779 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-21T16:53:16.779 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.779 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-05-21T16:53:16.779 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.779 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-05-21 16:48:38.022650918 +0000 2023-05-21T16:53:16.780 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-05-21 16:48:37.742657376 +0000 2023-05-21T16:53:16.780 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-05-21 16:48:37.742657376 +0000 2023-05-21T16:53:16.780 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-05-21T16:53:16.780 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-21T16:53:16.792 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-05-21T16:53:16.792 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-05-21T16:53:16.793 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000389266 s, 1.3 MB/s 2023-05-21T16:53:16.793 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-21T16:53:16.844 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-05-21T16:53:16.851 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-21T16:53:16.852 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.852 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-05-21T16:53:16.852 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.852 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-05-21 16:48:38.574638189 +0000 2023-05-21T16:53:16.852 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-05-21 16:48:38.286644830 +0000 2023-05-21T16:53:16.852 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-05-21 16:48:38.286644830 +0000 2023-05-21T16:53:16.853 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-05-21T16:53:16.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-21T16:53:16.864 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-05-21T16:53:16.864 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-05-21T16:53:16.865 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000399658 s, 1.3 MB/s 2023-05-21T16:53:16.865 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-21T16:53:16.916 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-05-21T16:53:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-21T16:53:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-21T16:53:16.924 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-05-21T16:53:16.924 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-21T16:53:16.925 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-05-21 16:48:39.074626658 +0000 2023-05-21T16:53:16.925 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-05-21 16:48:38.794633115 +0000 2023-05-21T16:53:16.925 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-05-21 16:48:38.794633115 +0000 2023-05-21T16:53:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2023-05-21T16:53:16.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-21T16:53:16.936 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-05-21T16:53:16.937 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-05-21T16:53:16.937 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000433617 s, 1.2 MB/s 2023-05-21T16:53:16.938 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-21T16:53:16.988 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:16.989 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-21T16:53:16.989 INFO:tasks.ceph:Generating config... 2023-05-21T16:53:16.991 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-21T16:53:16.992 INFO:tasks.ceph:[client] debug client = 20 2023-05-21T16:53:16.992 INFO:tasks.ceph:[client] debug ms = 1 2023-05-21T16:53:16.992 INFO:tasks.ceph:[client] pid file = 2023-05-21T16:53:16.992 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-21T16:53:16.993 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-21T16:53:16.993 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-21T16:53:16.993 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-21T16:53:16.993 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-21T16:53:16.993 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-21T16:53:16.994 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-21T16:53:16.994 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-21T16:53:16.994 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-21T16:53:16.994 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-21T16:53:16.994 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-21T16:53:16.995 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-21T16:53:16.995 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-21T16:53:16.995 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-21T16:53:16.995 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-21T16:53:16.995 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-21T16:53:16.995 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-21T16:53:16.996 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-21T16:53:16.996 INFO:tasks.ceph:[osd] bdev async discard = True 2023-05-21T16:53:16.996 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-05-21T16:53:16.996 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-05-21T16:53:16.996 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-21T16:53:16.997 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-21T16:53:16.997 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-21T16:53:16.997 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-21T16:53:16.997 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-21T16:53:16.997 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-21T16:53:16.998 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-21T16:53:16.998 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-21T16:53:16.998 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-21T16:53:16.998 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-21T16:53:16.998 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-21T16:53:16.999 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-21T16:53:16.999 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-21T16:53:16.999 INFO:tasks.ceph:Setting up mon.a... 2023-05-21T16:53:16.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-21T16:53:17.041 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2023-05-21T16:53:17.058 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-21T16:53:17.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-21T16:53:17.117 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2023-05-21T16:53:17.117 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-21T16:53:17.118 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:17.119 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-21T16:53:17.124 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:17.211 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:17.211 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 88c6000c-747d-47ed-bada-4d7002233c90 2023-05-21T16:53:17.211 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = pacific 2023-05-21T16:53:17.211 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 88c6000c-747d-47ed-bada-4d7002233c90 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2023-05-21T16:53:17.211547+0000 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-05-21T16:53:17.211547+0000 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 16 (pacific) 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2023-05-21T16:53:17.212 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2023-05-21T16:53:17.213 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-21T16:53:17.214 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-21T16:53:17.219 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 88c6000c-747d-47ed-bada-4d7002233c90... 2023-05-21T16:53:17.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-21T16:53:17.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-21T16:53:17.256 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2023-05-21T16:53:17.256 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2023-05-21T16:53:17.256 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-21T16:53:17.256 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2023-05-21T16:53:17.256 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.257 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2023-05-21T16:53:17.258 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2023-05-21T16:53:17.259 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2023-05-21T16:53:17.261 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 88c6000c-747d-47ed-bada-4d7002233c90 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2023-05-21T16:53:17.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.263 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.264 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2023-05-21T16:53:17.265 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2023-05-21T16:53:17.266 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2023-05-21T16:53:17.267 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2023-05-21T16:53:17.268 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-05-21T16:53:17.269 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-05-21T16:53:17.269 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-05-21T16:53:17.269 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-05-21T16:53:17.269 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2023-05-21T16:53:17.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.269 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2023-05-21T16:53:17.270 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2023-05-21T16:53:17.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2023-05-21T16:53:17.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2023-05-21T16:53:17.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2023-05-21T16:53:17.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.271 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-21T16:53:17.272 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2023-05-21T16:53:17.272 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2023-05-21T16:53:17.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.272 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2023-05-21T16:53:17.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-21T16:53:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-21T16:53:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2023-05-21T16:53:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2023-05-21T16:53:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2023-05-21T16:53:17.274 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2023-05-21T16:53:17.274 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:17.274 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2023-05-21T16:53:17.274 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2023-05-21T16:53:17.274 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-05-21T16:53:17.275 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = "" 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-05-21T16:53:17.276 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2023-05-21T16:53:17.277 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2023-05-21T16:53:17.278 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2023-05-21T16:53:17.278 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2023-05-21T16:53:17.278 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2023-05-21T16:53:17.278 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2023-05-21T16:53:17.278 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2023-05-21T16:53:17.279 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-05-21T16:53:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-05-21T16:53:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.46,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 88c6000c-747d-47ed-bada-4d7002233c90 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.285 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-05-21T16:53:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-05-21T16:53:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2023-05-21T16:53:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-05-21T16:53:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-05-21T16:53:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-05-21T16:53:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2023-05-21T16:53:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2023-05-21T16:53:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-05-21T16:53:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.291 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-05-21T16:53:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-05-21T16:53:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-05-21T16:53:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-05-21T16:53:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-05-21T16:53:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-05-21T16:53:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-05-21T16:53:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-05-21T16:53:17.298 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-05-21T16:53:17.298 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-05-21T16:53:17.298 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-05-21T16:53:17.298 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-05-21T16:53:17.298 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-05-21T16:53:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-05-21T16:53:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-05-21T16:53:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-05-21T16:53:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-05-21T16:53:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-05-21T16:53:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-05-21T16:53:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-05-21T16:53:17.301 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-21T16:53:17.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-21T16:53:17.382 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-21T16:53:17.382 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:17.382 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-21T16:53:17.389 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:17.389 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-21T16:53:17.395 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:53:17.395 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:17.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-21T16:53:17.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-21T16:53:17.466 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:17.467 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:17.474 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:53:17.474 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:17.475 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-21T16:53:17.475 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-21T16:53:17.501 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:17.501 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:17.550 INFO:tasks.ceph:Setting up mon nodes... 2023-05-21T16:53:17.551 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-21T16:53:17.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-21T16:53:17.602 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-21T16:53:17.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-21T16:53:17.703 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-21T16:53:17.720 INFO:tasks.ceph:Setting up mds nodes... 2023-05-21T16:53:17.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-21T16:53:17.771 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-21T16:53:17.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-21T16:53:17.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-21T16:53:17.836 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-21T16:53:17.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-21T16:53:17.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-21T16:53:17.906 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-21T16:53:17.909 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-21T16:53:17.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-21T16:53:17.969 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-21T16:53:17.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-21T16:53:17.981 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-21T16:53:17.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-21T16:53:18.027 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-21T16:53:18.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-21T16:53:18.124 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-21T16:53:18.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-21T16:53:18.180 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-21T16:53:18.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-21T16:53:18.231 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-21T16:53:18.245 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-21T16:53:18.245 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-21T16:53:18.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-21T16:53:18.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:18.263 INFO:tasks.ceph:role: osd.0 2023-05-21T16:53:18.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:53:18.263 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-21T16:53:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:18.304 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:18.305 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:18.305 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-05-21T16:53:18.305 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:18.306 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:18.306 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:18.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-05-21T16:53:18.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-21T16:53:18.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-21T16:53:18.383 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:18.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:18.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-21T16:53:18.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:18.395 INFO:tasks.ceph:role: osd.1 2023-05-21T16:53:18.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:53:18.396 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-21T16:53:18.482 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:18.482 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:18.482 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:18.484 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-05-21T16:53:18.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-21T16:53:18.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-21T16:53:18.507 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:18.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:18.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-21T16:53:18.519 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:18.519 INFO:tasks.ceph:role: osd.2 2023-05-21T16:53:18.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:53:18.519 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-21T16:53:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:18.561 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:18.561 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:18.561 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-05-21T16:53:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:18.562 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:18.562 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:18.563 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-05-21T16:53:18.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-21T16:53:18.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-21T16:53:18.636 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:18.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:18.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-21T16:53:18.648 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:18.649 INFO:tasks.ceph:role: osd.3 2023-05-21T16:53:18.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:53:18.649 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-21T16:53:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:18.692 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:18.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2023-05-21T16:53:18.693 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-21T16:53:18.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-21T16:53:18.766 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:18.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:18.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:18.846+0000 7f2245091700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-21T16:53:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:18.850+0000 7f2245091700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-21T16:53:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:18.850+0000 7f2245091700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-21T16:53:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:18.850+0000 7f2245091700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-21T16:53:18.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:18.850+0000 7f2245091700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-21T16:53:18.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:18.850+0000 7f2245091700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-21T16:53:21.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-21T16:53:21.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:21.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:21.926+0000 7f7684bcc700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-21T16:53:21.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:21.926+0000 7f7684bcc700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-21T16:53:21.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:21.926+0000 7f7684bcc700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-21T16:53:21.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:21.926+0000 7f7684bcc700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-21T16:53:21.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:21.926+0000 7f7684bcc700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-21T16:53:21.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:21.930+0000 7f7684bcc700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-21T16:53:24.947 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-21T16:53:24.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:25.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:25.054+0000 7fe665097700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-21T16:53:25.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:25.054+0000 7fe665097700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-21T16:53:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:25.054+0000 7fe665097700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-21T16:53:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:25.054+0000 7fe665097700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-21T16:53:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:25.054+0000 7fe665097700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-21T16:53:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:25.054+0000 7fe665097700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-21T16:53:28.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-21T16:53:28.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:28.130+0000 7f681015f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-21T16:53:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:28.130+0000 7f681015f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-21T16:53:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:28.130+0000 7f681015f700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-21T16:53:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:28.130+0000 7f681015f700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-21T16:53:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:28.130+0000 7f681015f700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-21T16:53:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:28.130+0000 7f681015f700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-21T16:53:31.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-21T16:53:31.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-21T16:53:31.153 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:31.153 INFO:tasks.ceph:role: osd.4 2023-05-21T16:53:31.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:53:31.154 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-21T16:53:31.739 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:31.740 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:31.740 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:31.740 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-05-21T16:53:31.741 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:31.741 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:31.741 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:31.742 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:31.742 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:31.742 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:31.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-05-21T16:53:31.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-21T16:53:31.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-21T16:53:31.835 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:31.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:31.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-21T16:53:31.846 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:31.846 INFO:tasks.ceph:role: osd.5 2023-05-21T16:53:31.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:53:31.847 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-21T16:53:32.406 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-05-21T16:53:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:32.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-05-21T16:53:32.408 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-21T16:53:32.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-21T16:53:32.459 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:32.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:32.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-21T16:53:32.514 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:32.514 INFO:tasks.ceph:role: osd.6 2023-05-21T16:53:32.514 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:53:32.514 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-21T16:53:32.972 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-05-21T16:53:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:32.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-05-21T16:53:32.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-21T16:53:33.025 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-21T16:53:33.036 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:33.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:33.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-21T16:53:33.049 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-21T16:53:33.049 INFO:tasks.ceph:role: osd.7 2023-05-21T16:53:33.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:53:33.050 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-21T16:53:33.556 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-21T16:53:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-21T16:53:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-21T16:53:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2023-05-21T16:53:33.556 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-21T16:53:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-05-21T16:53:33.557 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-21T16:53:33.557 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-21T16:53:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-21T16:53:33.557 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-21T16:53:33.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-05-21T16:53:33.558 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-21T16:53:33.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-21T16:53:33.618 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-05-21T16:53:33.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:53:33.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:33.693+0000 7fda473f0700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-21T16:53:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:33.697+0000 7fda473f0700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-21T16:53:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:33.697+0000 7fda473f0700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-21T16:53:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:33.697+0000 7fda473f0700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-21T16:53:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:33.697+0000 7fda473f0700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-21T16:53:33.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:33.697+0000 7fda473f0700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-21T16:53:36.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-21T16:53:36.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:37.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:37.057+0000 7f41e3296700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-21T16:53:37.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:37.057+0000 7f41e3296700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-21T16:53:37.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:37.057+0000 7f41e3296700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-21T16:53:37.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:37.057+0000 7f41e3296700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-21T16:53:37.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:37.057+0000 7f41e3296700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-21T16:53:37.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:37.057+0000 7f41e3296700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-21T16:53:40.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-21T16:53:40.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:40.125+0000 7f49e170e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-21T16:53:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:40.125+0000 7f49e170e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-21T16:53:40.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:40.125+0000 7f49e170e700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-21T16:53:40.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:40.125+0000 7f49e170e700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-21T16:53:40.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:40.125+0000 7f49e170e700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-21T16:53:40.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:40.129+0000 7f49e170e700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-21T16:53:43.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-21T16:53:43.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:43.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:43.261+0000 7f7e339d1700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-21T16:53:43.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:43.261+0000 7f7e339d1700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-21T16:53:43.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:43.261+0000 7f7e339d1700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-21T16:53:43.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:43.265+0000 7f7e339d1700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-21T16:53:43.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:43.265+0000 7f7e339d1700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-21T16:53:43.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:43.265+0000 7f7e339d1700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-21T16:53:46.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:53:46.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:53:46.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-21T16:53:46.536 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-21T16:53:46.537 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-21T16:53:46.553 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-21T16:53:46.611 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-21T16:53:46.621 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-21T16:53:46.637 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-21T16:53:46.651 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-21T16:53:46.707 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-21T16:53:46.720 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.721 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-21T16:53:46.737 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-21T16:53:46.796 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-21T16:53:46.806 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-21T16:53:46.821 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-21T16:53:46.836 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-21T16:53:46.847 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-21T16:53:46.904 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.905 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-21T16:53:46.911 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:46.912 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-21T16:53:46.962 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.963 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-21T16:53:46.970 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:46.970 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-21T16:53:47.018 INFO:tasks.ceph:Adding keys to all mons... 2023-05-21T16:53:47.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-21T16:53:47.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-21T16:53:47.032 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2023-05-21T16:53:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpkMt3tIxAA3MOnp4wfW9XPCfERBAPnTw== 2023-05-21T16:53:47.032 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2023-05-21T16:53:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpki1gHLhAAPiOS6bcjJBHz2MRcwfWYFg== 2023-05-21T16:53:47.032 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2023-05-21T16:53:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpkpOzlMRAA4aZpiecfZq4C3lCtQbBeYg== 2023-05-21T16:53:47.033 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2023-05-21T16:53:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB+TGpkBRzOMhAAVPCX/fmqk/VqvYu+RhTYFQ== 2023-05-21T16:53:47.033 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2023-05-21T16:53:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCBTGpkjYOONxAAv0HbaCcFUkGbs4qufAzJQQ== 2023-05-21T16:53:47.033 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2023-05-21T16:53:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCFTGpkA09jAxAAizXs5rJiUOqA9VP0z2jwOg== 2023-05-21T16:53:47.034 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2023-05-21T16:53:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCITGpke1DrBxAADVKP7j+UvBNae5bjhvY7eA== 2023-05-21T16:53:47.034 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2023-05-21T16:53:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpkAOELKhAAEHcT2uVno8t8eH5xPsLVJQ== 2023-05-21T16:53:47.034 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpkr78jNhAAYL//f04X/Fhl8DXkyaJ4GQ== 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpkuB/lORAAPQdRD7pj/yWPodV3N0emfQ== 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCNTGpkNNyTKRAAIGMScNf7AVnIV3UOJENE5g== 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCRTGpkN96UAxAAXRW+hfXBhwpjSPYty26O5g== 2023-05-21T16:53:47.035 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCUTGpk3F/GBxAASeLnJ5GmRDSWZtN51PyGpA== 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCXTGpkwC3nDxAA74at/BnPJZlsBtCbUroLJw== 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB+TGpkXg2qARAAVnjHF0MQFJcvFrEmZI1T4w== 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout:[client.2] 2023-05-21T16:53:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB+TGpkO291BxAADKtdPe8+71XZ9Ei/YOUcpA== 2023-05-21T16:53:47.037 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2023-05-21T16:53:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB+TGpkcgfhChAAhfrvn6MXSxIL6im6BX5y5g== 2023-05-21T16:53:47.037 INFO:teuthology.orchestra.run.smithi046.stdout:[client.3] 2023-05-21T16:53:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB+TGpkNnv0DRAALaixpNnTJIT3x79j2s79sg== 2023-05-21T16:53:47.038 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2023-05-21T16:53:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB9TGpkMt3tIxAA3MOnp4wfW9XPCfERBAPnTw== 2023-05-21T16:53:47.038 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB9TGpki1gHLhAAPiOS6bcjJBHz2MRcwfWYFg== 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB9TGpkpOzlMRAA4aZpiecfZq4C3lCtQbBeYg== 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+TGpkBRzOMhAAVPCX/fmqk/VqvYu+RhTYFQ== 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2023-05-21T16:53:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCBTGpkjYOONxAAv0HbaCcFUkGbs4qufAzJQQ== 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCFTGpkA09jAxAAizXs5rJiUOqA9VP0z2jwOg== 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCITGpke1DrBxAADVKP7j+UvBNae5bjhvY7eA== 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB9TGpkAOELKhAAEHcT2uVno8t8eH5xPsLVJQ== 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-05-21T16:53:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB9TGpkr78jNhAAYL//f04X/Fhl8DXkyaJ4GQ== 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB9TGpkuB/lORAAPQdRD7pj/yWPodV3N0emfQ== 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCNTGpkNNyTKRAAIGMScNf7AVnIV3UOJENE5g== 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCRTGpkN96UAxAAXRW+hfXBhwpjSPYty26O5g== 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2023-05-21T16:53:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCUTGpk3F/GBxAASeLnJ5GmRDSWZtN51PyGpA== 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCXTGpkwC3nDxAA74at/BnPJZlsBtCbUroLJw== 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+TGpkXg2qARAAVnjHF0MQFJcvFrEmZI1T4w== 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+TGpkO291BxAADKtdPe8+71XZ9Ei/YOUcpA== 2023-05-21T16:53:47.042 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-05-21T16:53:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+TGpkcgfhChAAhfrvn6MXSxIL6im6BX5y5g== 2023-05-21T16:53:47.043 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2023-05-21T16:53:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+TGpkNnv0DRAALaixpNnTJIT3x79j2s79sg== 2023-05-21T16:53:47.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-21T16:53:47.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-21T16:53:47.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.441 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.489 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-21T16:53:47.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-21T16:53:47.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-21T16:53:47.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-21T16:53:47.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:47.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:47.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:47.901 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:47.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:47.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:48.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:48.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-21T16:53:48.058 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-21T16:53:48.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-21T16:53:48.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-21T16:53:48.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-21T16:53:48.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-21T16:53:48.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-21T16:53:48.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-21T16:53:48.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-21T16:53:48.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-21T16:53:48.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-21T16:53:48.409 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:48.411 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-21T16:53:48.415 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-21T16:53:48.416 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-21T16:53:48.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-21T16:53:48.461 INFO:tasks.ceph.mon.a:Started 2023-05-21T16:53:48.461 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-21T16:53:48.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-21T16:53:48.465 INFO:tasks.ceph.mon.b:Started 2023-05-21T16:53:48.465 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-21T16:53:48.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-21T16:53:48.468 INFO:tasks.ceph.mon.c:Started 2023-05-21T16:53:48.468 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-21T16:53:48.469 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-21T16:53:48.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-21T16:53:48.472 INFO:tasks.ceph.mgr.y:Started 2023-05-21T16:53:48.472 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-21T16:53:48.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-21T16:53:48.476 INFO:tasks.ceph.mgr.x:Started 2023-05-21T16:53:48.476 INFO:tasks.ceph:Setting crush tunables to default 2023-05-21T16:53:48.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2023-05-21T16:53:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.581+0000 7f4d90f3e700 1 Processor -- start 2023-05-21T16:53:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.581+0000 7f4d90f3e700 1 -- start start 2023-05-21T16:53:48.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d90f3e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d90f3e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0cd670 con 0x7f4d8c15a8e0 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d90f3e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c06cb10 con 0x7f4d8c0b1c30 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d90f3e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c06cdf0 con 0x7f4d8c157470 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4d8c15a8e0 0x7f4d8c0b1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37118/0 (socket says 172.21.15.46:37118) 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 learned_addr learned my addr 172.21.15.46:0/1578574532 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:48.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:48.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:48.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:48.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-21T16:53:48.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.789+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:48.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.789+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:48.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.789+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:48.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.789+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:48.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:48.789+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-21T16:53:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.193+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.193+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.193+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.193+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.193+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-21T16:53:50.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.997+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.997+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.997+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.997+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:49.997+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-21T16:53:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d8c06c2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-21T16:53:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d8c06c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 >> v1:172.21.15.142:6789/0 conn(0x7f4d8c0b1c30 legacy=0x7f4d8c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 >> v1:172.21.15.46:6789/0 conn(0x7f4d8c15a8e0 legacy=0x7f4d8c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c06cdf0 con 0x7f4d78006280 2023-05-21T16:53:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78008dc0 con 0x7f4d780037b0 2023-05-21T16:53:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-21T16:53:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-21T16:53:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-21T16:53:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-21T16:53:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:51.789+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-21T16:53:52.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-21T16:53:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-21T16:53:52.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:52.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:52.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:52.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.193+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-21T16:53:53.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:53.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:53.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-21T16:53:53.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:53.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:53.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-21T16:53:53.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-21T16:53:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-21T16:53:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-21T16:53:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:52.997+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-21T16:53:53.880 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:53.877+0000 7fe6aa29a2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-21T16:53:54.507 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:54.501+0000 7fe6aa29a2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-21T16:53:54.564 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:54.561+0000 7fe6aa29a2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-21T16:53:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 msgr2=0x7f4d78005bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-21T16:53:54.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d780037b0 0x7f4d78005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 msgr2=0x7f4d78008710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-21T16:53:54.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78006280 0x7f4d78008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8bfff700 1 -- 172.21.15.46:0/1578574532 reap_dead start 2023-05-21T16:53:54.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d7800b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:54.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78003bc0 0x7f4d78006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d78006b90 0x7f4d78007030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c06cdf0 con 0x7f4d78003bc0 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d78008dc0 con 0x7f4d8c157470 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d897fa700 1 -- 172.21.15.46:0/1578574532 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780077a0 con 0x7f4d78006b90 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.46:3300/0 conn(0x7f4d78003bc0 0x7f4d78006650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d7800b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:54.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8bfff700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d78006b90 0x7f4d78007030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d78006b90 msgr2=0x7f4d78007030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d78006b90 0x7f4d78007030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 msgr2=0x7f4d7800b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d7800b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 -- 172.21.15.46:0/1578574532 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c06d0d0 con 0x7f4d78003bc0 2023-05-21T16:53:54.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d7800b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8affd700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d78006650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0cac40 tx=0x7f4d80007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deda988647593f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8a7fc700 1 -- 172.21.15.46:0/1578574532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80005e50 con 0x7f4d78003bc0 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8a7fc700 1 -- 172.21.15.46:0/1578574532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80017460 con 0x7f4d78003bc0 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.585+0000 7f4d8a7fc700 1 -- 172.21.15.46:0/1578574532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d800177d0 con 0x7f4d78003bc0 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 -- 172.21.15.46:0/1578574532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 msgr2=0x7f4d78006650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d78006650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0cac40 tx=0x7f4d80007330 comp rx=0 tx=0).stop 2023-05-21T16:53:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 -- 172.21.15.46:0/1578574532 shutdown_connections 2023-05-21T16:53:54.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d78006b90 0x7f4d78007030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/1578574532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d78006650 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/1578574532 >> v2:172.21.15.142:3300/0 conn(0x7f4d8c157470 0x7f4d7800b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 -- 172.21.15.46:0/1578574532 >> 172.21.15.46:0/1578574532 conn(0x7f4d8c06d930 msgr2=0x7f4d8c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:54.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 -- 172.21.15.46:0/1578574532 shutdown_connections 2023-05-21T16:53:54.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.589+0000 7f4d90f3e700 1 -- 172.21.15.46:0/1578574532 wait complete. 2023-05-21T16:53:54.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 Processor -- start 2023-05-21T16:53:54.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 -- start start 2023-05-21T16:53:54.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d8c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:54.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d78006b90 0x7f4d8c14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:54.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d8c157470 0x7f4d8c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c150500 con 0x7f4d78003bc0 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c14ff20 con 0x7f4d78006b90 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c7580 con 0x7f4d8c157470 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d8c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d8c0b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50524/0 (socket says 172.21.15.46:50524) 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/177612318 learned_addr learned my addr 172.21.15.46:0/177612318 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:53:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8bfff700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d8c157470 0x7f4d8c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8affd700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d78006b90 0x7f4d8c14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d8c157470 msgr2=0x7f4d8c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d8c157470 0x7f4d8c0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d78006b90 msgr2=0x7f4d8c14e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d78006b90 0x7f4d8c14e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 -- 172.21.15.46:0/177612318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c009bd0 con 0x7f4d78003bc0 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8affd700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d78006b90 0x7f4d8c14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:53:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d8b7fe700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d8c0b28f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c004a00 tx=0x7f4d7c004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c019ea0 con 0x7f4d78003bc0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00f040 con 0x7f4d78003bc0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8000f040 con 0x7f4d78003bc0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.593+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0216a0 con 0x7f4d78003bc0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.597+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c0b1520 con 0x7f4d78003bc0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.597+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d7c021800 con 0x7f4d78003bc0 2023-05-21T16:53:54.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.597+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4d7c018a00 con 0x7f4d78003bc0 2023-05-21T16:53:54.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.597+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c0cd8c0 con 0x7f4d78003bc0 2023-05-21T16:53:54.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.605+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4d7c018430 con 0x7f4d78003bc0 2023-05-21T16:53:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.681+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4d8c0b16b0 con 0x7f4d78003bc0 2023-05-21T16:53:54.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d73fff700 1 -- 172.21.15.46:0/177612318 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4d7c021c90 con 0x7f4d78003bc0 2023-05-21T16:53:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 msgr2=0x7f4d8c0b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d8c0b28f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c004a00 tx=0x7f4d7c004a30 comp rx=0 tx=0).stop 2023-05-21T16:53:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 shutdown_connections 2023-05-21T16:53:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d8c157470 0x7f4d8c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d78006b90 0x7f4d8c14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 --2- 172.21.15.46:0/177612318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d78003bc0 0x7f4d8c0b28f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:54.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 >> 172.21.15.46:0/177612318 conn(0x7f4d8c06d930 msgr2=0x7f4d8c1527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:54.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 shutdown_connections 2023-05-21T16:53:54.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:54.689+0000 7f4d90f3e700 1 -- 172.21.15.46:0/177612318 wait complete. 2023-05-21T16:53:54.696 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2023-05-21T16:53:54.706 INFO:tasks.ceph:check_enable_crimson: False 2023-05-21T16:53:54.707 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-21T16:53:54.707 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:54.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-21T16:53:54.715 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:54.709+0000 7fe6aa29a2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-21T16:53:54.719 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:54.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-21T16:53:54.729 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:54.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-21T16:53:54.744 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:53:54.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-21T16:53:54.800 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:54.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-21T16:53:54.811 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:54.808+0000 7fd6f32022c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-21T16:53:54.816 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:54.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-21T16:53:54.870 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:54.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-21T16:53:54.880 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:53:54.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-21T16:53:54.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 612525d2-4128-4839-81a3-07a7bc220010 0 2023-05-21T16:53:54.915 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:54.909+0000 7fe6aa29a2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-21T16:53:54.968 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:54.965+0000 7fe6aa29a2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-21T16:53:55.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 Processor -- start 2023-05-21T16:53:55.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 -- start start 2023-05-21T16:53:55.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f218c0ccda0 0x7f218c160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c0af130 con 0x7f218c0cf360 2023-05-21T16:53:55.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c1610c0 con 0x7f218c0ccda0 2023-05-21T16:53:55.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2192095700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0ce340 con 0x7f218c0cc9d0 2023-05-21T16:53:55.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2191894700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f218c0cf360 0x7f218c0ca8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34318/0 (socket says 172.21.15.142:34318) 2023-05-21T16:53:55.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2191894700 1 -- 172.21.15.142:0/2580578947 learned_addr learned my addr 172.21.15.142:0/2580578947 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2191093700 1 --2- 172.21.15.142:0/2580578947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2190892700 1 --2- 172.21.15.142:0/2580578947 >> v2:172.21.15.46:3300/0 conn(0x7f218c0ccda0 0x7f218c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2183fff700 1 -- 172.21.15.142:0/2580578947 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527805087 0 0) 0x7f218c0af130 con 0x7f218c0cf360 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.040+0000 7f2183fff700 1 -- 172.21.15.142:0/2580578947 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21780035d0 con 0x7f218c0cf360 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 -- 172.21.15.142:0/2580578947 >> v2:172.21.15.46:3300/0 conn(0x7f218c0ccda0 msgr2=0x7f218c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 --2- 172.21.15.142:0/2580578947 >> v2:172.21.15.46:3300/0 conn(0x7f218c0ccda0 0x7f218c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 -- 172.21.15.142:0/2580578947 >> v1:172.21.15.142:6789/0 conn(0x7f218c0cf360 legacy=0x7f218c0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 -- 172.21.15.142:0/2580578947 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0ce620 con 0x7f218c0cc9d0 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 --2- 172.21.15.142:0/2580578947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c0cee20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2188009850 tx=0x7f2188009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b3cccb89c5fc38 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2183fff700 1 -- 172.21.15.142:0/2580578947 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011830 con 0x7f218c0cc9d0 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2183fff700 1 -- 172.21.15.142:0/2580578947 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188011990 con 0x7f218c0cc9d0 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2183fff700 1 -- 172.21.15.142:0/2580578947 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011d40 con 0x7f218c0cc9d0 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- 172.21.15.142:0/2580578947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 msgr2=0x7f218c0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 --2- 172.21.15.142:0/2580578947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c0cee20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2188009850 tx=0x7f2188009b60 comp rx=0 tx=0).stop 2023-05-21T16:53:55.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- 172.21.15.142:0/2580578947 shutdown_connections 2023-05-21T16:53:55.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 --2- 172.21.15.142:0/2580578947 >> v2:172.21.15.46:3300/0 conn(0x7f218c0ccda0 0x7f218c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 --2- 172.21.15.142:0/2580578947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c0cee20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- 172.21.15.142:0/2580578947 >> 172.21.15.142:0/2580578947 conn(0x7f218c06d930 msgr2=0x7f218c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- 172.21.15.142:0/2580578947 shutdown_connections 2023-05-21T16:53:55.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- 172.21.15.142:0/2580578947 wait complete. 2023-05-21T16:53:55.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 Processor -- start 2023-05-21T16:53:55.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- start start 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f218c0ccda0 0x7f218c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cf360 0x7f218c0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0c3c00 con 0x7f218c0ccda0 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c15beb0 con 0x7f218c0cf360 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2192095700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1f1e20 con 0x7f218c0cc9d0 2023-05-21T16:53:55.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c15b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:40940/0 (socket says 172.21.15.142:40940) 2023-05-21T16:53:55.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191093700 1 -- 172.21.15.142:0/2316508867 learned_addr learned my addr 172.21.15.142:0/2316508867 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2191894700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cf360 0x7f218c0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.044+0000 7f2190892700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f218c0ccda0 0x7f218c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2191093700 1 -- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cf360 msgr2=0x7f218c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2191093700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cf360 0x7f218c0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2191093700 1 -- 172.21.15.142:0/2316508867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f218c0ccda0 msgr2=0x7f218c0b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2191093700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f218c0ccda0 0x7f218c0b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2191093700 1 -- 172.21.15.142:0/2316508867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880094b0 con 0x7f218c0cc9d0 2023-05-21T16:53:55.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2191093700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c15b970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2188014040 tx=0x7f2188004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188004510 con 0x7f218c0cc9d0 2023-05-21T16:53:55.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c1613a0 con 0x7f218c0cc9d0 2023-05-21T16:53:55.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c0ce900 con 0x7f218c0cc9d0 2023-05-21T16:53:55.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218801e070 con 0x7f218c0cc9d0 2023-05-21T16:53:55.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188003900 con 0x7f218c0cc9d0 2023-05-21T16:53:55.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2188025480 con 0x7f218c0cc9d0 2023-05-21T16:53:55.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.048+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2188020070 con 0x7f218c0cc9d0 2023-05-21T16:53:55.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.052+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c005310 con 0x7f218c0cc9d0 2023-05-21T16:53:55.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.056+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f218802a020 con 0x7f218c0cc9d0 2023-05-21T16:53:55.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.132+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "612525d2-4128-4839-81a3-07a7bc220010", "id": 0} v 0) v1 -- 0x7f216c005660 con 0x7f218c0cc9d0 2023-05-21T16:53:55.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2181ffb700 1 -- 172.21.15.142:0/2316508867 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "612525d2-4128-4839-81a3-07a7bc220010", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2188015020 con 0x7f218c0cc9d0 2023-05-21T16:53:55.142 INFO:teuthology.orchestra.run.smithi142.stdout:0 2023-05-21T16:53:55.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 msgr2=0x7f218c15b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c15b970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2188014040 tx=0x7f2188004770 comp rx=0 tx=0).stop 2023-05-21T16:53:55.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 shutdown_connections 2023-05-21T16:53:55.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c0cf360 0x7f218c0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f218c0ccda0 0x7f218c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 --2- 172.21.15.142:0/2316508867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0cc9d0 0x7f218c15b970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 >> 172.21.15.142:0/2316508867 conn(0x7f218c06d930 msgr2=0x7f218c1604b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 shutdown_connections 2023-05-21T16:53:55.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.140+0000 7f2192095700 1 -- 172.21.15.142:0/2316508867 wait complete. 2023-05-21T16:53:55.155 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:55.149+0000 7fe6aa29a2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-21T16:53:55.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 5662b240-6b3b-40ae-881f-49d0a074d2ac 1 2023-05-21T16:53:55.220 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:55.217+0000 7fe6aa29a2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-21T16:53:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.260+0000 7f2a948bb700 1 Processor -- start 2023-05-21T16:53:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.260+0000 7f2a948bb700 1 -- start start 2023-05-21T16:53:55.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 0x7f2a900aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a900ccf70 con 0x7f2a90070250 2023-05-21T16:53:55.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9015ead0 con 0x7f2a900b63e0 2023-05-21T16:53:55.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900cd310 con 0x7f2a900d0400 2023-05-21T16:53:55.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 0x7f2a900aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 0x7f2a900aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:40954/0 (socket says 172.21.15.142:40954) 2023-05-21T16:53:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 -- 172.21.15.142:0/1486883482 learned_addr learned my addr 172.21.15.142:0/1486883482 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 -- 172.21.15.142:0/1486883482 >> v1:172.21.15.142:6789/0 conn(0x7f2a900b63e0 legacy=0x7f2a900cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 -- 172.21.15.142:0/1486883482 >> v1:172.21.15.46:6789/0 conn(0x7f2a90070250 legacy=0x7f2a9006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 -- 172.21.15.142:0/1486883482 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9015edb0 con 0x7f2a900d0400 2023-05-21T16:53:55.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8e59c700 1 --2- 172.21.15.142:0/1486883482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 0x7f2a900aff50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009940 tx=0x7f2a84009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d1bdf458d663c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8dd9b700 1 -- 172.21.15.142:0/1486883482 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400ba60 con 0x7f2a900d0400 2023-05-21T16:53:55.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8dd9b700 1 -- 172.21.15.142:0/1486883482 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a84009e90 con 0x7f2a900d0400 2023-05-21T16:53:55.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a8dd9b700 1 -- 172.21.15.142:0/1486883482 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400bde0 con 0x7f2a900d0400 2023-05-21T16:53:55.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- 172.21.15.142:0/1486883482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 msgr2=0x7f2a900aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 --2- 172.21.15.142:0/1486883482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 0x7f2a900aff50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009940 tx=0x7f2a84009c50 comp rx=0 tx=0).stop 2023-05-21T16:53:55.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- 172.21.15.142:0/1486883482 shutdown_connections 2023-05-21T16:53:55.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 --2- 172.21.15.142:0/1486883482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900d0400 0x7f2a900aff50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- 172.21.15.142:0/1486883482 >> 172.21.15.142:0/1486883482 conn(0x7f2a900d0b80 msgr2=0x7f2a900d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- 172.21.15.142:0/1486883482 shutdown_connections 2023-05-21T16:53:55.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.264+0000 7f2a948bb700 1 -- 172.21.15.142:0/1486883482 wait complete. 2023-05-21T16:53:55.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 Processor -- start 2023-05-21T16:53:55.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- start start 2023-05-21T16:53:55.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 0x7f2a90146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b63e0 0x7f2a900c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a900b2ea0 0x7f2a900ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a901f0c10 con 0x7f2a900b2ea0 2023-05-21T16:53:55.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b20e0 con 0x7f2a90070250 2023-05-21T16:53:55.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b23c0 con 0x7f2a900b63e0 2023-05-21T16:53:55.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 0x7f2a90146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 0x7f2a90146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36722/0 (socket says 172.21.15.142:36722) 2023-05-21T16:53:55.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 -- 172.21.15.142:0/2038930402 learned_addr learned my addr 172.21.15.142:0/2038930402 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8e59c700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b63e0 0x7f2a900c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8f59e700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a900b2ea0 0x7f2a900ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 -- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b63e0 msgr2=0x7f2a900c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b63e0 0x7f2a900c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 -- 172.21.15.142:0/2038930402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a900b2ea0 msgr2=0x7f2a900ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a900b2ea0 0x7f2a900ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 -- 172.21.15.142:0/2038930402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84009570 con 0x7f2a90070250 2023-05-21T16:53:55.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a8ed9d700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 0x7f2a90146e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000c500 tx=0x7f2a8000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800052d0 con 0x7f2a90070250 2023-05-21T16:53:55.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80005430 con 0x7f2a90070250 2023-05-21T16:53:55.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9006e240 con 0x7f2a90070250 2023-05-21T16:53:55.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800055a0 con 0x7f2a90070250 2023-05-21T16:53:55.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9006fad0 con 0x7f2a90070250 2023-05-21T16:53:55.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a80003be0 con 0x7f2a90070250 2023-05-21T16:53:55.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2a80011e40 con 0x7f2a90070250 2023-05-21T16:53:55.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.268+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9006e3d0 con 0x7f2a90070250 2023-05-21T16:53:55.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.272+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2a80017070 con 0x7f2a90070250 2023-05-21T16:53:55.285 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:55.281+0000 7fe6aa29a2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-21T16:53:55.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.352+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5662b240-6b3b-40ae-881f-49d0a074d2ac", "id": 1} v 0) v1 -- 0x7f2a90073cb0 con 0x7f2a90070250 2023-05-21T16:53:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.356+0000 7f2a777fe700 1 -- 172.21.15.142:0/2038930402 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5662b240-6b3b-40ae-881f-49d0a074d2ac", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a80011590 con 0x7f2a90070250 2023-05-21T16:53:55.362 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-05-21T16:53:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 msgr2=0x7f2a90146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 0x7f2a90146e30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000c500 tx=0x7f2a8000c810 comp rx=0 tx=0).stop 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 shutdown_connections 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a900b2ea0 0x7f2a900ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a900b63e0 0x7f2a900c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 --2- 172.21.15.142:0/2038930402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a90070250 0x7f2a90146e30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 >> 172.21.15.142:0/2038930402 conn(0x7f2a900d0b80 msgr2=0x7f2a900b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 shutdown_connections 2023-05-21T16:53:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.360+0000 7f2a948bb700 1 -- 172.21.15.142:0/2038930402 wait complete. 2023-05-21T16:53:55.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new f78ffdcc-8d96-48c6-91ef-595b03771447 2 2023-05-21T16:53:55.443 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:55.440+0000 7fd6f32022c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-21T16:53:55.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 Processor -- start 2023-05-21T16:53:55.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 -- start start 2023-05-21T16:53:55.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02b015a8d0 0x7f02b015e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02b00aec10 0x7f02b015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b015aca0 con 0x7f02b015ee10 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00cb7f0 con 0x7f02b015a8d0 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02b5271700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00ca520 con 0x7f02b00aec10 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02b00aec10 0x7f02b015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02b00aec10 0x7f02b015e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36726/0 (socket says 172.21.15.142:36726) 2023-05-21T16:53:55.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 -- 172.21.15.142:0/4071446681 learned_addr learned my addr 172.21.15.142:0/4071446681 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02affff700 1 --2- 172.21.15.142:0/4071446681 >> v2:172.21.15.46:3300/0 conn(0x7f02b015a8d0 0x7f02b015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 -- 172.21.15.142:0/4071446681 >> v2:172.21.15.46:3300/0 conn(0x7f02b015a8d0 msgr2=0x7f02b015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:55.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 --2- 172.21.15.142:0/4071446681 >> v2:172.21.15.46:3300/0 conn(0x7f02b015a8d0 0x7f02b015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 -- 172.21.15.142:0/4071446681 >> v1:172.21.15.142:6789/0 conn(0x7f02b015ee10 legacy=0x7f02b00b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02af7fe700 1 -- 172.21.15.142:0/4071446681 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b015f210 con 0x7f02b00aec10 2023-05-21T16:53:55.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.484+0000 7f02affff700 1 --2- 172.21.15.142:0/4071446681 >> v2:172.21.15.46:3300/0 conn(0x7f02b015a8d0 0x7f02b015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:53:55.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02af7fe700 1 --2- 172.21.15.142:0/4071446681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00aec10 0x7f02b015e8d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02b006aa10 tx=0x7f02a4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80c6364327124800 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02aeffd700 1 -- 172.21.15.142:0/4071446681 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400b8a0 con 0x7f02b00aec10 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02aeffd700 1 -- 172.21.15.142:0/4071446681 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400ba00 con 0x7f02b00aec10 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02aeffd700 1 -- 172.21.15.142:0/4071446681 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400bd90 con 0x7f02b00aec10 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 -- 172.21.15.142:0/4071446681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00aec10 msgr2=0x7f02b015e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 --2- 172.21.15.142:0/4071446681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00aec10 0x7f02b015e8d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02b006aa10 tx=0x7f02a4009bf0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 -- 172.21.15.142:0/4071446681 shutdown_connections 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 --2- 172.21.15.142:0/4071446681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00aec10 0x7f02b015e8d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 --2- 172.21.15.142:0/4071446681 >> v2:172.21.15.46:3300/0 conn(0x7f02b015a8d0 0x7f02b015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 -- 172.21.15.142:0/4071446681 >> 172.21.15.142:0/4071446681 conn(0x7f02b006d930 msgr2=0x7f02b006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 -- 172.21.15.142:0/4071446681 shutdown_connections 2023-05-21T16:53:55.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 -- 172.21.15.142:0/4071446681 wait complete. 2023-05-21T16:53:55.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 Processor -- start 2023-05-21T16:53:55.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.488+0000 7f02b5271700 1 -- start start 2023-05-21T16:53:55.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 0x7f02b00c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b015a8d0 0x7f02b0152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02b015ee10 0x7f02b015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b1be0 con 0x7f02b015ee10 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b23f0 con 0x7f02b015a8d0 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c70b0 con 0x7f02b00aec10 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02af7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b015a8d0 0x7f02b0152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 0x7f02b00c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 0x7f02b00c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:40974/0 (socket says 172.21.15.142:40974) 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 -- 172.21.15.142:0/1949198779 learned_addr learned my addr 172.21.15.142:0/1949198779 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b4a70700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02b015ee10 0x7f02b015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 -- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b015a8d0 msgr2=0x7f02b0152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b015a8d0 0x7f02b0152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 -- 172.21.15.142:0/1949198779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02b015ee10 msgr2=0x7f02b015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02b015ee10 0x7f02b015b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 -- 172.21.15.142:0/1949198779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4009570 con 0x7f02b00aec10 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02af7fe700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b015a8d0 0x7f02b0152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02affff700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 0x7f02b00c6b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f02a000e790 tx=0x7f02a000eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000c070 con 0x7f02b00aec10 2023-05-21T16:53:55.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a0004230 con 0x7f02b00aec10 2023-05-21T16:53:55.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b00cae50 con 0x7f02b00aec10 2023-05-21T16:53:55.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00045c0 con 0x7f02b00aec10 2023-05-21T16:53:55.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b00cab70 con 0x7f02b00aec10 2023-05-21T16:53:55.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f02a00039c0 con 0x7f02b00aec10 2023-05-21T16:53:55.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f02a001c400 con 0x7f02b00aec10 2023-05-21T16:53:55.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.492+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b00cb130 con 0x7f02b00aec10 2023-05-21T16:53:55.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.496+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f02a000f040 con 0x7f02b00aec10 2023-05-21T16:53:55.500 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:55.496+0000 7fd6f32022c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-21T16:53:55.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.568+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f78ffdcc-8d96-48c6-91ef-595b03771447", "id": 2} v 0) v1 -- 0x7f02b006d710 con 0x7f02b00aec10 2023-05-21T16:53:55.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.576+0000 7f02acff9700 1 -- 172.21.15.142:0/1949198779 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f78ffdcc-8d96-48c6-91ef-595b03771447", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f02a0013b40 con 0x7f02b00aec10 2023-05-21T16:53:55.582 INFO:teuthology.orchestra.run.smithi142.stdout:2 2023-05-21T16:53:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 msgr2=0x7f02b00c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 0x7f02b00c6b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f02a000e790 tx=0x7f02a000eaa0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 shutdown_connections 2023-05-21T16:53:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02b015ee10 0x7f02b015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b015a8d0 0x7f02b0152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 --2- 172.21.15.142:0/1949198779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00aec10 0x7f02b00c6b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 >> 172.21.15.142:0/1949198779 conn(0x7f02b006d930 msgr2=0x7f02b00b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 shutdown_connections 2023-05-21T16:53:55.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.580+0000 7f02b5271700 1 -- 172.21.15.142:0/1949198779 wait complete. 2023-05-21T16:53:55.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 925d9c07-7074-4307-aa90-a93dd351347d 3 2023-05-21T16:53:55.644 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:55.640+0000 7fd6f32022c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-21T16:53:55.696 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:55.693+0000 7fe6aa29a2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-21T16:53:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 Processor -- start 2023-05-21T16:53:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 -- start start 2023-05-21T16:53:55.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 0x7fe9780cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 0x7fe978160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9780af130 con 0x7fe9780cf360 2023-05-21T16:53:55.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9781610c0 con 0x7fe9780cc9d0 2023-05-21T16:53:55.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97df98700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9780ce340 con 0x7fe9780ccda0 2023-05-21T16:53:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 0x7fe978160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97cf96700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 0x7fe9780cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 0x7fe978160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:40978/0 (socket says 172.21.15.142:40978) 2023-05-21T16:53:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97cf96700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 0x7fe9780cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36756/0 (socket says 172.21.15.142:36756) 2023-05-21T16:53:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 -- 172.21.15.142:0/4152263665 learned_addr learned my addr 172.21.15.142:0/4152263665 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 -- 172.21.15.142:0/4152263665 >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 msgr2=0x7fe9780cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 --2- 172.21.15.142:0/4152263665 >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 0x7fe9780cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 -- 172.21.15.142:0/4152263665 >> v1:172.21.15.46:6789/0 conn(0x7fe9780cf360 legacy=0x7fe9780ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 -- 172.21.15.142:0/4152263665 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9780ce620 con 0x7fe9780ccda0 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe97cf96700 1 --2- 172.21.15.142:0/4152263665 >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 0x7fe9780cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe977fff700 1 --2- 172.21.15.142:0/4152263665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 0x7fe978160520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe964009910 tx=0x7fe964009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=825617023aaafdd0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe9777fe700 1 -- 172.21.15.142:0/4152263665 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964011830 con 0x7fe9780ccda0 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe9777fe700 1 -- 172.21.15.142:0/4152263665 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe964011990 con 0x7fe9780ccda0 2023-05-21T16:53:55.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.696+0000 7fe9777fe700 1 -- 172.21.15.142:0/4152263665 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964011d40 con 0x7fe9780ccda0 2023-05-21T16:53:55.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- 172.21.15.142:0/4152263665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 msgr2=0x7fe978160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 --2- 172.21.15.142:0/4152263665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 0x7fe978160520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe964009910 tx=0x7fe964009c20 comp rx=0 tx=0).stop 2023-05-21T16:53:55.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- 172.21.15.142:0/4152263665 shutdown_connections 2023-05-21T16:53:55.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 --2- 172.21.15.142:0/4152263665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780ccda0 0x7fe978160520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 --2- 172.21.15.142:0/4152263665 >> v2:172.21.15.142:3300/0 conn(0x7fe9780cc9d0 0x7fe9780cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- 172.21.15.142:0/4152263665 >> 172.21.15.142:0/4152263665 conn(0x7fe97806d930 msgr2=0x7fe97806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- 172.21.15.142:0/4152263665 shutdown_connections 2023-05-21T16:53:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- 172.21.15.142:0/4152263665 wait complete. 2023-05-21T16:53:55.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 Processor -- start 2023-05-21T16:53:55.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- start start 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9780cc9d0 0x7fe9780c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 0x7fe9781f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780cf360 0x7fe9780c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9781f2100 con 0x7fe9780cc9d0 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9780b1850 con 0x7fe9780ccda0 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.700+0000 7fe97df98700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9780c95e0 con 0x7fe9780cf360 2023-05-21T16:53:55.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 0x7fe9781f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 0x7fe9781f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36760/0 (socket says 172.21.15.142:36760) 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 -- 172.21.15.142:0/3902987803 learned_addr learned my addr 172.21.15.142:0/3902987803 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe97d797700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780cf360 0x7fe9780c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe97cf96700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9780cc9d0 0x7fe9780c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 -- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780cf360 msgr2=0x7fe9780c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780cf360 0x7fe9780c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 -- 172.21.15.142:0/3902987803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9780cc9d0 msgr2=0x7fe9780c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9780cc9d0 0x7fe9780c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 -- 172.21.15.142:0/3902987803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0094b0 con 0x7fe9780ccda0 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe977fff700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 0x7fe9781f1bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe964000c00 tx=0x7fe964004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964004510 con 0x7fe9780ccda0 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9640036c0 con 0x7fe9780ccda0 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe964009570 con 0x7fe9780ccda0 2023-05-21T16:53:55.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964003a70 con 0x7fe9780ccda0 2023-05-21T16:53:55.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9781613a0 con 0x7fe9780ccda0 2023-05-21T16:53:55.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe96401a430 con 0x7fe9780ccda0 2023-05-21T16:53:55.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe964021030 con 0x7fe9780ccda0 2023-05-21T16:53:55.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.704+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9780ce900 con 0x7fe9780ccda0 2023-05-21T16:53:55.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.708+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe964045b10 con 0x7fe9780ccda0 2023-05-21T16:53:55.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.784+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "925d9c07-7074-4307-aa90-a93dd351347d", "id": 3} v 0) v1 -- 0x7fe9780caff0 con 0x7fe9780ccda0 2023-05-21T16:53:55.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.788+0000 7fe9757fa700 1 -- 172.21.15.142:0/3902987803 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "925d9c07-7074-4307-aa90-a93dd351347d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe964034030 con 0x7fe9780ccda0 2023-05-21T16:53:55.794 INFO:teuthology.orchestra.run.smithi142.stdout:3 2023-05-21T16:53:55.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 msgr2=0x7fe9781f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 0x7fe9781f1bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe964000c00 tx=0x7fe964004770 comp rx=0 tx=0).stop 2023-05-21T16:53:55.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 shutdown_connections 2023-05-21T16:53:55.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9780cf360 0x7fe9780c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9780ccda0 0x7fe9781f1bc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 --2- 172.21.15.142:0/3902987803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9780cc9d0 0x7fe9780c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 >> 172.21.15.142:0/3902987803 conn(0x7fe97806d930 msgr2=0x7fe97806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 shutdown_connections 2023-05-21T16:53:55.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.792+0000 7fe97df98700 1 -- 172.21.15.142:0/3902987803 wait complete. 2023-05-21T16:53:55.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new aef2c64a-58c5-4174-b23c-01559c32eca1 4 2023-05-21T16:53:55.819 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:55.813+0000 7fe6aa29a2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-21T16:53:55.844 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:55.839+0000 7fd6f32022c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-21T16:53:55.896 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:55.891+0000 7fd6f32022c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-21T16:53:55.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 Processor -- start 2023-05-21T16:53:55.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 -- start start 2023-05-21T16:53:55.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc0240cc9d0 0x7fc0240cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc024160c30 0x7fc0240ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240af130 con 0x7fc0240ccda0 2023-05-21T16:53:55.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0241610c0 con 0x7fc0240cc9d0 2023-05-21T16:53:55.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0240ce340 con 0x7fc024160c30 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc022d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc024160c30 0x7fc0240ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc022d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc024160c30 0x7fc0240ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36770/0 (socket says 172.21.15.142:36770) 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc022d9d700 1 -- 172.21.15.142:0/1580281173 learned_addr learned my addr 172.21.15.142:0/1580281173 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc02259c700 1 --2- 172.21.15.142:0/1580281173 >> v2:172.21.15.46:3300/0 conn(0x7fc0240cc9d0 0x7fc0240cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc022d9d700 1 -- 172.21.15.142:0/1580281173 >> v2:172.21.15.46:3300/0 conn(0x7fc0240cc9d0 msgr2=0x7fc0240cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc022d9d700 1 --2- 172.21.15.142:0/1580281173 >> v2:172.21.15.46:3300/0 conn(0x7fc0240cc9d0 0x7fc0240cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.903+0000 7fc022d9d700 1 -- 172.21.15.142:0/1580281173 >> v1:172.21.15.46:6789/0 conn(0x7fc0240ccda0 legacy=0x7fc024160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:55.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc022d9d700 1 -- 172.21.15.142:0/1580281173 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240ce620 con 0x7fc024160c30 2023-05-21T16:53:55.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc022d9d700 1 --2- 172.21.15.142:0/1580281173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc0240ca8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0240cba00 tx=0x7fc01c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f59cf72251f076a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02159a700 1 -- 172.21.15.142:0/1580281173 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00e070 con 0x7fc024160c30 2023-05-21T16:53:55.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02159a700 1 -- 172.21.15.142:0/1580281173 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c00b9c0 con 0x7fc024160c30 2023-05-21T16:53:55.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02159a700 1 -- 172.21.15.142:0/1580281173 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00bd70 con 0x7fc024160c30 2023-05-21T16:53:55.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 -- 172.21.15.142:0/1580281173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 msgr2=0x7fc0240ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 --2- 172.21.15.142:0/1580281173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc0240ca8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0240cba00 tx=0x7fc01c00b330 comp rx=0 tx=0).stop 2023-05-21T16:53:55.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 -- 172.21.15.142:0/1580281173 shutdown_connections 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 --2- 172.21.15.142:0/1580281173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc0240ca8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 --2- 172.21.15.142:0/1580281173 >> v2:172.21.15.46:3300/0 conn(0x7fc0240cc9d0 0x7fc0240cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 -- 172.21.15.142:0/1580281173 >> 172.21.15.142:0/1580281173 conn(0x7fc02406d930 msgr2=0x7fc02406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 -- 172.21.15.142:0/1580281173 shutdown_connections 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 -- 172.21.15.142:0/1580281173 wait complete. 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 Processor -- start 2023-05-21T16:53:55.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.907+0000 7fc02359e700 1 -- start start 2023-05-21T16:53:55.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240cc9d0 0x7fc0240c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0240ccda0 0x7fc0241f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc02406ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c7900 con 0x7fc0240ccda0 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c3b10 con 0x7fc024160c30 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c6cf0 con 0x7fc0240cc9d0 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc022d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc02406ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240cc9d0 0x7fc0240c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc022d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc02406ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36782/0 (socket says 172.21.15.142:36782) 2023-05-21T16:53:55.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc022d9d700 1 -- 172.21.15.142:0/2175900550 learned_addr learned my addr 172.21.15.142:0/2175900550 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc021d9b700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0240ccda0 0x7fc0241f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 -- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 msgr2=0x7fc02406ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc02406ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 -- 172.21.15.142:0/2175900550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0240ccda0 msgr2=0x7fc0241f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0240ccda0 0x7fc0241f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 -- 172.21.15.142:0/2175900550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c009b30 con 0x7fc0240cc9d0 2023-05-21T16:53:55.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc022d9d700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc02406ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02259c700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240cc9d0 0x7fc0240c35d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc01400d5f0 tx=0x7fc01400d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140125f0 con 0x7fc0240cc9d0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014012750 con 0x7fc0240cc9d0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0241613a0 con 0x7fc0240cc9d0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014012b00 con 0x7fc0240cc9d0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0240ce900 con 0x7fc0240cc9d0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc014013480 con 0x7fc0240cc9d0 2023-05-21T16:53:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc014013c40 con 0x7fc0240cc9d0 2023-05-21T16:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.911+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0240cf360 con 0x7fc0240cc9d0 2023-05-21T16:53:55.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.915+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc0140137e0 con 0x7fc0240cc9d0 2023-05-21T16:53:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.987+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aef2c64a-58c5-4174-b23c-01559c32eca1", "id": 4} v 0) v1 -- 0x7fc024073cb0 con 0x7fc0240cc9d0 2023-05-21T16:53:56.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc012ffd700 1 -- 172.21.15.142:0/2175900550 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aef2c64a-58c5-4174-b23c-01559c32eca1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc014013a50 con 0x7fc0240cc9d0 2023-05-21T16:53:56.000 INFO:teuthology.orchestra.run.smithi142.stdout:4 2023-05-21T16:53:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240cc9d0 msgr2=0x7fc0240c35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240cc9d0 0x7fc0240c35d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc01400d5f0 tx=0x7fc01400d900 comp rx=0 tx=0).stop 2023-05-21T16:53:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 shutdown_connections 2023-05-21T16:53:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc024160c30 0x7fc02406ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0240ccda0 0x7fc0241f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 --2- 172.21.15.142:0/2175900550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0240cc9d0 0x7fc0240c35d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 >> 172.21.15.142:0/2175900550 conn(0x7fc02406d930 msgr2=0x7fc02415e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 shutdown_connections 2023-05-21T16:53:56.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:55.995+0000 7fc02359e700 1 -- 172.21.15.142:0/2175900550 wait complete. 2023-05-21T16:53:56.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 7feccbd7-5ab8-41f6-87ba-effa897b85e6 5 2023-05-21T16:53:56.086 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:56.083+0000 7fd6f32022c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-21T16:53:56.123 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:56.117+0000 7fe6aa29a2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-21T16:53:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 Processor -- start 2023-05-21T16:53:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 -- start start 2023-05-21T16:53:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6370156d40 0x7f637006b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 0x7f63700cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63700cbe30 0x7f63700b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700cc270 con 0x7f6370156d40 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6370157110 con 0x7f637006be60 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f6374fb2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637015da80 con 0x7f63700cbe30 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 0x7f63700cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63700cbe30 0x7f63700b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 0x7f63700cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36794/0 (socket says 172.21.15.142:36794) 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636effd700 1 -- 172.21.15.142:0/1808993507 learned_addr learned my addr 172.21.15.142:0/1808993507 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636f7fe700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.46:3300/0 conn(0x7f6370156d40 0x7f637006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636ffff700 1 -- 172.21.15.142:0/1808993507 >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 msgr2=0x7f63700cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636ffff700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 0x7f63700cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636ffff700 1 -- 172.21.15.142:0/1808993507 >> v2:172.21.15.46:3300/0 conn(0x7f6370156d40 msgr2=0x7f637006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636ffff700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.46:3300/0 conn(0x7f6370156d40 0x7f637006b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636ffff700 1 -- 172.21.15.142:0/1808993507 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700cae10 con 0x7f63700cbe30 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636f7fe700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.46:3300/0 conn(0x7f6370156d40 0x7f637006b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:53:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.119+0000 7f636effd700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 0x7f63700cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636ffff700 1 --2- 172.21.15.142:0/1808993507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63700cbe30 0x7f63700b1400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f63700b1fc0 tx=0x7f636800f650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4207d4a918173e2e server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636e7fc700 1 -- 172.21.15.142:0/1808993507 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368012070 con 0x7f63700cbe30 2023-05-21T16:53:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636e7fc700 1 -- 172.21.15.142:0/1808993507 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636800fe40 con 0x7f63700cbe30 2023-05-21T16:53:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636e7fc700 1 -- 172.21.15.142:0/1808993507 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800d310 con 0x7f63700cbe30 2023-05-21T16:53:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- 172.21.15.142:0/1808993507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63700cbe30 msgr2=0x7f63700b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- 172.21.15.142:0/1808993507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63700cbe30 0x7f63700b1400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f63700b1fc0 tx=0x7f636800f650 comp rx=0 tx=0).stop 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- 172.21.15.142:0/1808993507 shutdown_connections 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- 172.21.15.142:0/1808993507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63700cbe30 0x7f63700b1400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.142:3300/0 conn(0x7f637006be60 0x7f63700cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- 172.21.15.142:0/1808993507 >> v2:172.21.15.46:3300/0 conn(0x7f6370156d40 0x7f637006b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- 172.21.15.142:0/1808993507 >> 172.21.15.142:0/1808993507 conn(0x7f63700722d0 msgr2=0x7f63700cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- 172.21.15.142:0/1808993507 shutdown_connections 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- 172.21.15.142:0/1808993507 wait complete. 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 Processor -- start 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- start start 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637006be60 0x7f63700c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 0x7f63700b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6370156d40 0x7f637006c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700c6370 con 0x7f6370156d40 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63701f1a50 con 0x7f63700cbe30 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f6374fb2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63701f0e40 con 0x7f637006be60 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 0x7f63700b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 0x7f63700b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36804/0 (socket says 172.21.15.142:36804) 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636effd700 1 -- 172.21.15.142:0/368993875 learned_addr learned my addr 172.21.15.142:0/368993875 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637006be60 0x7f63700c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636ffff700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6370156d40 0x7f637006c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 -- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 msgr2=0x7f63700b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 0x7f63700b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 -- 172.21.15.142:0/368993875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6370156d40 msgr2=0x7f637006c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6370156d40 0x7f637006c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 -- 172.21.15.142:0/368993875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636400b620 con 0x7f637006be60 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636effd700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 0x7f63700b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.123+0000 7f636f7fe700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637006be60 0x7f63700c5e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f636000e840 tx=0x7f636000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000c070 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360004250 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63600036c0 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636800f050 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63700cb3d0 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6360003b20 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6360013b90 con 0x7f637006be60 2023-05-21T16:53:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63700cb0f0 con 0x7f637006be60 2023-05-21T16:53:56.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.127+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f636000f040 con 0x7f637006be60 2023-05-21T16:53:56.152 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:56.147+0000 7fd6f32022c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-21T16:53:56.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.203+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7feccbd7-5ab8-41f6-87ba-effa897b85e6", "id": 5} v 0) v1 -- 0x7f63700caae0 con 0x7f637006be60 2023-05-21T16:53:56.217 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:56.211+0000 7fd6f32022c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-21T16:53:56.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.211+0000 7f6357fff700 1 -- 172.21.15.142:0/368993875 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7feccbd7-5ab8-41f6-87ba-effa897b85e6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6360013410 con 0x7f637006be60 2023-05-21T16:53:56.218 INFO:teuthology.orchestra.run.smithi142.stdout:5 2023-05-21T16:53:56.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637006be60 msgr2=0x7f63700c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637006be60 0x7f63700c5e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f636000e840 tx=0x7f636000eb50 comp rx=0 tx=0).stop 2023-05-21T16:53:56.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 shutdown_connections 2023-05-21T16:53:56.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6370156d40 0x7f637006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63700cbe30 0x7f63700b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 --2- 172.21.15.142:0/368993875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637006be60 0x7f63700c5e30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 >> 172.21.15.142:0/368993875 conn(0x7f63700722d0 msgr2=0x7f637015cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 shutdown_connections 2023-05-21T16:53:56.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.215+0000 7f6374fb2700 1 -- 172.21.15.142:0/368993875 wait complete. 2023-05-21T16:53:56.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 36309035-87b5-43fb-a1e6-55cf9efbd98e 6 2023-05-21T16:53:56.299 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:56.293+0000 7fe6aa29a2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-21T16:53:56.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 Processor -- start 2023-05-21T16:53:56.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 -- start start 2023-05-21T16:53:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc92406ee70 0x7fc92406f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240ce380 con 0x7fc92415a5c0 2023-05-21T16:53:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92406f850 con 0x7fc92406ee70 2023-05-21T16:53:56.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240cb950 con 0x7fc9240cb4c0 2023-05-21T16:53:56.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc92259c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc92415a5c0 0x7fc9240cdc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34340/0 (socket says 172.21.15.142:34340) 2023-05-21T16:53:56.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc92259c700 1 -- 172.21.15.142:0/1256043360 learned_addr learned my addr 172.21.15.142:0/1256043360 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-05-21T16:53:56.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc91bfff700 1 --2- 172.21.15.142:0/1256043360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc922d9d700 1 --2- 172.21.15.142:0/1256043360 >> v2:172.21.15.46:3300/0 conn(0x7fc92406ee70 0x7fc92406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc921d9b700 1 -- 172.21.15.142:0/1256043360 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542659322 0 0) 0x7fc9240ce380 con 0x7fc92415a5c0 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc921d9b700 1 -- 172.21.15.142:0/1256043360 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9100035d0 con 0x7fc92415a5c0 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc91bfff700 1 -- 172.21.15.142:0/1256043360 >> v2:172.21.15.46:3300/0 conn(0x7fc92406ee70 msgr2=0x7fc92406f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc91bfff700 1 --2- 172.21.15.142:0/1256043360 >> v2:172.21.15.46:3300/0 conn(0x7fc92406ee70 0x7fc92406f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc91bfff700 1 -- 172.21.15.142:0/1256043360 >> v1:172.21.15.142:6789/0 conn(0x7fc92415a5c0 legacy=0x7fc9240cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc91bfff700 1 -- 172.21.15.142:0/1256043360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240ceb70 con 0x7fc9240cb4c0 2023-05-21T16:53:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc91bfff700 1 --2- 172.21.15.142:0/1256043360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240b3cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009850 tx=0x7fc90c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be23ae22b86f0f58 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc921d9b700 1 -- 172.21.15.142:0/1256043360 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011830 con 0x7fc9240cb4c0 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc921d9b700 1 -- 172.21.15.142:0/1256043360 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c011990 con 0x7fc9240cb4c0 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc921d9b700 1 -- 172.21.15.142:0/1256043360 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011d00 con 0x7fc9240cb4c0 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 -- 172.21.15.142:0/1256043360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 msgr2=0x7fc9240b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.339+0000 7fc928d1c700 1 --2- 172.21.15.142:0/1256043360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240b3cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009850 tx=0x7fc90c009b60 comp rx=0 tx=0).stop 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- 172.21.15.142:0/1256043360 shutdown_connections 2023-05-21T16:53:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 --2- 172.21.15.142:0/1256043360 >> v2:172.21.15.46:3300/0 conn(0x7fc92406ee70 0x7fc92406f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 --2- 172.21.15.142:0/1256043360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240b3cc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- 172.21.15.142:0/1256043360 >> 172.21.15.142:0/1256043360 conn(0x7fc9240b29c0 msgr2=0x7fc9240b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- 172.21.15.142:0/1256043360 shutdown_connections 2023-05-21T16:53:56.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- 172.21.15.142:0/1256043360 wait complete. 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 Processor -- start 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- start start 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 0x7fc9240c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc92415a5c0 0x7fc9240c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240caf80 con 0x7fc92415a5c0 2023-05-21T16:53:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240ca400 con 0x7fc92406ee70 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240ca6e0 con 0x7fc9240cb4c0 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 0x7fc9240c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:41040/0 (socket says 172.21.15.142:41040) 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 0x7fc9240c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36806/0 (socket says 172.21.15.142:36806) 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc91bfff700 1 -- 172.21.15.142:0/3080554248 learned_addr learned my addr 172.21.15.142:0/3080554248 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc922d9d700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc92415a5c0 0x7fc9240c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 -- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 msgr2=0x7fc9240c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 -- 172.21.15.142:0/3080554248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc92415a5c0 msgr2=0x7fc9240c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc92415a5c0 0x7fc9240c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 -- 172.21.15.142:0/3080554248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0094b0 con 0x7fc92406ee70 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc92259c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 0x7fc9240c4590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc91400c400 tx=0x7fc91400c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914005b60 con 0x7fc92406ee70 2023-05-21T16:53:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914005cc0 con 0x7fc92406ee70 2023-05-21T16:53:56.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914007310 con 0x7fc92406ee70 2023-05-21T16:53:56.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9240cf130 con 0x7fc92406ee70 2023-05-21T16:53:56.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.343+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240cee50 con 0x7fc92406ee70 2023-05-21T16:53:56.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.347+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc91401c440 con 0x7fc92406ee70 2023-05-21T16:53:56.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.347+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc9140077c0 con 0x7fc92406ee70 2023-05-21T16:53:56.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.347+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92415a990 con 0x7fc92406ee70 2023-05-21T16:53:56.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.347+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc914017070 con 0x7fc92406ee70 2023-05-21T16:53:56.369 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:56.365+0000 7fe6aa29a2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-21T16:53:56.425 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:56.421+0000 7fe6aa29a2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-21T16:53:56.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.419+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "36309035-87b5-43fb-a1e6-55cf9efbd98e", "id": 6} v 0) v1 -- 0x7fc924073cb0 con 0x7fc92406ee70 2023-05-21T16:53:56.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.427+0000 7fc91affd700 1 -- 172.21.15.142:0/3080554248 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36309035-87b5-43fb-a1e6-55cf9efbd98e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc91401c9f0 con 0x7fc92406ee70 2023-05-21T16:53:56.433 INFO:teuthology.orchestra.run.smithi142.stdout:6 2023-05-21T16:53:56.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 msgr2=0x7fc9240c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 0x7fc9240c4590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc91400c400 tx=0x7fc91400c710 comp rx=0 tx=0).stop 2023-05-21T16:53:56.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 shutdown_connections 2023-05-21T16:53:56.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc92415a5c0 0x7fc9240c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9240cb4c0 0x7fc9240c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 --2- 172.21.15.142:0/3080554248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc92406ee70 0x7fc9240c4590 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 >> 172.21.15.142:0/3080554248 conn(0x7fc9240b29c0 msgr2=0x7fc9240b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 shutdown_connections 2023-05-21T16:53:56.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.431+0000 7fc928d1c700 1 -- 172.21.15.142:0/3080554248 wait complete. 2023-05-21T16:53:56.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 47a415bd-8310-4b06-b089-df6f365f0ee5 7 2023-05-21T16:53:56.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.551+0000 7fadcb59e700 1 Processor -- start 2023-05-21T16:53:56.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.551+0000 7fadcb59e700 1 -- start start 2023-05-21T16:53:56.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadcc157470 0x7fadcc06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadcc15a8e0 0x7fadcc0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0cd670 con 0x7fadcc0b1a60 2023-05-21T16:53:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc0b1ee0 con 0x7fadcc157470 2023-05-21T16:53:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc06cb10 con 0x7fadcc15a8e0 2023-05-21T16:53:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadcc15a8e0 0x7fadcc0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadcc15a8e0 0x7fadcc0b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36810/0 (socket says 172.21.15.142:36810) 2023-05-21T16:53:56.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 -- 172.21.15.142:0/1380669603 learned_addr learned my addr 172.21.15.142:0/1380669603 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadca59c700 1 --2- 172.21.15.142:0/1380669603 >> v2:172.21.15.46:3300/0 conn(0x7fadcc157470 0x7fadcc06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 -- 172.21.15.142:0/1380669603 >> v2:172.21.15.46:3300/0 conn(0x7fadcc157470 msgr2=0x7fadcc06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 --2- 172.21.15.142:0/1380669603 >> v2:172.21.15.46:3300/0 conn(0x7fadcc157470 0x7fadcc06c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 -- 172.21.15.142:0/1380669603 >> v1:172.21.15.46:6789/0 conn(0x7fadcc0b1a60 legacy=0x7fadcc15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 -- 172.21.15.142:0/1380669603 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc06cdf0 con 0x7fadcc15a8e0 2023-05-21T16:53:56.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc9d9b700 1 --2- 172.21.15.142:0/1380669603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc15a8e0 0x7fadcc0b1520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0ca8e0 tx=0x7fadc000be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe9fa0d2c9744d4f server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc959a700 1 -- 172.21.15.142:0/1380669603 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000dd50 con 0x7fadcc15a8e0 2023-05-21T16:53:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc959a700 1 -- 172.21.15.142:0/1380669603 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0004030 con 0x7fadcc15a8e0 2023-05-21T16:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadc959a700 1 -- 172.21.15.142:0/1380669603 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00043c0 con 0x7fadcc15a8e0 2023-05-21T16:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- 172.21.15.142:0/1380669603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc15a8e0 msgr2=0x7fadcc0b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 --2- 172.21.15.142:0/1380669603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc15a8e0 0x7fadcc0b1520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0ca8e0 tx=0x7fadc000be90 comp rx=0 tx=0).stop 2023-05-21T16:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- 172.21.15.142:0/1380669603 shutdown_connections 2023-05-21T16:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 --2- 172.21.15.142:0/1380669603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc15a8e0 0x7fadcc0b1520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 --2- 172.21.15.142:0/1380669603 >> v2:172.21.15.46:3300/0 conn(0x7fadcc157470 0x7fadcc06c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- 172.21.15.142:0/1380669603 >> 172.21.15.142:0/1380669603 conn(0x7fadcc06d930 msgr2=0x7fadcc06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- 172.21.15.142:0/1380669603 shutdown_connections 2023-05-21T16:53:56.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.555+0000 7fadcb59e700 1 -- 172.21.15.142:0/1380669603 wait complete. 2023-05-21T16:53:56.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 Processor -- start 2023-05-21T16:53:56.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- start start 2023-05-21T16:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadcc0b1a60 0x7fadcc1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 0x7fadcc0adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadcc15a8e0 0x7fadcc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc15b450 con 0x7fadcc0b1a60 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0b0ad0 con 0x7fadcc157470 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0b0db0 con 0x7fadcc15a8e0 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 0x7fadcc0adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 0x7fadcc0adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36816/0 (socket says 172.21.15.142:36816) 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 -- 172.21.15.142:0/3668960725 learned_addr learned my addr 172.21.15.142:0/3668960725 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcad9d700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadcc15a8e0 0x7fadcc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadca59c700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadcc0b1a60 0x7fadcc1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 -- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadcc15a8e0 msgr2=0x7fadcc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadcc15a8e0 0x7fadcc0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 -- 172.21.15.142:0/3668960725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadcc0b1a60 msgr2=0x7fadcc1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadcc0b1a60 0x7fadcc1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 -- 172.21.15.142:0/3668960725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc000b810 con 0x7fadcc157470 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcad9d700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadcc15a8e0 0x7fadcc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadca59c700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadcc0b1a60 0x7fadcc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:53:56.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadc9d9b700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 0x7fadcc0adb80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadc0004000 tx=0x7fadc0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003d00 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0003e60 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0010690 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc0cd8c0 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc06d0d0 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fadc0010af0 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fadc0019a50 con 0x7fadcc157470 2023-05-21T16:53:56.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.559+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc06c800 con 0x7fadcc157470 2023-05-21T16:53:56.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.563+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fadc0023440 con 0x7fadcc157470 2023-05-21T16:53:56.635 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:56.631+0000 7fd6f32022c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-21T16:53:56.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.639+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47a415bd-8310-4b06-b089-df6f365f0ee5", "id": 7} v 0) v1 -- 0x7fadcc073cb0 con 0x7fadcc157470 2023-05-21T16:53:56.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.647+0000 7fadbaffd700 1 -- 172.21.15.142:0/3668960725 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47a415bd-8310-4b06-b089-df6f365f0ee5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fadc00310b0 con 0x7fadcc157470 2023-05-21T16:53:56.653 INFO:teuthology.orchestra.run.smithi142.stdout:7 2023-05-21T16:53:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 msgr2=0x7fadcc0adb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 0x7fadcc0adb80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadc0004000 tx=0x7fadc0004770 comp rx=0 tx=0).stop 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 shutdown_connections 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadcc15a8e0 0x7fadcc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadcc157470 0x7fadcc0adb80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 --2- 172.21.15.142:0/3668960725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadcc0b1a60 0x7fadcc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 >> 172.21.15.142:0/3668960725 conn(0x7fadcc06d930 msgr2=0x7fadcc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 shutdown_connections 2023-05-21T16:53:56.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-05-21T16:53:56.651+0000 7fadcb59e700 1 -- 172.21.15.142:0/3668960725 wait complete. 2023-05-21T16:53:56.671 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-21T16:53:56.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-21T16:53:56.674 INFO:tasks.ceph.osd.0:Started 2023-05-21T16:53:56.675 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-21T16:53:56.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-21T16:53:56.677 INFO:tasks.ceph.osd.1:Started 2023-05-21T16:53:56.678 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-21T16:53:56.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-21T16:53:56.680 INFO:tasks.ceph.osd.2:Started 2023-05-21T16:53:56.680 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-21T16:53:56.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-21T16:53:56.683 INFO:tasks.ceph.osd.3:Started 2023-05-21T16:53:56.683 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-21T16:53:56.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-21T16:53:56.685 INFO:tasks.ceph.osd.4:Started 2023-05-21T16:53:56.686 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-21T16:53:56.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-21T16:53:56.687 INFO:tasks.ceph.osd.5:Started 2023-05-21T16:53:56.688 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-21T16:53:56.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-21T16:53:56.689 INFO:tasks.ceph.osd.6:Started 2023-05-21T16:53:56.690 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-21T16:53:56.690 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-21T16:53:56.692 INFO:tasks.ceph.osd.7:Started 2023-05-21T16:53:56.693 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:53:56.777 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:56.771+0000 7fd6f32022c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-21T16:53:56.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 Processor -- start 2023-05-21T16:53:56.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 -- start start 2023-05-21T16:53:56.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4680cb2d0 0x7fd468159940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd468071860 0x7fd46815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4680ca9c0 con 0x7fd4680ce950 2023-05-21T16:53:56.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd468159e80 con 0x7fd468071860 2023-05-21T16:53:56.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd46ecef700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd468071860 0x7fd46815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd470752700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4680c9e40 con 0x7fd4680cb2d0 2023-05-21T16:53:56.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd46ecef700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd468071860 0x7fd46815d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50556/0 (socket says 172.21.15.46:50556) 2023-05-21T16:53:56.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd46ecef700 1 -- 172.21.15.46:0/3388331761 learned_addr learned my addr 172.21.15.46:0/3388331761 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:53:56.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.817+0000 7fd46e4ee700 1 --2- 172.21.15.46:0/3388331761 >> v2:172.21.15.142:3300/0 conn(0x7fd4680cb2d0 0x7fd468159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46ecef700 1 -- 172.21.15.46:0/3388331761 >> v2:172.21.15.142:3300/0 conn(0x7fd4680cb2d0 msgr2=0x7fd468159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46ecef700 1 --2- 172.21.15.46:0/3388331761 >> v2:172.21.15.142:3300/0 conn(0x7fd4680cb2d0 0x7fd468159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46ecef700 1 -- 172.21.15.46:0/3388331761 >> v1:172.21.15.142:6789/0 conn(0x7fd4680ce950 legacy=0x7fd468071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46ecef700 1 -- 172.21.15.46:0/3388331761 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680ca120 con 0x7fd468071860 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46ecef700 1 --2- 172.21.15.46:0/3388331761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd468071860 0x7fd46815d280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd46806e350 tx=0x7fd46000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ce16e2fb4c1de7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46d4ec700 1 -- 172.21.15.46:0/3388331761 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000e070 con 0x7fd468071860 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46d4ec700 1 -- 172.21.15.46:0/3388331761 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000b910 con 0x7fd468071860 2023-05-21T16:53:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd46d4ec700 1 -- 172.21.15.46:0/3388331761 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000bcc0 con 0x7fd468071860 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 -- 172.21.15.46:0/3388331761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd468071860 msgr2=0x7fd46815d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 --2- 172.21.15.46:0/3388331761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd468071860 0x7fd46815d280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd46806e350 tx=0x7fd46000b330 comp rx=0 tx=0).stop 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 -- 172.21.15.46:0/3388331761 shutdown_connections 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 --2- 172.21.15.46:0/3388331761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd468071860 0x7fd46815d280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 --2- 172.21.15.46:0/3388331761 >> v2:172.21.15.142:3300/0 conn(0x7fd4680cb2d0 0x7fd468159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 -- 172.21.15.46:0/3388331761 >> 172.21.15.46:0/3388331761 conn(0x7fd4680cf430 msgr2=0x7fd4680cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 -- 172.21.15.46:0/3388331761 shutdown_connections 2023-05-21T16:53:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.821+0000 7fd470752700 1 -- 172.21.15.46:0/3388331761 wait complete. 2023-05-21T16:53:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 Processor -- start 2023-05-21T16:53:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 -- start start 2023-05-21T16:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd468071860 0x7fd4681ee720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 0x7fd4680b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4680ce950 0x7fd4680c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680b4e60 con 0x7fd4680cb2d0 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681504d0 con 0x7fd4680ce950 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680b45c0 con 0x7fd468071860 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 0x7fd4680b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 0x7fd4680b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50560/0 (socket says 172.21.15.46:50560) 2023-05-21T16:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 -- 172.21.15.46:0/1374366972 learned_addr learned my addr 172.21.15.46:0/1374366972 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46ecef700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4680ce950 0x7fd4680c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46e4ee700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd468071860 0x7fd4681ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 -- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd468071860 msgr2=0x7fd4681ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd468071860 0x7fd4681ee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 -- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4680ce950 msgr2=0x7fd4680c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4680ce950 0x7fd4680c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 -- 172.21.15.46:0/1374366972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009b30 con 0x7fd4680cb2d0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd46dced700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 0x7fd4680b3cc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c500 tx=0x7fd45800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580052d0 con 0x7fd4680cb2d0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458005430 con 0x7fd4680cb2d0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4680ca6e0 con 0x7fd4680cb2d0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580055a0 con 0x7fd4680cb2d0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.825+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4680ca400 con 0x7fd4680cb2d0 2023-05-21T16:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.829+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd458003be0 con 0x7fd4680cb2d0 2023-05-21T16:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.829+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd458011d60 con 0x7fd4680cb2d0 2023-05-21T16:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.829+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4680cb6a0 con 0x7fd4680cb2d0 2023-05-21T16:53:56.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.833+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd458017070 con 0x7fd4680cb2d0 2023-05-21T16:53:56.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd468073cb0 con 0x7fd4680cb2d0 2023-05-21T16:53:56.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd45effd700 1 -- 172.21.15.46:0/1374366972 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd458011590 con 0x7fd4680cb2d0 2023-05-21T16:53:56.910 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:53:56.910 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:53:56.647177+0000","last_up_change":"0.000000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:53:56.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 msgr2=0x7fd4680b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:56.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 0x7fd4680b3cc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c500 tx=0x7fd45800c810 comp rx=0 tx=0).stop 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 shutdown_connections 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4680ce950 0x7fd4680c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4680cb2d0 0x7fd4680b3cc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 --2- 172.21.15.46:0/1374366972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd468071860 0x7fd4681ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 >> 172.21.15.46:0/1374366972 conn(0x7fd4680cf430 msgr2=0x7fd4680b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 shutdown_connections 2023-05-21T16:53:56.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:53:56.905+0000 7fd470752700 1 -- 172.21.15.46:0/1374366972 wait complete. 2023-05-21T16:53:56.923 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-21T16:53:56.923 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-21T16:53:57.048 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T16:53:57.043+0000 7f91b5d6f700 -1 Falling back to public interface 2023-05-21T16:53:57.057 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T16:53:57.053+0000 7f0f91cef700 -1 Falling back to public interface 2023-05-21T16:53:57.081 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T16:53:57.077+0000 7f9992537700 -1 Falling back to public interface 2023-05-21T16:53:57.094 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:57.091+0000 7fd6f32022c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-21T16:53:57.276 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:57.271+0000 7fd6f32022c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-21T16:53:57.317 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T16:53:57.313+0000 7f83f2e98700 -1 Falling back to public interface 2023-05-21T16:53:57.329 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:57.325+0000 7fe6aa29a2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-21T16:53:57.331 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T16:53:57.327+0000 7f256ff96700 -1 Falling back to public interface 2023-05-21T16:53:57.331 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T16:53:57.327+0000 7f2c93e61700 -1 Falling back to public interface 2023-05-21T16:53:57.337 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T16:53:57.333+0000 7f4f6dc38700 -1 Falling back to public interface 2023-05-21T16:53:57.344 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T16:53:57.339+0000 7f39e9d4d700 -1 Falling back to public interface 2023-05-21T16:53:57.351 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:57.347+0000 7fd6f32022c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-21T16:53:57.400 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:57.397+0000 7fe6aa29a2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-21T16:53:57.411 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:57.407+0000 7fd6f32022c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-21T16:53:57.566 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:57.561+0000 7fe6aa29a2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-21T16:53:57.631 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:57.625+0000 7fe6aa29a2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-21T16:53:57.706 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:57.701+0000 7fe6aa29a2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-21T16:53:57.729 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-21T16:53:57.830 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 Processor -- start 2023-05-21T16:53:57.830 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 -- start start 2023-05-21T16:53:57.831 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa18006d730 0x7fa180160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa18015c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1800b1530 con 0x7fa1800cf340 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1800b1810 con 0x7fa18006d730 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa186416700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1800b1af0 con 0x7fa1800cd680 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa18006d730 0x7fa180160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa18006d730 0x7fa180160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50576/0 (socket says 172.21.15.46:50576) 2023-05-21T16:53:57.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 -- 172.21.15.46:0/561106810 learned_addr learned my addr 172.21.15.46:0/561106810 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:53:57.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 -- 172.21.15.46:0/561106810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 msgr2=0x7fa18015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:53:57.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185c15700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa18015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:57.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa18015c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 -- 172.21.15.46:0/561106810 >> v1:172.21.15.46:6789/0 conn(0x7fa1800cf340 legacy=0x7fa18006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:57.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185414700 1 -- 172.21.15.46:0/561106810 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800b1dd0 con 0x7fa18006d730 2023-05-21T16:53:57.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.825+0000 7fa185c15700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa18015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:53:57.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa185414700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa180160a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009910 tx=0x7fa17c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fe11d272913f34 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:57.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa177fff700 1 -- 172.21.15.46:0/561106810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00ba60 con 0x7fa18006d730 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa177fff700 1 -- 172.21.15.46:0/561106810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00bbc0 con 0x7fa18006d730 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa177fff700 1 -- 172.21.15.46:0/561106810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c009e60 con 0x7fa18006d730 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 -- 172.21.15.46:0/561106810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 msgr2=0x7fa180160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa180160a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009910 tx=0x7fa17c009c20 comp rx=0 tx=0).stop 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 -- 172.21.15.46:0/561106810 shutdown_connections 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa18015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 --2- 172.21.15.46:0/561106810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa180160a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 -- 172.21.15.46:0/561106810 >> 172.21.15.46:0/561106810 conn(0x7fa180069f20 msgr2=0x7fa18006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:57.836 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 -- 172.21.15.46:0/561106810 shutdown_connections 2023-05-21T16:53:57.836 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.829+0000 7fa186416700 1 -- 172.21.15.46:0/561106810 wait complete. 2023-05-21T16:53:57.836 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 Processor -- start 2023-05-21T16:53:57.836 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- start start 2023-05-21T16:53:57.839 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa1800ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:57.839 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa1800c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:57.839 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1800cf340 0x7fa1800ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:53:57.839 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1801f30a0 con 0x7fa18006d730 2023-05-21T16:53:57.839 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1801f2dc0 con 0x7fa1800cf340 2023-05-21T16:53:57.839 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1800aba00 con 0x7fa1800cd680 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa1800ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa1800ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50578/0 (socket says 172.21.15.46:50578) 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 -- 172.21.15.46:0/2529415083 learned_addr learned my addr 172.21.15.46:0/2529415083 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185c15700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1800cf340 0x7fa1800ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa184c13700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa1800c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 -- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 msgr2=0x7fa1800c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:57.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa1800c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 -- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1800cf340 msgr2=0x7fa1800ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1800cf340 0x7fa1800ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 -- 172.21.15.46:0/2529415083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c009570 con 0x7fa18006d730 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa185414700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa1800ac4e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17c014040 tx=0x7fa17c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0036c0 con 0x7fa18006d730 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c01e070 con 0x7fa18006d730 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c003a80 con 0x7fa18006d730 2023-05-21T16:53:57.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1800cdae0 con 0x7fa18006d730 2023-05-21T16:53:57.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1800b20b0 con 0x7fa18006d730 2023-05-21T16:53:57.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa17c025480 con 0x7fa18006d730 2023-05-21T16:53:57.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa17c020070 con 0x7fa18006d730 2023-05-21T16:53:57.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.833+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1800cdc70 con 0x7fa18006d730 2023-05-21T16:53:57.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.837+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fa17c02a020 con 0x7fa18006d730 2023-05-21T16:53:57.880 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:57.873+0000 7fe6aa29a2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-21T16:53:57.907 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.901+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1800cce40 con 0x7fa18006d730 2023-05-21T16:53:57.908 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa175ffb700 1 -- 172.21.15.46:0/2529415083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa17c015020 con 0x7fa18006d730 2023-05-21T16:53:57.908 INFO:teuthology.misc.health.smithi046.stdout: 2023-05-21T16:53:57.908 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:53:56.647177+0000","last_up_change":"0.000000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:53:57.909 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 msgr2=0x7fa1800ac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:53:57.909 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa1800ac4e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa17c014040 tx=0x7fa17c004770 comp rx=0 tx=0).stop 2023-05-21T16:53:57.909 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 shutdown_connections 2023-05-21T16:53:57.910 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1800cf340 0x7fa1800ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.910 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1800cd680 0x7fa1800c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.910 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 --2- 172.21.15.46:0/2529415083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18006d730 0x7fa1800ac4e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:53:57.910 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 >> 172.21.15.46:0/2529415083 conn(0x7fa180069f20 msgr2=0x7fa1800b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:53:57.910 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 shutdown_connections 2023-05-21T16:53:57.910 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:53:57.905+0000 7fa186416700 1 -- 172.21.15.46:0/2529415083 wait complete. 2023-05-21T16:53:57.919 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-21T16:53:58.085 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:58.081+0000 7fe6aa29a2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-21T16:53:58.284 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:58.279+0000 7fd6f32022c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-21T16:53:58.352 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:58.347+0000 7fd6f32022c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-21T16:53:58.514 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:58.507+0000 7fd6f32022c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-21T16:53:58.579 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:58.575+0000 7fd6f32022c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-21T16:53:58.654 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:58.647+0000 7fd6f32022c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-21T16:53:58.747 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:58.741+0000 7fe6aa29a2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-21T16:53:58.836 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:58.831+0000 7fd6f32022c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-21T16:53:59.062 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:59.055+0000 7fd6f32022c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-21T16:53:59.719 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-21T16:53:59.715+0000 7fd6f32022c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-21T16:53:59.791 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:59.785+0000 7fe69151f700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-21T16:53:59.792 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-21T16:53:59.789+0000 7fe69151f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-21T16:54:00.745 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T16:54:00.739+0000 7f39e9d4d700 -1 osd.5 0 log_to_monitors true 2023-05-21T16:54:00.911 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T16:54:00.907+0000 7f91b5d6f700 -1 osd.7 0 log_to_monitors true 2023-05-21T16:54:00.997 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T16:54:00.993+0000 7f0f91cef700 -1 osd.2 0 log_to_monitors true 2023-05-21T16:54:01.000 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T16:54:00.997+0000 7f9992537700 -1 osd.1 0 log_to_monitors true 2023-05-21T16:54:01.021 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T16:54:01.015+0000 7f256ff96700 -1 osd.4 0 log_to_monitors true 2023-05-21T16:54:01.171 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T16:54:01.167+0000 7f2c93e61700 -1 osd.6 0 log_to_monitors true 2023-05-21T16:54:01.211 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T16:54:01.205+0000 7f83f2e98700 -1 osd.0 0 log_to_monitors true 2023-05-21T16:54:01.214 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T16:54:01.209+0000 7f4f6dc38700 -1 osd.3 0 log_to_monitors true 2023-05-21T16:54:04.370 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T16:54:04.365+0000 7f0f8d30b700 -1 osd.2 0 waiting for initial osdmap 2023-05-21T16:54:04.375 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T16:54:04.369+0000 7f0f855e0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:04.382 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T16:54:04.377+0000 7f998f4fe700 -1 osd.1 0 waiting for initial osdmap 2023-05-21T16:54:04.389 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T16:54:04.385+0000 7f9985e28700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:04.394 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T16:54:04.389+0000 7f83ee4b4700 -1 osd.0 0 waiting for initial osdmap 2023-05-21T16:54:04.401 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T16:54:04.397+0000 7f83e6789700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:04.451 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T16:54:04.445+0000 7f4f69254700 -1 osd.3 0 waiting for initial osdmap 2023-05-21T16:54:04.456 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T16:54:04.453+0000 7f4f61529700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:04.725 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:04.831 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.825+0000 7f7f7cc8a700 1 Processor -- start 2023-05-21T16:54:04.832 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.825+0000 7f7f7cc8a700 1 -- start start 2023-05-21T16:54:04.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f700dd280 0x7f7f70050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:04.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f700dfb70 0x7f7f70036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:04.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f70052bf0 con 0x7f7f70036cb0 2023-05-21T16:54:04.833 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700dd650 con 0x7f7f700dd280 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f70037130 con 0x7f7f700dfb70 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f77fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7f70036cb0 0x7f7f700e3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33658/0 (socket says 172.21.15.46:33658) 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f77fff700 1 -- 172.21.15.46:0/4251122283 learned_addr learned my addr 172.21.15.46:0/4251122283 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f777fe700 1 --2- 172.21.15.46:0/4251122283 >> v2:172.21.15.46:3300/0 conn(0x7f7f700dd280 0x7f7f70050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f76ffd700 1 --2- 172.21.15.46:0/4251122283 >> v2:172.21.15.142:3300/0 conn(0x7f7f700dfb70 0x7f7f70036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f767fc700 1 -- 172.21.15.46:0/4251122283 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858180023 0 0) 0x7f7f70052bf0 con 0x7f7f70036cb0 2023-05-21T16:54:04.834 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f767fc700 1 -- 172.21.15.46:0/4251122283 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f600035d0 con 0x7f7f70036cb0 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f76ffd700 1 -- 172.21.15.46:0/4251122283 >> v2:172.21.15.46:3300/0 conn(0x7f7f700dd280 msgr2=0x7f7f70050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f76ffd700 1 --2- 172.21.15.46:0/4251122283 >> v2:172.21.15.46:3300/0 conn(0x7f7f700dd280 0x7f7f70050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f76ffd700 1 -- 172.21.15.46:0/4251122283 >> v1:172.21.15.46:6789/0 conn(0x7f7f70036cb0 legacy=0x7f7f700e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f76ffd700 1 -- 172.21.15.46:0/4251122283 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700528c0 con 0x7f7f700dfb70 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f76ffd700 1 --2- 172.21.15.46:0/4251122283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700dfb70 0x7f7f70036770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000e190 tx=0x7f7f68009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=759598f48a851508 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f767fc700 1 -- 172.21.15.46:0/4251122283 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011830 con 0x7f7f700dfb70 2023-05-21T16:54:04.835 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f767fc700 1 -- 172.21.15.46:0/4251122283 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68011990 con 0x7f7f700dfb70 2023-05-21T16:54:04.836 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f767fc700 1 -- 172.21.15.46:0/4251122283 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011d20 con 0x7f7f700dfb70 2023-05-21T16:54:04.836 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/4251122283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700dfb70 msgr2=0x7f7f70036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/4251122283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700dfb70 0x7f7f70036770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000e190 tx=0x7f7f68009b30 comp rx=0 tx=0).stop 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/4251122283 shutdown_connections 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/4251122283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f700dfb70 0x7f7f70036770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/4251122283 >> v2:172.21.15.46:3300/0 conn(0x7f7f700dd280 0x7f7f70050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/4251122283 >> 172.21.15.46:0/4251122283 conn(0x7f7f70051770 msgr2=0x7f7f70051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/4251122283 shutdown_connections 2023-05-21T16:54:04.837 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.829+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/4251122283 wait complete. 2023-05-21T16:54:04.838 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 Processor -- start 2023-05-21T16:54:04.838 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 -- start start 2023-05-21T16:54:04.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f70036cb0 0x7f7f7004e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:04.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 0x7f7f70038830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:04.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f700dfb70 0x7f7f7003a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:04.840 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7004df20 con 0x7f7f700dfb70 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7003aa90 con 0x7f7f70036cb0 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f7cc8a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70038d70 con 0x7f7f700dd280 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f76ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 0x7f7f70038830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f700dfb70 0x7f7f7003a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.833+0000 7f7f76ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 0x7f7f70038830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:58404/0 (socket says 172.21.15.46:58404) 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 -- 172.21.15.46:0/2774243172 learned_addr learned my addr 172.21.15.46:0/2774243172 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:04.841 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f777fe700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f70036cb0 0x7f7f7004e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 -- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f70036cb0 msgr2=0x7f7f7004e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f70036cb0 0x7f7f7004e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 -- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f700dfb70 msgr2=0x7f7f7003a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f700dfb70 0x7f7f7003a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 -- 172.21.15.46:0/2774243172 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680094b0 con 0x7f7f700dd280 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f777fe700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f70036cb0 0x7f7f7004e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:04.842 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f77fff700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f700dfb70 0x7f7f7003a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:04.843 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f76ffd700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 0x7f7f70038830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f68014040 tx=0x7f7f68004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:04.843 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68004510 con 0x7f7f700dd280 2023-05-21T16:54:04.844 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6801e070 con 0x7f7f700dd280 2023-05-21T16:54:04.844 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700e0710 con 0x7f7f700dd280 2023-05-21T16:54:04.844 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68003900 con 0x7f7f700dd280 2023-05-21T16:54:04.844 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f700e0430 con 0x7f7f700dd280 2023-05-21T16:54:04.844 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.837+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f700e09f0 con 0x7f7f700dd280 2023-05-21T16:54:04.845 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.841+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f7f68003a60 con 0x7f7f700dd280 2023-05-21T16:54:04.845 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.841+0000 7f7f5ffff700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f64066260 0x7f7f64068710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:04.845 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.841+0000 7f7f777fe700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f64066260 0x7f7f64068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:04.845 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.841+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f7f68083d30 con 0x7f7f700dd280 2023-05-21T16:54:04.845 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.841+0000 7f7f777fe700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f64066260 0x7f7f64068710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0112c0 tx=0x7f7f6c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:04.849 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:04.845+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7f68052170 con 0x7f7f700dd280 2023-05-21T16:54:05.010 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.005+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f700e2c10 con 0x7f7f700dd280 2023-05-21T16:54:05.011 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.005+0000 7f7f5ffff700 1 -- 172.21.15.46:0/2774243172 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7f68015090 con 0x7f7f700dd280 2023-05-21T16:54:05.012 INFO:teuthology.misc.health.smithi046.stdout: 2023-05-21T16:54:05.012 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":12,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:02.714785+0000","last_up_change":"0.000000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:05.016 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f64066260 msgr2=0x7f7f64068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:05.016 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f64066260 0x7f7f64068710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0112c0 tx=0x7f7f6c009240 comp rx=0 tx=0).stop 2023-05-21T16:54:05.016 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 msgr2=0x7f7f70038830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:05.016 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 0x7f7f70038830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f68014040 tx=0x7f7f68004770 comp rx=0 tx=0).stop 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 shutdown_connections 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f64066260 0x7f7f64068710 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f700dfb70 0x7f7f7003a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f700dd280 0x7f7f70038830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 --2- 172.21.15.46:0/2774243172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f70036cb0 0x7f7f7004e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 >> 172.21.15.46:0/2774243172 conn(0x7f7f70051770 msgr2=0x7f7f700de1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:05.017 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 shutdown_connections 2023-05-21T16:54:05.018 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:05.013+0000 7f7f7cc8a700 1 -- 172.21.15.46:0/2774243172 wait complete. 2023-05-21T16:54:05.029 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-21T16:54:05.059 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T16:54:05.058+0000 7f39e6d14700 -1 osd.5 0 waiting for initial osdmap 2023-05-21T16:54:05.064 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T16:54:05.062+0000 7f39dd63e700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:05.064 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T16:54:05.062+0000 7f2c90e28700 -1 osd.6 0 waiting for initial osdmap 2023-05-21T16:54:05.072 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T16:54:05.070+0000 7f91b138b700 -1 osd.7 0 waiting for initial osdmap 2023-05-21T16:54:05.072 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T16:54:05.070+0000 7f2c87752700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:05.080 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T16:54:05.078+0000 7f91a9660700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:05.085 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T16:54:05.082+0000 7f256cf5d700 -1 osd.4 0 waiting for initial osdmap 2023-05-21T16:54:05.089 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T16:54:05.086+0000 7f2563887700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-21T16:54:11.835 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:11.945 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0febfff700 1 Processor -- start 2023-05-21T16:54:11.945 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0febfff700 1 -- start start 2023-05-21T16:54:11.947 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0febfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 0x7f0fec0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.947 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0febfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec0cb590 con 0x7f0fec15da40 2023-05-21T16:54:11.947 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0febfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec070110 con 0x7f0fec069f20 2023-05-21T16:54:11.948 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0febfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0c9c90 con 0x7f0fec0b1340 2023-05-21T16:54:11.948 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0feaffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0fec15da40 0x7f0fec0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33662/0 (socket says 172.21.15.46:33662) 2023-05-21T16:54:11.948 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0feaffd700 1 -- 172.21.15.46:0/1508341626 learned_addr learned my addr 172.21.15.46:0/1508341626 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:11.950 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.941+0000 7f0feb7fe700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 0x7f0fec0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.950 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917418980 0 0) 0x7f0fec0cb590 con 0x7f0fec15da40 2023-05-21T16:54:11.950 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd40035d0 con 0x7f0fec15da40 2023-05-21T16:54:11.950 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 752073755 0 0) 0x7f0fd40035d0 con 0x7f0fec15da40 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 msgr2=0x7f0fec0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 0x7f0fec0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 >> v1:172.21.15.142:6789/0 conn(0x7f0fec069f20 legacy=0x7f0fec06ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec06a3b0 con 0x7f0fec15da40 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f0fdc001690 con 0x7f0fec15da40 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 >> v1:172.21.15.46:6789/0 conn(0x7f0fec15da40 legacy=0x7f0fec0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fd4003a50 0x7f0fd4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.951 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 0x7f0fd4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.952 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4004db0 0x7f0fd4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.952 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd400ba30 con 0x7f0fd4003a50 2023-05-21T16:54:11.952 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd400bb70 con 0x7f0fd4004db0 2023-05-21T16:54:11.952 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd400bd00 con 0x7f0fec0b1340 2023-05-21T16:54:11.952 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fd4003a50 0x7f0fd4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.952 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fea7fc700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 0x7f0fd4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.953 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feb7fe700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4004db0 0x7f0fd4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.953 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 -- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 msgr2=0x7f0fd4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:11.953 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0b1340 0x7f0fd4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 -- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4004db0 msgr2=0x7f0fd4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4004db0 0x7f0fd4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 -- 172.21.15.46:0/1508341626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40035d0 con 0x7f0fd4003a50 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fd4003a50 0x7f0fd4003e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0703f0 tx=0x7f0fd40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed97e8ecea1e615b server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc013070 con 0x7f0fd4003a50 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc00e110 con 0x7f0fd4003a50 2023-05-21T16:54:11.954 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0fe9ffb700 1 -- 172.21.15.46:0/1508341626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc005bc0 con 0x7f0fd4003a50 2023-05-21T16:54:11.955 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0febfff700 1 -- 172.21.15.46:0/1508341626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fd4003a50 msgr2=0x7f0fd4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:11.955 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0febfff700 1 --2- 172.21.15.46:0/1508341626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fd4003a50 0x7f0fd4003e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0703f0 tx=0x7f0fd40058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0feb7fe700 1 -- 172.21.15.46:0/1508341626 reap_dead start 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0febfff700 1 -- 172.21.15.46:0/1508341626 shutdown_connections 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0febfff700 1 -- 172.21.15.46:0/1508341626 >> 172.21.15.46:0/1508341626 conn(0x7f0fec0cbc30 msgr2=0x7f0fec0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0febfff700 1 -- 172.21.15.46:0/1508341626 shutdown_connections 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.945+0000 7f0febfff700 1 -- 172.21.15.46:0/1508341626 wait complete. 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.949+0000 7f0febfff700 1 Processor -- start 2023-05-21T16:54:11.956 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.949+0000 7f0febfff700 1 -- start start 2023-05-21T16:54:11.958 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4003a50 0x7f0fec0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.958 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 0x7f0fec0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.958 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0c65b0 0x7f0fec0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.958 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0b2790 con 0x7f0fec0c81f0 2023-05-21T16:54:11.958 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec1ed5d0 con 0x7f0fd4003a50 2023-05-21T16:54:11.959 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0c8ba0 con 0x7f0fec0c65b0 2023-05-21T16:54:11.959 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 0x7f0fec0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.959 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 0x7f0fec0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50754/0 (socket says 172.21.15.46:50754) 2023-05-21T16:54:11.959 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 -- 172.21.15.46:0/1059702461 learned_addr learned my addr 172.21.15.46:0/1059702461 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:11.959 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4003a50 0x7f0fec0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.959 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0feb7fe700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0c65b0 0x7f0fec0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 -- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0c65b0 msgr2=0x7f0fec0c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0c65b0 0x7f0fec0c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 -- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4003a50 msgr2=0x7f0fec0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4003a50 0x7f0fec0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 -- 172.21.15.46:0/1059702461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec06a970 con 0x7f0fec0c81f0 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fea7fc700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 0x7f0fec0c8660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000f860 tx=0x7f0fe000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:11.960 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00052e0 con 0x7f0fec0c81f0 2023-05-21T16:54:11.961 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0005460 con 0x7f0fec0c81f0 2023-05-21T16:54:11.961 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00038e0 con 0x7f0fec0c81f0 2023-05-21T16:54:11.961 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec06a690 con 0x7f0fec0c81f0 2023-05-21T16:54:11.961 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec06ac50 con 0x7f0fec0c81f0 2023-05-21T16:54:11.962 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.953+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec0b28d0 con 0x7f0fec0c81f0 2023-05-21T16:54:11.962 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.957+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0fe0003a40 con 0x7f0fec0c81f0 2023-05-21T16:54:11.962 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.957+0000 7f0fd37fe700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fd8066320 0x7f0fd80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:11.962 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.957+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0fe00836e0 con 0x7f0fec0c81f0 2023-05-21T16:54:11.962 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.957+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fd8066320 0x7f0fd80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:11.962 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.957+0000 7f0feaffd700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fd8066320 0x7f0fd80687d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc008010 tx=0x7f0fdc006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:11.970 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:11.965+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0fec0b28d0 con 0x7f0fec0c81f0 2023-05-21T16:54:12.133 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.129+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fec0b28d0 con 0x7f0fec0c81f0 2023-05-21T16:54:12.135 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.129+0000 7f0fd37fe700 1 -- 172.21.15.46:0/1059702461 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f0fec0b28d0 con 0x7f0fec0c81f0 2023-05-21T16:54:12.135 INFO:teuthology.misc.health.smithi046.stdout: 2023-05-21T16:54:12.136 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":17,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:09.589085+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:12.137 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fd8066320 msgr2=0x7f0fd80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.137 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fd8066320 0x7f0fd80687d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc008010 tx=0x7f0fdc006000 comp rx=0 tx=0).stop 2023-05-21T16:54:12.137 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 msgr2=0x7f0fec0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.138 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 0x7f0fec0c8660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000f860 tx=0x7f0fe000fb70 comp rx=0 tx=0).stop 2023-05-21T16:54:12.138 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 shutdown_connections 2023-05-21T16:54:12.138 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fd8066320 0x7f0fd80687d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.139 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fec0c65b0 0x7f0fec0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.139 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec0c81f0 0x7f0fec0c8660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.139 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 --2- 172.21.15.46:0/1059702461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd4003a50 0x7f0fec0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.139 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 >> 172.21.15.46:0/1059702461 conn(0x7f0fec0cbc30 msgr2=0x7f0fec0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:12.139 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 shutdown_connections 2023-05-21T16:54:12.139 INFO:teuthology.misc.health.smithi046.stderr:2023-05-21T16:54:12.133+0000 7f0febfff700 1 -- 172.21.15.46:0/1059702461 wait complete. 2023-05-21T16:54:12.149 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-21T16:54:12.149 INFO:tasks.ceph:Creating RBD pool 2023-05-21T16:54:12.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-21T16:54:12.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.265+0000 7f93517c2700 1 Processor -- start 2023-05-21T16:54:12.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.265+0000 7f93517c2700 1 -- start start 2023-05-21T16:54:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c15a8e0 0x7f934c0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f934c0b1a60 0x7f934c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0cd670 con 0x7f934c157470 2023-05-21T16:54:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0b1f00 con 0x7f934c0b1a60 2023-05-21T16:54:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c06cb10 con 0x7f934c15a8e0 2023-05-21T16:54:12.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93437fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c15a8e0 0x7f934c0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f934bfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f934c157470 0x7f934c06c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:51742/0 (socket says 172.21.15.46:51742) 2023-05-21T16:54:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f9350fc1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f934c0b1a60 0x7f934c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f934bfff700 1 -- 172.21.15.46:0/2496504051 learned_addr learned my addr 172.21.15.46:0/2496504051 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93437fe700 1 -- 172.21.15.46:0/2496504051 >> v2:172.21.15.142:3300/0 conn(0x7f934c0b1a60 msgr2=0x7f934c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93437fe700 1 --2- 172.21.15.46:0/2496504051 >> v2:172.21.15.142:3300/0 conn(0x7f934c0b1a60 0x7f934c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93437fe700 1 -- 172.21.15.46:0/2496504051 >> v1:172.21.15.142:6789/0 conn(0x7f934c157470 legacy=0x7f934c06c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93437fe700 1 -- 172.21.15.46:0/2496504051 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c06cdf0 con 0x7f934c15a8e0 2023-05-21T16:54:12.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93437fe700 1 --2- 172.21.15.46:0/2496504051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c15a8e0 0x7f934c0b1520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9334009850 tx=0x7f9334009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77dc358ed5116b87 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f934b7fe700 1 -- 172.21.15.46:0/2496504051 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334011830 con 0x7f934c15a8e0 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f934b7fe700 1 -- 172.21.15.46:0/2496504051 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334011990 con 0x7f934c15a8e0 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f934b7fe700 1 -- 172.21.15.46:0/2496504051 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334011d40 con 0x7f934c15a8e0 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- 172.21.15.46:0/2496504051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c15a8e0 msgr2=0x7f934c0b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 --2- 172.21.15.46:0/2496504051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c15a8e0 0x7f934c0b1520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9334009850 tx=0x7f9334009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- 172.21.15.46:0/2496504051 shutdown_connections 2023-05-21T16:54:12.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 --2- 172.21.15.46:0/2496504051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c15a8e0 0x7f934c0b1520 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 --2- 172.21.15.46:0/2496504051 >> v2:172.21.15.142:3300/0 conn(0x7f934c0b1a60 0x7f934c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- 172.21.15.46:0/2496504051 >> 172.21.15.46:0/2496504051 conn(0x7f934c06d930 msgr2=0x7f934c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- 172.21.15.46:0/2496504051 shutdown_connections 2023-05-21T16:54:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.269+0000 7f93517c2700 1 -- 172.21.15.46:0/2496504051 wait complete. 2023-05-21T16:54:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 Processor -- start 2023-05-21T16:54:12.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 -- start start 2023-05-21T16:54:12.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c0b1a60 0x7f934c150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f934c157470 0x7f934c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 0x7f934c15d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0c6b70 con 0x7f934c15a8e0 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c150890 con 0x7f934c157470 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93517c2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0c4060 con 0x7f934c0b1a60 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f9350fc1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 0x7f934c15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f9350fc1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 0x7f934c15d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50760/0 (socket says 172.21.15.46:50760) 2023-05-21T16:54:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f9350fc1700 1 -- 172.21.15.46:0/1133492140 learned_addr learned my addr 172.21.15.46:0/1133492140 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f934bfff700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c0b1a60 0x7f934c150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.273+0000 7f93437fe700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f934c157470 0x7f934c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f9350fc1700 1 -- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c0b1a60 msgr2=0x7f934c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f9350fc1700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c0b1a60 0x7f934c150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f9350fc1700 1 -- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f934c157470 msgr2=0x7f934c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f9350fc1700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f934c157470 0x7f934c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f9350fc1700 1 -- 172.21.15.46:0/1133492140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93340094b0 con 0x7f934c15a8e0 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f934bfff700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c0b1a60 0x7f934c150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93437fe700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f934c157470 0x7f934c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f9350fc1700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 0x7f934c15d550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9344009dd0 tx=0x7f934400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934400cce0 con 0x7f934c15a8e0 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400f040 con 0x7f934c15a8e0 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c0cd8c0 con 0x7f934c15a8e0 2023-05-21T16:54:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344014480 con 0x7f934c15a8e0 2023-05-21T16:54:12.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c06d0d0 con 0x7f934c15a8e0 2023-05-21T16:54:12.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.277+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c0ce320 con 0x7f934c15a8e0 2023-05-21T16:54:12.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.281+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93440145e0 con 0x7f934c15a8e0 2023-05-21T16:54:12.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.281+0000 7f93497fa700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f93300662f0 0x7f93300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.281+0000 7f934bfff700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f93300662f0 0x7f93300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.281+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93440840f0 con 0x7f934c15a8e0 2023-05-21T16:54:12.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.281+0000 7f934bfff700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f93300662f0 0x7f93300687a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f933c007fd0 tx=0x7f933c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.289+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9344051ab0 con 0x7f934c15a8e0 2023-05-21T16:54:12.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.449+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f934c0c64b0 con 0x7f934c15a8e0 2023-05-21T16:54:12.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.625+0000 7f93497fa700 1 -- 172.21.15.46:0/1133492140 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f93440550d0 con 0x7f934c15a8e0 2023-05-21T16:54:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f93300662f0 msgr2=0x7f93300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f93300662f0 0x7f93300687a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f933c007fd0 tx=0x7f933c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 msgr2=0x7f934c15d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 0x7f934c15d550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9344009dd0 tx=0x7f934400c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 shutdown_connections 2023-05-21T16:54:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f93300662f0 0x7f93300687a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f934c15a8e0 0x7f934c15d550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f934c157470 0x7f934c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 --2- 172.21.15.46:0/1133492140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f934c0b1a60 0x7f934c150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 >> 172.21.15.46:0/1133492140 conn(0x7f934c06d930 msgr2=0x7f934c0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 shutdown_connections 2023-05-21T16:54:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.629+0000 7f93517c2700 1 -- 172.21.15.46:0/1133492140 wait complete. 2023-05-21T16:54:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2023-05-21T16:54:12.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-21T16:54:12.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 Processor -- start 2023-05-21T16:54:12.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 -- start start 2023-05-21T16:54:12.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b20143c90 0x7f2b2015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2b200c9870 0x7f2b20069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2015ed60 con 0x7f2b20070ed0 2023-05-21T16:54:12.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b200cd6b0 con 0x7f2b200c9870 2023-05-21T16:54:12.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b200cba50 con 0x7f2b20143c90 2023-05-21T16:54:12.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b167fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2b200c9870 0x7f2b20069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2b20070ed0 0x7f2b200712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33674/0 (socket says 172.21.15.46:33674) 2023-05-21T16:54:12.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1f7fe700 1 -- 172.21.15.46:0/3593606890 learned_addr learned my addr 172.21.15.46:0/3593606890 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:12.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1effd700 1 --2- 172.21.15.46:0/3593606890 >> v2:172.21.15.142:3300/0 conn(0x7f2b20143c90 0x7f2b2015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b167fc700 1 -- 172.21.15.46:0/3593606890 >> v2:172.21.15.142:3300/0 conn(0x7f2b20143c90 msgr2=0x7f2b2015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:12.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b167fc700 1 --2- 172.21.15.46:0/3593606890 >> v2:172.21.15.142:3300/0 conn(0x7f2b20143c90 0x7f2b2015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b167fc700 1 -- 172.21.15.46:0/3593606890 >> v1:172.21.15.46:6789/0 conn(0x7f2b20070ed0 legacy=0x7f2b200712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b167fc700 1 -- 172.21.15.46:0/3593606890 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b200c9d00 con 0x7f2b200c9870 2023-05-21T16:54:12.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1e7fc700 1 -- 172.21.15.46:0/3593606890 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917108039 0 0) 0x7f2b18001490 con 0x7f2b20070ed0 2023-05-21T16:54:12.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b167fc700 1 --2- 172.21.15.46:0/3593606890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b200c9870 0x7f2b20069f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b20071da0 tx=0x7f2b08009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a041fbaa16dd6eb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:12.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1e7fc700 1 -- 172.21.15.46:0/3593606890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011830 con 0x7f2b200c9870 2023-05-21T16:54:12.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1e7fc700 1 -- 172.21.15.46:0/3593606890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08011990 con 0x7f2b200c9870 2023-05-21T16:54:12.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.769+0000 7f2b1e7fc700 1 -- 172.21.15.46:0/3593606890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011d20 con 0x7f2b200c9870 2023-05-21T16:54:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3593606890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b200c9870 msgr2=0x7f2b20069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3593606890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b200c9870 0x7f2b20069f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b20071da0 tx=0x7f2b08009b30 comp rx=0 tx=0).stop 2023-05-21T16:54:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3593606890 shutdown_connections 2023-05-21T16:54:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3593606890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b200c9870 0x7f2b20069f80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3593606890 >> v2:172.21.15.142:3300/0 conn(0x7f2b20143c90 0x7f2b2015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3593606890 >> 172.21.15.46:0/3593606890 conn(0x7f2b200cfeb0 msgr2=0x7f2b200cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3593606890 shutdown_connections 2023-05-21T16:54:12.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.773+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3593606890 wait complete. 2023-05-21T16:54:12.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 Processor -- start 2023-05-21T16:54:12.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 -- start start 2023-05-21T16:54:12.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 0x7f2b20136680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b200c9870 0x7f2b201591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b20143c90 0x7f2b2015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b20136fb0 con 0x7f2b20070ed0 2023-05-21T16:54:12.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2015af50 con 0x7f2b20143c90 2023-05-21T16:54:12.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b200c6420 con 0x7f2b200c9870 2023-05-21T16:54:12.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 0x7f2b20136680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 0x7f2b20136680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50770/0 (socket says 172.21.15.46:50770) 2023-05-21T16:54:12.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 -- 172.21.15.46:0/3637677019 learned_addr learned my addr 172.21.15.46:0/3637677019 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:12.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b167fc700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b200c9870 0x7f2b201591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1f7fe700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b20143c90 0x7f2b2015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 -- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b200c9870 msgr2=0x7f2b201591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b200c9870 0x7f2b201591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 -- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b20143c90 msgr2=0x7f2b2015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:12.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b20143c90 0x7f2b2015aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:12.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 -- 172.21.15.46:0/3637677019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080094b0 con 0x7f2b20070ed0 2023-05-21T16:54:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b1effd700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 0x7f2b20136680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000e9d0 tx=0x7f2b1000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.777+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10009720 con 0x7f2b20070ed0 2023-05-21T16:54:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b200cd340 con 0x7f2b20070ed0 2023-05-21T16:54:12.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1000ee70 con 0x7f2b20070ed0 2023-05-21T16:54:12.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b200c9fe0 con 0x7f2b20070ed0 2023-05-21T16:54:12.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000ca50 con 0x7f2b20070ed0 2023-05-21T16:54:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2006a4c0 con 0x7f2b20070ed0 2023-05-21T16:54:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b1000cbb0 con 0x7f2b20070ed0 2023-05-21T16:54:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b17fff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2b000662f0 0x7f2b000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2b100839b0 con 0x7f2b20070ed0 2023-05-21T16:54:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.781+0000 7f2b167fc700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2b000662f0 0x7f2b000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:12.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.785+0000 7f2b167fc700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2b000662f0 0x7f2b000687a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b080090b0 tx=0x7f2b08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:12.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.789+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2b10054c30 con 0x7f2b20070ed0 2023-05-21T16:54:12.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:12.957+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2b20073cb0 con 0x7f2b20070ed0 2023-05-21T16:54:13.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.625+0000 7f2b17fff700 1 -- 172.21.15.46:0/3637677019 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2b1000ce60 con 0x7f2b20070ed0 2023-05-21T16:54:13.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2b000662f0 msgr2=0x7f2b000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2b000662f0 0x7f2b000687a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b080090b0 tx=0x7f2b08008030 comp rx=0 tx=0).stop 2023-05-21T16:54:13.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 msgr2=0x7f2b20136680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 0x7f2b20136680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000e9d0 tx=0x7f2b1000ece0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 shutdown_connections 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2b000662f0 0x7f2b000687a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b20143c90 0x7f2b2015aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b200c9870 0x7f2b201591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 --2- 172.21.15.46:0/3637677019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b20070ed0 0x7f2b20136680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 >> 172.21.15.46:0/3637677019 conn(0x7f2b200cfeb0 msgr2=0x7f2b200b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:13.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 shutdown_connections 2023-05-21T16:54:13.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.633+0000 7f2b1ffff700 1 -- 172.21.15.46:0/3637677019 wait complete. 2023-05-21T16:54:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-21T16:54:13.653 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-21T16:54:13.653 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-21T16:54:13.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-21T16:54:13.655 INFO:tasks.ceph.mds.a:Started 2023-05-21T16:54:13.656 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-21T16:54:13.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-21T16:54:13.658 INFO:tasks.ceph.mds.c:Started 2023-05-21T16:54:13.658 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-21T16:54:13.658 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-21T16:54:13.660 INFO:tasks.ceph.mds.b:Started 2023-05-21T16:54:13.661 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-21T16:54:13.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-21T16:54:13.663 INFO:tasks.ceph.mds.d:Started 2023-05-21T16:54:13.663 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-21T16:54:13.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:13.729 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-05-21T16:54:13.730 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-05-21T16:54:13.735 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-05-21T16:54:13.737 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-05-21T16:54:13.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.765+0000 7f5936db9700 1 Processor -- start 2023-05-21T16:54:13.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.765+0000 7f5936db9700 1 -- start start 2023-05-21T16:54:13.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59301597a0 0x7f59300af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300afbe0 0x7f59300ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 0x7f5930069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300af500 con 0x7f59300aee60 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300af2e0 con 0x7f59301597a0 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300b0030 con 0x7f59300afbe0 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5935356700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 0x7f5930069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59301597a0 0x7f59300af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f592ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300afbe0 0x7f59300ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59301597a0 0x7f59300af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:41772/0 (socket says 172.21.15.46:41772) 2023-05-21T16:54:13.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 -- 172.21.15.46:0/767704746 learned_addr learned my addr 172.21.15.46:0/767704746 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:13.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5935356700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 0x7f5930069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50796/0 (socket says 172.21.15.46:50796) 2023-05-21T16:54:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 -- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300afbe0 msgr2=0x7f59300ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 --2- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300afbe0 0x7f59300ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 -- 172.21.15.46:0/767704746 >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 msgr2=0x7f5930069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 --2- 172.21.15.46:0/767704746 >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 0x7f5930069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 -- 172.21.15.46:0/767704746 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593006d870 con 0x7f59301597a0 2023-05-21T16:54:13.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5935356700 1 --2- 172.21.15.46:0/767704746 >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 0x7f5930069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:13.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5934b55700 1 --2- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300af6a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5930070250 tx=0x7f5924009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=837848d48e0c1d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:13.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f592f7fe700 1 -- 172.21.15.46:0/767704746 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924011830 con 0x7f59301597a0 2023-05-21T16:54:13.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f592f7fe700 1 -- 172.21.15.46:0/767704746 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924011990 con 0x7f59301597a0 2023-05-21T16:54:13.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f592f7fe700 1 -- 172.21.15.46:0/767704746 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924011d20 con 0x7f59301597a0 2023-05-21T16:54:13.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 msgr2=0x7f59300af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300af6a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5930070250 tx=0x7f5924009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- 172.21.15.46:0/767704746 shutdown_connections 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- 172.21.15.46:0/767704746 >> v2:172.21.15.46:3300/0 conn(0x7f59300aee60 0x7f5930069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300afbe0 0x7f59300ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 --2- 172.21.15.46:0/767704746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300af6a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- 172.21.15.46:0/767704746 >> 172.21.15.46:0/767704746 conn(0x7f59300ceca0 msgr2=0x7f59300cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- 172.21.15.46:0/767704746 shutdown_connections 2023-05-21T16:54:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.769+0000 7f5936db9700 1 -- 172.21.15.46:0/767704746 wait complete. 2023-05-21T16:54:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 Processor -- start 2023-05-21T16:54:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 -- start start 2023-05-21T16:54:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 0x7f5930152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 0x7f59300c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c4a30 con 0x7f59300afbe0 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c4d10 con 0x7f59301597a0 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5936db9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59300c4ff0 con 0x7f59300aee60 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f592ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 0x7f59300c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5934b55700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 0x7f5930152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5934b55700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 0x7f5930152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:58550/0 (socket says 172.21.15.46:58550) 2023-05-21T16:54:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f592ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 0x7f59300c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50804/0 (socket says 172.21.15.46:50804) 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5934b55700 1 -- 172.21.15.46:0/850259491 learned_addr learned my addr 172.21.15.46:0/850259491 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.773+0000 7f5935356700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5934b55700 1 -- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 msgr2=0x7f59300b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5934b55700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5934b55700 1 -- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 msgr2=0x7f59300c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5934b55700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 0x7f59300c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5934b55700 1 -- 172.21.15.46:0/850259491 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009a70 con 0x7f59300aee60 2023-05-21T16:54:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f592ffff700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 0x7f59300c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:13.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5934b55700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 0x7f5930152100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5924014040 tx=0x7f5924004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924004450 con 0x7f59300aee60 2023-05-21T16:54:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592401e070 con 0x7f59300aee60 2023-05-21T16:54:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5924009570 con 0x7f59300aee60 2023-05-21T16:54:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924003900 con 0x7f59300aee60 2023-05-21T16:54:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593015e1c0 con 0x7f59300aee60 2023-05-21T16:54:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593015d440 con 0x7f59300aee60 2023-05-21T16:54:13.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.777+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5924003a60 con 0x7f59300aee60 2023-05-21T16:54:13.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.781+0000 7f592d7fa700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59140662f0 0x7f59140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:13.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.781+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5924084a50 con 0x7f59300aee60 2023-05-21T16:54:13.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.781+0000 7f592ffff700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59140662f0 0x7f59140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:13.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.781+0000 7f592ffff700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59140662f0 0x7f59140687a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59300c3a80 tx=0x7f591c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:13.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.789+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59240522b0 con 0x7f59300aee60 2023-05-21T16:54:13.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.957+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5930159b70 con 0x7f59300aee60 2023-05-21T16:54:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.957+0000 7f592d7fa700 1 -- 172.21.15.46:0/850259491 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f5924020070 con 0x7f59300aee60 2023-05-21T16:54:13.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:13.964 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:13.621796+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:13.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59140662f0 msgr2=0x7f59140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59140662f0 0x7f59140687a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59300c3a80 tx=0x7f591c009240 comp rx=0 tx=0).stop 2023-05-21T16:54:13.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 msgr2=0x7f5930152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:13.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 0x7f5930152100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5924014040 tx=0x7f5924004770 comp rx=0 tx=0).stop 2023-05-21T16:54:13.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 shutdown_connections 2023-05-21T16:54:13.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59140662f0 0x7f59140687a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59301597a0 0x7f59300b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59300afbe0 0x7f59300c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 --2- 172.21.15.46:0/850259491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59300aee60 0x7f5930152100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 >> 172.21.15.46:0/850259491 conn(0x7f59300ceca0 msgr2=0x7f59300ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 shutdown_connections 2023-05-21T16:54:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:13.961+0000 7f5936db9700 1 -- 172.21.15.46:0/850259491 wait complete. 2023-05-21T16:54:13.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:13.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5359e700 1 Processor -- start 2023-05-21T16:54:14.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5359e700 1 -- start start 2023-05-21T16:54:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3b540b8ad0 0x7f3b540cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b540b8ea0 con 0x7f3b540b4910 2023-05-21T16:54:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b540d09d0 con 0x7f3b540b5ce0 2023-05-21T16:54:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540d0cb0 con 0x7f3b540b8ad0 2023-05-21T16:54:14.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b52d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3b540b4910 0x7f3b540d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33698/0 (socket says 172.21.15.46:33698) 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b52d9d700 1 -- 172.21.15.46:0/2647995462 learned_addr learned my addr 172.21.15.46:0/2647995462 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2647995462 >> v2:172.21.15.142:3300/0 conn(0x7f3b540b8ad0 0x7f3b540cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580741103 0 0) 0x7f3b540b8ea0 con 0x7f3b540b4910 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.093+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b3c0035d0 con 0x7f3b540b4910 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1560803054 0 0) 0x7f3b3c0035d0 con 0x7f3b540b4910 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 >> v2:172.21.15.142:3300/0 conn(0x7f3b540b8ad0 msgr2=0x7f3b540cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:14.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 --2- 172.21.15.46:0/2647995462 >> v2:172.21.15.142:3300/0 conn(0x7f3b540b8ad0 0x7f3b540cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 >> v1:172.21.15.142:6789/0 conn(0x7f3b540b5ce0 legacy=0x7f3b5406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540cd4f0 con 0x7f3b540b4910 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f3b4c0019f0 con 0x7f3b540b4910 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 >> v1:172.21.15.46:6789/0 conn(0x7f3b540b4910 legacy=0x7f3b540d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b3c003a20 0x7f3b3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c004870 0x7f3b3c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c005220 0x7f3b3c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540d0cb0 con 0x7f3b3c003a20 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c00c130 con 0x7f3b3c004870 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c00c2f0 con 0x7f3b3c005220 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b3c003a20 0x7f3b3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b51d9b700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c004870 0x7f3b3c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b52d9d700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c005220 0x7f3b3c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 -- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c005220 msgr2=0x7f3b3c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c005220 0x7f3b3c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 -- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c004870 msgr2=0x7f3b3c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c004870 0x7f3b3c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b52d9d700 1 -- 172.21.15.46:0/2647995462 reap_dead start 2023-05-21T16:54:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 -- 172.21.15.46:0/2647995462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0035d0 con 0x7f3b3c003a20 2023-05-21T16:54:14.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b3c003a20 0x7f3b3c003e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009b70 tx=0x7f3b3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7e0858b0b7c8d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800e6c0 con 0x7f3b3c003a20 2023-05-21T16:54:14.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800e820 con 0x7f3b3c003a20 2023-05-21T16:54:14.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5159a700 1 -- 172.21.15.46:0/2647995462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800ebb0 con 0x7f3b3c003a20 2023-05-21T16:54:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 -- 172.21.15.46:0/2647995462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b3c003a20 msgr2=0x7f3b3c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b3c003a20 0x7f3b3c003e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009b70 tx=0x7f3b3c0058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 -- 172.21.15.46:0/2647995462 shutdown_connections 2023-05-21T16:54:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2647995462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b3c003a20 0x7f3b3c003e30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 -- 172.21.15.46:0/2647995462 >> 172.21.15.46:0/2647995462 conn(0x7f3b540d3ae0 msgr2=0x7f3b540cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 -- 172.21.15.46:0/2647995462 shutdown_connections 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 -- 172.21.15.46:0/2647995462 wait complete. 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.097+0000 7f3b5359e700 1 Processor -- start 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 -- start start 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c003a20 0x7f3b540b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 0x7f3b541f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b541f5ad0 0x7f3b541f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540cb550 con 0x7f3b5414d340 2023-05-21T16:54:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540cb000 con 0x7f3b3c003a20 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540cb270 con 0x7f3b541f5ad0 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 0x7f3b541f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 0x7f3b541f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50832/0 (socket says 172.21.15.46:50832) 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 -- 172.21.15.46:0/2080224254 learned_addr learned my addr 172.21.15.46:0/2080224254 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b52d9d700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b541f5ad0 0x7f3b541f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c003a20 0x7f3b540b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 -- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b541f5ad0 msgr2=0x7f3b541f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b541f5ad0 0x7f3b541f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 -- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c003a20 msgr2=0x7f3b540b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c003a20 0x7f3b540b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 -- 172.21.15.46:0/2080224254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540cda70 con 0x7f3b5414d340 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b52d9d700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b541f5ad0 0x7f3b541f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c003a20 0x7f3b540b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b51d9b700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 0x7f3b541f5590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400f820 tx=0x7f3b4400fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44005320 con 0x7f3b5414d340 2023-05-21T16:54:14.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44005480 con 0x7f3b5414d340 2023-05-21T16:54:14.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b540cd790 con 0x7f3b5414d340 2023-05-21T16:54:14.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44006ac0 con 0x7f3b5414d340 2023-05-21T16:54:14.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.101+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540cf310 con 0x7f3b5414d340 2023-05-21T16:54:14.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.105+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b540733b0 con 0x7f3b5414d340 2023-05-21T16:54:14.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.105+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b44006c20 con 0x7f3b5414d340 2023-05-21T16:54:14.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.105+0000 7f3b42ffd700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3b34066320 0x7f3b340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.105+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b440832b0 con 0x7f3b5414d340 2023-05-21T16:54:14.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.105+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3b34066320 0x7f3b340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.105+0000 7f3b5259c700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3b34066320 0x7f3b340687d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b480090b0 tx=0x7f3b48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.113+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3b44050b10 con 0x7f3b5414d340 2023-05-21T16:54:14.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.277+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b5406b3e0 con 0x7f3b5414d340 2023-05-21T16:54:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.277+0000 7f3b42ffd700 1 -- 172.21.15.46:0/2080224254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b44054130 con 0x7f3b5414d340 2023-05-21T16:54:14.282 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3b34066320 msgr2=0x7f3b340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3b34066320 0x7f3b340687d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b480090b0 tx=0x7f3b48008030 comp rx=0 tx=0).stop 2023-05-21T16:54:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 msgr2=0x7f3b541f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 0x7f3b541f5590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400f820 tx=0x7f3b4400fbe0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 shutdown_connections 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3b34066320 0x7f3b340687d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b541f5ad0 0x7f3b541f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b5414d340 0x7f3b541f5590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 --2- 172.21.15.46:0/2080224254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c003a20 0x7f3b540b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 >> 172.21.15.46:0/2080224254 conn(0x7f3b540d3ae0 msgr2=0x7f3b5406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 shutdown_connections 2023-05-21T16:54:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.281+0000 7f3b5359e700 1 -- 172.21.15.46:0/2080224254 wait complete. 2023-05-21T16:54:14.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.417+0000 7f120e69e700 1 Processor -- start 2023-05-21T16:54:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.417+0000 7f120e69e700 1 -- start start 2023-05-21T16:54:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12080aeaf0 0x7f12080ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f120815d1f0 0x7f120815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1208159ab0 con 0x7f120815dbb0 2023-05-21T16:54:14.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12080ce5c0 con 0x7f120815d1f0 2023-05-21T16:54:14.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120815e010 con 0x7f12080aeaf0 2023-05-21T16:54:14.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f120815d1f0 0x7f120815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f120815d1f0 0x7f120815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50846/0 (socket says 172.21.15.46:50846) 2023-05-21T16:54:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 -- 172.21.15.46:0/270972248 learned_addr learned my addr 172.21.15.46:0/270972248 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120d69c700 1 --2- 172.21.15.46:0/270972248 >> v2:172.21.15.142:3300/0 conn(0x7f12080aeaf0 0x7f12080ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 -- 172.21.15.46:0/270972248 >> v2:172.21.15.142:3300/0 conn(0x7f12080aeaf0 msgr2=0x7f12080ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 --2- 172.21.15.46:0/270972248 >> v2:172.21.15.142:3300/0 conn(0x7f12080aeaf0 0x7f12080ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 -- 172.21.15.46:0/270972248 >> v1:172.21.15.142:6789/0 conn(0x7f120815dbb0 legacy=0x7f12080b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 -- 172.21.15.46:0/270972248 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080caee0 con 0x7f120815d1f0 2023-05-21T16:54:14.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120ce9b700 1 --2- 172.21.15.46:0/270972248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f120815d1f0 0x7f120815d670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009910 tx=0x7f11f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5daa4607353ad1f server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f11fffff700 1 -- 172.21.15.46:0/270972248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8011830 con 0x7f120815d1f0 2023-05-21T16:54:14.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f11fffff700 1 -- 172.21.15.46:0/270972248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8011990 con 0x7f120815d1f0 2023-05-21T16:54:14.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f11fffff700 1 -- 172.21.15.46:0/270972248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8011d40 con 0x7f120815d1f0 2023-05-21T16:54:14.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- 172.21.15.46:0/270972248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f120815d1f0 msgr2=0x7f120815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 --2- 172.21.15.46:0/270972248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f120815d1f0 0x7f120815d670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009910 tx=0x7f11f8009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:14.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- 172.21.15.46:0/270972248 shutdown_connections 2023-05-21T16:54:14.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 --2- 172.21.15.46:0/270972248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f120815d1f0 0x7f120815d670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 --2- 172.21.15.46:0/270972248 >> v2:172.21.15.142:3300/0 conn(0x7f12080aeaf0 0x7f12080ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- 172.21.15.46:0/270972248 >> 172.21.15.46:0/270972248 conn(0x7f120806d930 msgr2=0x7f120806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:14.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- 172.21.15.46:0/270972248 shutdown_connections 2023-05-21T16:54:14.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- 172.21.15.46:0/270972248 wait complete. 2023-05-21T16:54:14.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 Processor -- start 2023-05-21T16:54:14.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.421+0000 7f120e69e700 1 -- start start 2023-05-21T16:54:14.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 0x7f120814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120815d1f0 0x7f120815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120815dbb0 0x7f12080b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12081f2dd0 con 0x7f12080aeaf0 2023-05-21T16:54:14.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120814f660 con 0x7f120815d1f0 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120815a8f0 con 0x7f120815dbb0 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120d69c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 0x7f120814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120815d1f0 0x7f120815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120d69c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 0x7f120814f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50848/0 (socket says 172.21.15.46:50848) 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120d69c700 1 -- 172.21.15.46:0/525579034 learned_addr learned my addr 172.21.15.46:0/525579034 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120de9d700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120815dbb0 0x7f12080b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 -- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120815dbb0 msgr2=0x7f12080b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120815dbb0 0x7f12080b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 -- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 msgr2=0x7f120814f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 0x7f120814f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 -- 172.21.15.46:0/525579034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009570 con 0x7f120815d1f0 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120d69c700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 0x7f120814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120ce9b700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120815d1f0 0x7f120815a3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11f8016000 tx=0x7f11f8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004300 con 0x7f120815d1f0 2023-05-21T16:54:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f801f070 con 0x7f120815d1f0 2023-05-21T16:54:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12080ceb00 con 0x7f120815d1f0 2023-05-21T16:54:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80036c0 con 0x7f120815d1f0 2023-05-21T16:54:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.425+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12080ce820 con 0x7f120815d1f0 2023-05-21T16:54:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.429+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12080cede0 con 0x7f120815d1f0 2023-05-21T16:54:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.429+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11f8021030 con 0x7f120815d1f0 2023-05-21T16:54:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.429+0000 7f11fdffb700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f11ec0662f0 0x7f11ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.429+0000 7f120d69c700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f11ec0662f0 0x7f11ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.429+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11f8084e30 con 0x7f120815d1f0 2023-05-21T16:54:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.429+0000 7f120d69c700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f11ec0662f0 0x7f11ec0687a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f12080ae850 tx=0x7f1204009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.437+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f11f8052610 con 0x7f120815d1f0 2023-05-21T16:54:14.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.605+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1208073cb0 con 0x7f120815d1f0 2023-05-21T16:54:14.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.605+0000 7f11fdffb700 1 -- 172.21.15.46:0/525579034 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11f8072e60 con 0x7f120815d1f0 2023-05-21T16:54:14.611 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f11ec0662f0 msgr2=0x7f11ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f11ec0662f0 0x7f11ec0687a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f12080ae850 tx=0x7f1204009240 comp rx=0 tx=0).stop 2023-05-21T16:54:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120815d1f0 msgr2=0x7f120815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120815d1f0 0x7f120815a3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11f8016000 tx=0x7f11f8004770 comp rx=0 tx=0).stop 2023-05-21T16:54:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 shutdown_connections 2023-05-21T16:54:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f11ec0662f0 0x7f11ec0687a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120815dbb0 0x7f12080b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120815d1f0 0x7f120815a3b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 --2- 172.21.15.46:0/525579034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12080aeaf0 0x7f120814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 >> 172.21.15.46:0/525579034 conn(0x7f120806d930 msgr2=0x7f120806c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 shutdown_connections 2023-05-21T16:54:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.609+0000 7f120e69e700 1 -- 172.21.15.46:0/525579034 wait complete. 2023-05-21T16:54:14.626 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:54:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98c1dcf700 1 Processor -- start 2023-05-21T16:54:14.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98c1dcf700 1 -- start start 2023-05-21T16:54:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98c1dcf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc158e00 0x7f98bc0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98c1dcf700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc15d850 con 0x7f98bc15d200 2023-05-21T16:54:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98c1dcf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc1591d0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98c1dcf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0aea30 con 0x7f98bc158e00 2023-05-21T16:54:14.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bbfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f98bc15d200 0x7f98bc0c99e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57192/0 (socket says 172.21.15.46:57192) 2023-05-21T16:54:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bbfff700 1 -- 172.21.15.46:0/336768884 learned_addr learned my addr 172.21.15.46:0/336768884 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:14.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bb7fe700 1 --2- 172.21.15.46:0/336768884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc158e00 0x7f98bc0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702600093 0 0) 0x7f98bc1591d0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a80035d0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371041581 0 0) 0x7f98bc15d850 con 0x7f98bc15d200 2023-05-21T16:54:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98bc1591d0 con 0x7f98bc15d200 2023-05-21T16:54:14.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bb7fe700 1 -- 172.21.15.46:0/336768884 >> v1:172.21.15.142:6789/0 conn(0x7f98bc0af7f0 legacy=0x7f98bc15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bb7fe700 1 -- 172.21.15.46:0/336768884 >> v1:172.21.15.46:6789/0 conn(0x7f98bc15d200 legacy=0x7f98bc0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bb7fe700 1 -- 172.21.15.46:0/336768884 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0aed10 con 0x7f98bc158e00 2023-05-21T16:54:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.737+0000 7f98bb7fe700 1 --2- 172.21.15.46:0/336768884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc158e00 0x7f98bc0706a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009880 tx=0x7f98a4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717dc812abbf0981 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011830 con 0x7f98bc158e00 2023-05-21T16:54:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4011990 con 0x7f98bc158e00 2023-05-21T16:54:14.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98ba7fc700 1 -- 172.21.15.46:0/336768884 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011d20 con 0x7f98bc158e00 2023-05-21T16:54:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 -- 172.21.15.46:0/336768884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc158e00 msgr2=0x7f98bc0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/336768884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc158e00 0x7f98bc0706a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009880 tx=0x7f98a4009b90 comp rx=0 tx=0).stop 2023-05-21T16:54:14.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 -- 172.21.15.46:0/336768884 shutdown_connections 2023-05-21T16:54:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/336768884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc158e00 0x7f98bc0706a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 -- 172.21.15.46:0/336768884 >> 172.21.15.46:0/336768884 conn(0x7f98bc0cf090 msgr2=0x7f98bc0cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 -- 172.21.15.46:0/336768884 shutdown_connections 2023-05-21T16:54:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 -- 172.21.15.46:0/336768884 wait complete. 2023-05-21T16:54:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 Processor -- start 2023-05-21T16:54:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.741+0000 7f98c1dcf700 1 -- start start 2023-05-21T16:54:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98c1dcf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 0x7f98bc0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98c1dcf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98bc158e00 0x7f98bc14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98c1dcf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98bc15d200 0x7f98bc14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98c1dcf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0c62c0 con 0x7f98bc158e00 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98c1dcf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0c65a0 con 0x7f98bc15d200 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98c1dcf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0c6880 con 0x7f98bc0af7f0 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98baffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98bc158e00 0x7f98bc14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 0x7f98bc0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 0x7f98bc0c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:55964/0 (socket says 172.21.15.46:55964) 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 -- 172.21.15.46:0/691608190 learned_addr learned my addr 172.21.15.46:0/691608190 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bbfff700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98bc15d200 0x7f98bc14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 -- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98bc15d200 msgr2=0x7f98bc14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98bc15d200 0x7f98bc14f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 -- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98bc158e00 msgr2=0x7f98bc14ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98bc158e00 0x7f98bc14ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 -- 172.21.15.46:0/691608190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40094b0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98baffd700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98bc158e00 0x7f98bc14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.745+0000 7f98bb7fe700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 0x7f98bc0c5ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98a4013040 tx=0x7f98a4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.749+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a401a8c0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.749+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc0af2d0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.749+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98bc0aeff0 con 0x7f98bc0af7f0 2023-05-21T16:54:14.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.749+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a401e070 con 0x7f98bc0af7f0 2023-05-21T16:54:14.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.749+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a401ac20 con 0x7f98bc0af7f0 2023-05-21T16:54:14.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.753+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a0005310 con 0x7f98bc0af7f0 2023-05-21T16:54:14.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.753+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98a402d450 con 0x7f98bc0af7f0 2023-05-21T16:54:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.753+0000 7f98b3fff700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f989c066320 0x7f989c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.753+0000 7f98baffd700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f989c066320 0x7f989c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.753+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f98a4084a00 con 0x7f98bc0af7f0 2023-05-21T16:54:14.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.753+0000 7f98baffd700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f989c066320 0x7f989c0687d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0c5b00 tx=0x7f98ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:14.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.757+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f98a4052260 con 0x7f98bc0af7f0 2023-05-21T16:54:14.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.957+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98a0005890 con 0x7f98bc0af7f0 2023-05-21T16:54:14.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.957+0000 7f98b3fff700 1 -- 172.21.15.46:0/691608190 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f98a4020070 con 0x7f98bc0af7f0 2023-05-21T16:54:14.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:14.964 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f989c066320 msgr2=0x7f989c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f989c066320 0x7f989c0687d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0c5b00 tx=0x7f98ac009040 comp rx=0 tx=0).stop 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 msgr2=0x7f98bc0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 0x7f98bc0c5ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98a4013040 tx=0x7f98a4004770 comp rx=0 tx=0).stop 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 shutdown_connections 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f989c066320 0x7f989c0687d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98bc15d200 0x7f98bc14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98bc158e00 0x7f98bc14ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 --2- 172.21.15.46:0/691608190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98bc0af7f0 0x7f98bc0c5ce0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 >> 172.21.15.46:0/691608190 conn(0x7f98bc0cf090 msgr2=0x7f98bc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 shutdown_connections 2023-05-21T16:54:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:14.965+0000 7f98c1dcf700 1 -- 172.21.15.46:0/691608190 wait complete. 2023-05-21T16:54:14.970 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2023-05-21T16:54:14.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 Processor -- start 2023-05-21T16:54:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 -- start start 2023-05-21T16:54:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f855406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85540caea0 0x7f855415b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855415aea0 con 0x7f855415b870 2023-05-21T16:54:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855415ac20 con 0x7f85540caea0 2023-05-21T16:54:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.097+0000 7f8559234700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554071790 con 0x7f8554154de0 2023-05-21T16:54:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8558a33700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f855415b870 0x7f855415e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57204/0 (socket says 172.21.15.46:57204) 2023-05-21T16:54:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8558a33700 1 -- 172.21.15.46:0/2311316724 learned_addr learned my addr 172.21.15.46:0/2311316724 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8553fff700 1 --2- 172.21.15.46:0/2311316724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f855406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f85537fe700 1 --2- 172.21.15.46:0/2311316724 >> v2:172.21.15.142:3300/0 conn(0x7f85540caea0 0x7f855415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8552ffd700 1 -- 172.21.15.46:0/2311316724 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028535191 0 0) 0x7f855415aea0 con 0x7f855415b870 2023-05-21T16:54:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8552ffd700 1 -- 172.21.15.46:0/2311316724 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853c0035d0 con 0x7f855415b870 2023-05-21T16:54:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8553fff700 1 -- 172.21.15.46:0/2311316724 >> v2:172.21.15.142:3300/0 conn(0x7f85540caea0 msgr2=0x7f855415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8553fff700 1 --2- 172.21.15.46:0/2311316724 >> v2:172.21.15.142:3300/0 conn(0x7f85540caea0 0x7f855415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8553fff700 1 -- 172.21.15.46:0/2311316724 >> v1:172.21.15.46:6789/0 conn(0x7f855415b870 legacy=0x7f855415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8553fff700 1 -- 172.21.15.46:0/2311316724 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540cb310 con 0x7f8554154de0 2023-05-21T16:54:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8553fff700 1 --2- 172.21.15.46:0/2311316724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f855406c760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8544009850 tx=0x7f8544009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59692bdeaa05bf7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8552ffd700 1 -- 172.21.15.46:0/2311316724 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544011830 con 0x7f8554154de0 2023-05-21T16:54:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8552ffd700 1 -- 172.21.15.46:0/2311316724 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544011990 con 0x7f8554154de0 2023-05-21T16:54:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8552ffd700 1 -- 172.21.15.46:0/2311316724 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544011d00 con 0x7f8554154de0 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 -- 172.21.15.46:0/2311316724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 msgr2=0x7f855406c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 --2- 172.21.15.46:0/2311316724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f855406c760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8544009850 tx=0x7f8544009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 -- 172.21.15.46:0/2311316724 shutdown_connections 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 --2- 172.21.15.46:0/2311316724 >> v2:172.21.15.142:3300/0 conn(0x7f85540caea0 0x7f855415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 --2- 172.21.15.46:0/2311316724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f855406c760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 -- 172.21.15.46:0/2311316724 >> 172.21.15.46:0/2311316724 conn(0x7f85540cf720 msgr2=0x7f85540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:15.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 -- 172.21.15.46:0/2311316724 shutdown_connections 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.101+0000 7f8559234700 1 -- 172.21.15.46:0/2311316724 wait complete. 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 Processor -- start 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 -- start start 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85540caea0 0x7f8554157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f85540ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 0x7f8554150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541510a0 con 0x7f855415b870 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554158040 con 0x7f85540caea0 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540abab0 con 0x7f8554154de0 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 0x7f8554150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 0x7f8554150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58556/0 (socket says 172.21.15.46:58556) 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 -- 172.21.15.46:0/1333866840 learned_addr learned my addr 172.21.15.46:0/1333866840 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f85537fe700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f85540ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8553fff700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85540caea0 0x7f8554157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 -- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 msgr2=0x7f85540ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f85540ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 -- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85540caea0 msgr2=0x7f8554157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85540caea0 0x7f8554157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 -- 172.21.15.46:0/1333866840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440094b0 con 0x7f855415b870 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f85537fe700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f85540ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8558a33700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 0x7f8554150b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f854c00cb40 tx=0x7f854c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00a9a0 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00ab00 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855406d0b0 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00ae90 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.105+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855406cdd0 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.109+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855406d390 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.109+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f854c01b3b0 con 0x7f855415b870 2023-05-21T16:54:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.109+0000 7f8550ff9700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f85400662f0 0x7f85400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.109+0000 7f8553fff700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f85400662f0 0x7f85400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.109+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f854c083380 con 0x7f855415b870 2023-05-21T16:54:15.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.109+0000 7f8553fff700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f85400662f0 0x7f85400687a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85440090b0 tx=0x7f854401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.117+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f854c050be0 con 0x7f855415b870 2023-05-21T16:54:15.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.285+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85540733b0 con 0x7f855415b870 2023-05-21T16:54:15.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.285+0000 7f8550ff9700 1 -- 172.21.15.46:0/1333866840 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14636 (secure 0 0 0) 0x7f854c00ce60 con 0x7f855415b870 2023-05-21T16:54:15.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:15.292 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:14.635644+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f85400662f0 msgr2=0x7f85400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f85400662f0 0x7f85400687a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85440090b0 tx=0x7f854401c040 comp rx=0 tx=0).stop 2023-05-21T16:54:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 msgr2=0x7f8554150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 0x7f8554150b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f854c00cb40 tx=0x7f854c00cc20 comp rx=0 tx=0).stop 2023-05-21T16:54:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 shutdown_connections 2023-05-21T16:54:15.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f85400662f0 0x7f85400687a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855415b870 0x7f8554150b60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8554154de0 0x7f85540ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 --2- 172.21.15.46:0/1333866840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85540caea0 0x7f8554157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 >> 172.21.15.46:0/1333866840 conn(0x7f85540cf720 msgr2=0x7f855406ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 shutdown_connections 2023-05-21T16:54:15.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.289+0000 7f8559234700 1 -- 172.21.15.46:0/1333866840 wait complete. 2023-05-21T16:54:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:15.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:15.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.417+0000 7fb0b5a67700 1 Processor -- start 2023-05-21T16:54:15.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.417+0000 7fb0b5a67700 1 -- start start 2023-05-21T16:54:15.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb0b006c760 0x7fb0b00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b015e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b015aea0 con 0x7fb0b0154de0 2023-05-21T16:54:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b015ac20 con 0x7fb0b006c760 2023-05-21T16:54:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0071790 con 0x7fb0b015e210 2023-05-21T16:54:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0affff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb0b006c760 0x7fb0b00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b4a65700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb0b0154de0 0x7fb0b015b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57220/0 (socket says 172.21.15.46:57220) 2023-05-21T16:54:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b4a65700 1 -- 172.21.15.46:0/4284146712 learned_addr learned my addr 172.21.15.46:0/4284146712 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:15.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5266700 1 --2- 172.21.15.46:0/4284146712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0affff700 1 -- 172.21.15.46:0/4284146712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 msgr2=0x7fb0b015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:15.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0affff700 1 --2- 172.21.15.46:0/4284146712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0af7fe700 1 -- 172.21.15.46:0/4284146712 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253963095 0 0) 0x7fb0b015aea0 con 0x7fb0b0154de0 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0affff700 1 -- 172.21.15.46:0/4284146712 >> v1:172.21.15.46:6789/0 conn(0x7fb0b0154de0 legacy=0x7fb0b015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0affff700 1 -- 172.21.15.46:0/4284146712 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b006cdd0 con 0x7fb0b006c760 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0affff700 1 --2- 172.21.15.46:0/4284146712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b00caea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009850 tx=0x7fb0a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0caa10feb00d339 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0af7fe700 1 -- 172.21.15.46:0/4284146712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011830 con 0x7fb0b006c760 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0af7fe700 1 -- 172.21.15.46:0/4284146712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0011990 con 0x7fb0b006c760 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0af7fe700 1 -- 172.21.15.46:0/4284146712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011d40 con 0x7fb0b006c760 2023-05-21T16:54:15.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- 172.21.15.46:0/4284146712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 msgr2=0x7fb0b00caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/4284146712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b00caea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009850 tx=0x7fb0a0009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- 172.21.15.46:0/4284146712 shutdown_connections 2023-05-21T16:54:15.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/4284146712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/4284146712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b00caea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- 172.21.15.46:0/4284146712 >> 172.21.15.46:0/4284146712 conn(0x7fb0b00cf720 msgr2=0x7fb0b00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.421+0000 7fb0b5a67700 1 -- 172.21.15.46:0/4284146712 shutdown_connections 2023-05-21T16:54:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 -- 172.21.15.46:0/4284146712 wait complete. 2023-05-21T16:54:15.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 Processor -- start 2023-05-21T16:54:15.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 -- start start 2023-05-21T16:54:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b01effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b0154de0 0x7fb0b00aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b00afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b0270 con 0x7fb0b006c760 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c25d0 con 0x7fb0b0154de0 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.425+0000 7fb0b5a67700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c2870 con 0x7fb0b015e210 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b01effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b01effe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58568/0 (socket says 172.21.15.46:58568) 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 -- 172.21.15.46:0/1351048402 learned_addr learned my addr 172.21.15.46:0/1351048402 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:15.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0affff700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b0154de0 0x7fb0b00aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b5266700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b00afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 -- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 msgr2=0x7fb0b00afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b00afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 -- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b0154de0 msgr2=0x7fb0b00aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b0154de0 0x7fb0b00aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 -- 172.21.15.46:0/1351048402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094b0 con 0x7fb0b006c760 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b5266700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b00afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:15.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b4a65700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b01effe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c580 tx=0x7fb0a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4004ca0 con 0x7fb0b006c760 2023-05-21T16:54:15.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4004e20 con 0x7fb0b006c760 2023-05-21T16:54:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b006d390 con 0x7fb0b006c760 2023-05-21T16:54:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007310 con 0x7fb0b006c760 2023-05-21T16:54:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b006d0b0 con 0x7fb0b006c760 2023-05-21T16:54:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b015ba40 con 0x7fb0b006c760 2023-05-21T16:54:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.429+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0a4007470 con 0x7fb0b006c760 2023-05-21T16:54:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.433+0000 7fb0ad7fa700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb09c0662f0 0x7fb09c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.433+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0a4083730 con 0x7fb0b006c760 2023-05-21T16:54:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.433+0000 7fb0affff700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb09c0662f0 0x7fb09c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.433+0000 7fb0affff700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb09c0662f0 0x7fb09c0687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00090b0 tx=0x7fb0a001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.437+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb0a4050f00 con 0x7fb0b006c760 2023-05-21T16:54:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.593+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0b00733b0 con 0x7fb0b006c760 2023-05-21T16:54:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0ad7fa700 1 -- 172.21.15.46:0/1351048402 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0a4007720 con 0x7fb0b006c760 2023-05-21T16:54:15.601 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb09c0662f0 msgr2=0x7fb09c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb09c0662f0 0x7fb09c0687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00090b0 tx=0x7fb0a001c040 comp rx=0 tx=0).stop 2023-05-21T16:54:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 msgr2=0x7fb0b01effe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b01effe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c580 tx=0x7fb0a400c940 comp rx=0 tx=0).stop 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 shutdown_connections 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb09c0662f0 0x7fb09c0687a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0b015e210 0x7fb0b00afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b0154de0 0x7fb0b00aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 --2- 172.21.15.46:0/1351048402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b006c760 0x7fb0b01effe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 >> 172.21.15.46:0/1351048402 conn(0x7fb0b00cf720 msgr2=0x7fb0b0159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 shutdown_connections 2023-05-21T16:54:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.597+0000 7fb0b5a67700 1 -- 172.21.15.46:0/1351048402 wait complete. 2023-05-21T16:54:15.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9ab5b700 1 Processor -- start 2023-05-21T16:54:15.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9ab5b700 1 -- start start 2023-05-21T16:54:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9ab5b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c940cb340 0x7f1c940ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9ab5b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940c9510 con 0x7f1c940caab0 2023-05-21T16:54:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9ab5b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940c97b0 con 0x7f1c94069f80 2023-05-21T16:54:15.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9ab5b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c940c9a90 con 0x7f1c940cb340 2023-05-21T16:54:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c99358700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c940cb340 0x7f1c940ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c99358700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1c940cb340 0x7f1c940ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58582/0 (socket says 172.21.15.46:58582) 2023-05-21T16:54:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c9a35a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1c940caab0 0x7f1c940b1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57236/0 (socket says 172.21.15.46:57236) 2023-05-21T16:54:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.729+0000 7f1c99358700 1 -- 172.21.15.46:0/3153356103 learned_addr learned my addr 172.21.15.46:0/3153356103 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:15.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c99358700 1 -- 172.21.15.46:0/3153356103 >> v1:172.21.15.142:6789/0 conn(0x7f1c94069f80 legacy=0x7f1c9406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c99358700 1 -- 172.21.15.46:0/3153356103 >> v1:172.21.15.46:6789/0 conn(0x7f1c940caab0 legacy=0x7f1c940b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c99358700 1 -- 172.21.15.46:0/3153356103 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940c9d70 con 0x7f1c940cb340 2023-05-21T16:54:15.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c99358700 1 --2- 172.21.15.46:0/3153356103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940ca570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009e50 tx=0x7f1c9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3802db0ea6ecbc17 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c98b57700 1 -- 172.21.15.46:0/3153356103 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000e070 con 0x7f1c940cb340 2023-05-21T16:54:15.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c98b57700 1 -- 172.21.15.46:0/3153356103 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9000b9c0 con 0x7f1c940cb340 2023-05-21T16:54:15.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c98b57700 1 -- 172.21.15.46:0/3153356103 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000bd70 con 0x7f1c940cb340 2023-05-21T16:54:15.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/3153356103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 msgr2=0x7f1c940ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/3153356103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940ca570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009e50 tx=0x7f1c9000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:15.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/3153356103 shutdown_connections 2023-05-21T16:54:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/3153356103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940ca570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/3153356103 >> 172.21.15.46:0/3153356103 conn(0x7f1c940cb8a0 msgr2=0x7f1c940cbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/3153356103 shutdown_connections 2023-05-21T16:54:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/3153356103 wait complete. 2023-05-21T16:54:15.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 Processor -- start 2023-05-21T16:54:15.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.733+0000 7f1c9ab5b700 1 -- start start 2023-05-21T16:54:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 0x7f1c94159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c940caab0 0x7f1c940a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940a7a20 con 0x7f1c940cb340 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940ac7f0 con 0x7f1c94069f80 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940acad0 con 0x7f1c940caab0 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c99358700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c940caab0 0x7f1c940a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c99b59700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 0x7f1c94159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58598/0 (socket says 172.21.15.46:58598) 2023-05-21T16:54:15.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c99358700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c940caab0 0x7f1c940a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:56008/0 (socket says 172.21.15.46:56008) 2023-05-21T16:54:15.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 -- 172.21.15.46:0/4109751411 learned_addr learned my addr 172.21.15.46:0/4109751411 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:15.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c99b59700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 0x7f1c94159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:50910/0 (socket says 172.21.15.46:50910) 2023-05-21T16:54:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 -- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c940caab0 msgr2=0x7f1c940a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c940caab0 0x7f1c940a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 -- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 msgr2=0x7f1c94159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 0x7f1c94159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 -- 172.21.15.46:0/4109751411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009b30 con 0x7f1c940cb340 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c99b59700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 0x7f1c94159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9a35a700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940c7f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00c500 tx=0x7f1c8c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c005cd0 con 0x7f1c940cb340 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c005e30 con 0x7f1c940cb340 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c940b23c0 con 0x7f1c940cb340 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0072f0 con 0x7f1c940cb340 2023-05-21T16:54:15.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.737+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c940ca050 con 0x7f1c940cb340 2023-05-21T16:54:15.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.741+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c940b2550 con 0x7f1c940cb340 2023-05-21T16:54:15.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.741+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c8c007450 con 0x7f1c940cb340 2023-05-21T16:54:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.741+0000 7f1c8a7fc700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1c800662f0 0x7f1c800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.741+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1c8c082ce0 con 0x7f1c940cb340 2023-05-21T16:54:15.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.741+0000 7f1c99b59700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1c800662f0 0x7f1c800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:15.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.745+0000 7f1c99b59700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1c800662f0 0x7f1c800687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c84000f60 tx=0x7f1c84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:15.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.753+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1c8c050540 con 0x7f1c940cb340 2023-05-21T16:54:15.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.909+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c94073cb0 con 0x7f1c940cb340 2023-05-21T16:54:15.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.909+0000 7f1c8a7fc700 1 -- 172.21.15.46:0/4109751411 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c8c0170a0 con 0x7f1c940cb340 2023-05-21T16:54:15.915 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:15.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1c800662f0 msgr2=0x7f1c800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1c800662f0 0x7f1c800687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c84000f60 tx=0x7f1c84009040 comp rx=0 tx=0).stop 2023-05-21T16:54:15.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 msgr2=0x7f1c940c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:15.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940c7f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00c500 tx=0x7f1c8c00c810 comp rx=0 tx=0).stop 2023-05-21T16:54:15.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 shutdown_connections 2023-05-21T16:54:15.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1c800662f0 0x7f1c800687a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c940cb340 0x7f1c940c7f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c940caab0 0x7f1c940a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 --2- 172.21.15.46:0/4109751411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c94069f80 0x7f1c94159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:15.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 >> 172.21.15.46:0/4109751411 conn(0x7f1c940cb8a0 msgr2=0x7f1c940b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:15.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 shutdown_connections 2023-05-21T16:54:15.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:15.913+0000 7f1c9ab5b700 1 -- 172.21.15.46:0/4109751411 wait complete. 2023-05-21T16:54:15.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-21T16:54:16.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.033+0000 7fae2f59e700 1 Processor -- start 2023-05-21T16:54:16.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.033+0000 7fae2f59e700 1 -- start start 2023-05-21T16:54:16.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30158690 0x7fae300ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae30158a60 0x7fae300ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300cebd0 con 0x7fae30073860 2023-05-21T16:54:16.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3006dcf0 con 0x7fae30158a60 2023-05-21T16:54:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006dfd0 con 0x7fae30158690 2023-05-21T16:54:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2ed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fae30073860 0x7fae3006ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57240/0 (socket says 172.21.15.46:57240) 2023-05-21T16:54:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2ed9d700 1 -- 172.21.15.46:0/3752002331 learned_addr learned my addr 172.21.15.46:0/3752002331 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2dd9b700 1 --2- 172.21.15.46:0/3752002331 >> v2:172.21.15.142:3300/0 conn(0x7fae30158a60 0x7fae300ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2e59c700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30158690 0x7fae300ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2d59a700 1 -- 172.21.15.46:0/3752002331 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044311046 0 0) 0x7fae300cebd0 con 0x7fae30073860 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2d59a700 1 -- 172.21.15.46:0/3752002331 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae180057e0 con 0x7fae30073860 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30158690 msgr2=0x7fae300ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2dd9b700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30158690 0x7fae300ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3752002331 >> v1:172.21.15.46:6789/0 conn(0x7fae30073860 legacy=0x7fae3006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3752002331 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3006e2b0 con 0x7fae30158a60 2023-05-21T16:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2e59c700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30158690 0x7fae300ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2dd9b700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300ce690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae20009850 tx=0x7fae20009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57612515f8105a96 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2d59a700 1 -- 172.21.15.46:0/3752002331 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20011830 con 0x7fae30158a60 2023-05-21T16:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2d59a700 1 -- 172.21.15.46:0/3752002331 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20011990 con 0x7fae30158a60 2023-05-21T16:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2d59a700 1 -- 172.21.15.46:0/3752002331 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20011d00 con 0x7fae30158a60 2023-05-21T16:54:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 msgr2=0x7fae300ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300ce690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae20009850 tx=0x7fae20009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- 172.21.15.46:0/3752002331 shutdown_connections 2023-05-21T16:54:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300ce690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3752002331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30158690 0x7fae300ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- 172.21.15.46:0/3752002331 >> 172.21.15.46:0/3752002331 conn(0x7fae300cee50 msgr2=0x7fae300cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- 172.21.15.46:0/3752002331 shutdown_connections 2023-05-21T16:54:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.037+0000 7fae2f59e700 1 -- 172.21.15.46:0/3752002331 wait complete. 2023-05-21T16:54:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.041+0000 7fae2f59e700 1 Processor -- start 2023-05-21T16:54:16.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.041+0000 7fae2f59e700 1 -- start start 2023-05-21T16:54:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30073860 0x7fae300c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 0x7fae3015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3015b4f0 con 0x7fae30158690 2023-05-21T16:54:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3015b7d0 con 0x7fae30158a60 2023-05-21T16:54:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3015bab0 con 0x7fae30073860 2023-05-21T16:54:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 0x7fae3015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30073860 0x7fae300c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 0x7fae3015ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58602/0 (socket says 172.21.15.46:58602) 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3608975252 learned_addr learned my addr 172.21.15.46:0/3608975252 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3608975252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30073860 msgr2=0x7fae300c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30073860 0x7fae300c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3608975252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 msgr2=0x7fae300b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 -- 172.21.15.46:0/3608975252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240094b0 con 0x7fae30158690 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2dd9b700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 0x7fae3015ac30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae200090b0 tx=0x7fae20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20004450 con 0x7fae30158690 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2001e070 con 0x7fae30158690 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae200094b0 con 0x7fae30158690 2023-05-21T16:54:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20003900 con 0x7fae30158690 2023-05-21T16:54:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.045+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3006b830 con 0x7fae30158690 2023-05-21T16:54:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.049+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3006e590 con 0x7fae30158690 2023-05-21T16:54:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.049+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae20003a60 con 0x7fae30158690 2023-05-21T16:54:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.049+0000 7fae1effd700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fae100662f0 0x7fae100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.049+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae20084690 con 0x7fae30158690 2023-05-21T16:54:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.049+0000 7fae2e59c700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fae100662f0 0x7fae100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.049+0000 7fae2e59c700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fae100662f0 0x7fae100687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae24009d80 tx=0x7fae24009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.057+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fae20051ef0 con 0x7fae30158690 2023-05-21T16:54:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.221+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fae300733b0 con 0x7fae30158690 2023-05-21T16:54:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.225+0000 7fae1effd700 1 -- 172.21.15.46:0/3608975252 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fae20006ce0 con 0x7fae30158690 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:16.229 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:54:16.230 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2023-05-21T16:54:16.230 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "rbd" 2023-05-21T16:54:16.230 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:54:16.230 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-05-21T16:54:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fae100662f0 msgr2=0x7fae100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fae100662f0 0x7fae100687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae24009d80 tx=0x7fae24009240 comp rx=0 tx=0).stop 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 msgr2=0x7fae3015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 0x7fae3015ac30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae200090b0 tx=0x7fae20004770 comp rx=0 tx=0).stop 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 shutdown_connections 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fae100662f0 0x7fae100687a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae30158a60 0x7fae300b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae30158690 0x7fae3015ac30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 --2- 172.21.15.46:0/3608975252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae30073860 0x7fae300c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 >> 172.21.15.46:0/3608975252 conn(0x7fae300cee50 msgr2=0x7fae300af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 shutdown_connections 2023-05-21T16:54:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.229+0000 7fae2f59e700 1 -- 172.21.15.46:0/3608975252 wait complete. 2023-05-21T16:54:16.250 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-21T16:54:16.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-21T16:54:16.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 Processor -- start 2023-05-21T16:54:16.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 -- start start 2023-05-21T16:54:16.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b8ad0 0x7f49440cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49440b5ce0 0x7f494406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49440b4910 0x7f49440b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440b52f0 con 0x7f49440b4910 2023-05-21T16:54:16.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440b8ea0 con 0x7f49440b5ce0 2023-05-21T16:54:16.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f494a165700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440d09d0 con 0x7f49440b8ad0 2023-05-21T16:54:16.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49440b4910 0x7f49440b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49440b4910 0x7f49440b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58610/0 (socket says 172.21.15.46:58610) 2023-05-21T16:54:16.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 -- 172.21.15.46:0/2418307825 learned_addr learned my addr 172.21.15.46:0/2418307825 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:16.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4948962700 1 --2- 172.21.15.46:0/2418307825 >> v2:172.21.15.142:3300/0 conn(0x7f49440b5ce0 0x7f494406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949163700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b8ad0 0x7f49440cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 -- 172.21.15.46:0/2418307825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b8ad0 msgr2=0x7f49440cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:16.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b8ad0 0x7f49440cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 -- 172.21.15.46:0/2418307825 >> v2:172.21.15.142:3300/0 conn(0x7f49440b5ce0 msgr2=0x7f494406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 --2- 172.21.15.46:0/2418307825 >> v2:172.21.15.142:3300/0 conn(0x7f49440b5ce0 0x7f494406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 -- 172.21.15.46:0/2418307825 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440d0cb0 con 0x7f49440b4910 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4948962700 1 --2- 172.21.15.46:0/2418307825 >> v2:172.21.15.142:3300/0 conn(0x7f49440b5ce0 0x7f494406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949163700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b8ad0 0x7f49440cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f4949964700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b4910 0x7f49440b4db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f49440d0980 tx=0x7f493c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56934fec68a95fc server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f493bfff700 1 -- 172.21.15.46:0/2418307825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00e070 con 0x7f49440b4910 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f493bfff700 1 -- 172.21.15.46:0/2418307825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c00b9c0 con 0x7f49440b4910 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.361+0000 7f493bfff700 1 -- 172.21.15.46:0/2418307825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00bd70 con 0x7f49440b4910 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- 172.21.15.46:0/2418307825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b4910 msgr2=0x7f49440b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b4910 0x7f49440b4db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f49440d0980 tx=0x7f493c00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- 172.21.15.46:0/2418307825 shutdown_connections 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b4910 0x7f49440b4db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- 172.21.15.46:0/2418307825 >> v2:172.21.15.142:3300/0 conn(0x7f49440b5ce0 0x7f494406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- 172.21.15.46:0/2418307825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b8ad0 0x7f49440cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- 172.21.15.46:0/2418307825 >> 172.21.15.46:0/2418307825 conn(0x7f49440d3ae0 msgr2=0x7f49440cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:16.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- 172.21.15.46:0/2418307825 shutdown_connections 2023-05-21T16:54:16.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- 172.21.15.46:0/2418307825 wait complete. 2023-05-21T16:54:16.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 Processor -- start 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- start start 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49440b4910 0x7f4944147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b5ce0 0x7f494415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 0x7f494415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c8950 con 0x7f49440b8ad0 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c8c30 con 0x7f49440b4910 2023-05-21T16:54:16.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f494a165700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c8f10 con 0x7f49440b5ce0 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f4949964700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 0x7f494415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f4949964700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 0x7f494415c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58616/0 (socket says 172.21.15.46:58616) 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f4949964700 1 -- 172.21.15.46:0/3886535670 learned_addr learned my addr 172.21.15.46:0/3886535670 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f4948962700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b5ce0 0x7f494415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.365+0000 7f4949163700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49440b4910 0x7f4944147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4949964700 1 -- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b5ce0 msgr2=0x7f494415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4949964700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b5ce0 0x7f494415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4949964700 1 -- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49440b4910 msgr2=0x7f4944147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4949964700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49440b4910 0x7f4944147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4949964700 1 -- 172.21.15.46:0/3886535670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c009b30 con 0x7f49440b8ad0 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4949964700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 0x7f494415c710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f49440b55f0 tx=0x7f493c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0099b0 con 0x7f49440b8ad0 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c004250 con 0x7f49440b8ad0 2023-05-21T16:54:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440cd790 con 0x7f49440b8ad0 2023-05-21T16:54:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0045e0 con 0x7f49440b8ad0 2023-05-21T16:54:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49440cd4f0 con 0x7f49440b8ad0 2023-05-21T16:54:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49440cda70 con 0x7f49440b8ad0 2023-05-21T16:54:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.369+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f493c004740 con 0x7f49440b8ad0 2023-05-21T16:54:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.373+0000 7f4939ffb700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49280662f0 0x7f49280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.373+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f493c084dc0 con 0x7f49440b8ad0 2023-05-21T16:54:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.373+0000 7f4949163700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49280662f0 0x7f49280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.373+0000 7f4949163700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49280662f0 0x7f49280687a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f493400c960 tx=0x7f4934008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.381+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f493c0526d0 con 0x7f49440b8ad0 2023-05-21T16:54:16.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:54:16.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:54:16.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.545+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49440733b0 con 0x7f49440b8ad0 2023-05-21T16:54:16.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.753+0000 7f4939ffb700 1 -- 172.21.15.46:0/3886535670 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f493c0200b0 con 0x7f49440b8ad0 2023-05-21T16:54:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49280662f0 msgr2=0x7f49280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49280662f0 0x7f49280687a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f493400c960 tx=0x7f4934008040 comp rx=0 tx=0).stop 2023-05-21T16:54:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 msgr2=0x7f494415c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 0x7f494415c710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f49440b55f0 tx=0x7f493c004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 shutdown_connections 2023-05-21T16:54:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49280662f0 0x7f49280687a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49440b8ad0 0x7f494415c710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49440b5ce0 0x7f494415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 --2- 172.21.15.46:0/3886535670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49440b4910 0x7f4944147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.757+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 >> 172.21.15.46:0/3886535670 conn(0x7f49440d3ae0 msgr2=0x7f4944069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.761+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 shutdown_connections 2023-05-21T16:54:16.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.761+0000 7f494a165700 1 -- 172.21.15.46:0/3886535670 wait complete. 2023-05-21T16:54:16.768 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-05-21T16:54:16.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-21T16:54:16.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.901+0000 7f327359e700 1 Processor -- start 2023-05-21T16:54:16.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.901+0000 7f327359e700 1 -- start start 2023-05-21T16:54:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274160a00 0x7f3274164f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3274069f80 0x7f327406a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3274070ed0 0x7f3274071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32740c45d0 con 0x7f3274070ed0 2023-05-21T16:54:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32740cd9c0 con 0x7f3274069f80 2023-05-21T16:54:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32741654b0 con 0x7f3274160a00 2023-05-21T16:54:16.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3274070ed0 0x7f3274071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3274070ed0 0x7f3274071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58628/0 (socket says 172.21.15.46:58628) 2023-05-21T16:54:16.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 -- 172.21.15.46:0/3554144707 learned_addr learned my addr 172.21.15.46:0/3554144707 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:16.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3271d9b700 1 --2- 172.21.15.46:0/3554144707 >> v2:172.21.15.142:3300/0 conn(0x7f3274069f80 0x7f327406a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327259c700 1 --2- 172.21.15.46:0/3554144707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274160a00 0x7f3274164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 -- 172.21.15.46:0/3554144707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274160a00 msgr2=0x7f3274164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 --2- 172.21.15.46:0/3554144707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274160a00 0x7f3274164f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 -- 172.21.15.46:0/3554144707 >> v2:172.21.15.142:3300/0 conn(0x7f3274069f80 msgr2=0x7f327406a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 --2- 172.21.15.46:0/3554144707 >> v2:172.21.15.142:3300/0 conn(0x7f3274069f80 0x7f327406a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 -- 172.21.15.46:0/3554144707 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274071860 con 0x7f3274070ed0 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f3272d9d700 1 --2- 172.21.15.46:0/3554144707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f3274071320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f327406e0b0 tx=0x7f326c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600ca18f3a548b1a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327159a700 1 -- 172.21.15.46:0/3554144707 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00e070 con 0x7f3274070ed0 2023-05-21T16:54:16.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327159a700 1 -- 172.21.15.46:0/3554144707 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00b910 con 0x7f3274070ed0 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327159a700 1 -- 172.21.15.46:0/3554144707 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00bcc0 con 0x7f3274070ed0 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- 172.21.15.46:0/3554144707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 msgr2=0x7f3274071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- 172.21.15.46:0/3554144707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f3274071320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f327406e0b0 tx=0x7f326c00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- 172.21.15.46:0/3554144707 shutdown_connections 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- 172.21.15.46:0/3554144707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f3274071320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- 172.21.15.46:0/3554144707 >> v2:172.21.15.142:3300/0 conn(0x7f3274069f80 0x7f327406a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 --2- 172.21.15.46:0/3554144707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274160a00 0x7f3274164f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- 172.21.15.46:0/3554144707 >> 172.21.15.46:0/3554144707 conn(0x7f32740cfeb0 msgr2=0x7f32740cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:16.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- 172.21.15.46:0/3554144707 shutdown_connections 2023-05-21T16:54:16.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.905+0000 7f327359e700 1 -- 172.21.15.46:0/3554144707 wait complete. 2023-05-21T16:54:16.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.909+0000 7f327359e700 1 Processor -- start 2023-05-21T16:54:16.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.909+0000 7f327359e700 1 -- start start 2023-05-21T16:54:16.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274069f80 0x7f327415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f327415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3274160a00 0x7f327406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32741601e0 con 0x7f3274070ed0 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32741f9350 con 0x7f3274160a00 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32741f9630 con 0x7f3274069f80 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f327415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f327415fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58640/0 (socket says 172.21.15.46:58640) 2023-05-21T16:54:16.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 -- 172.21.15.46:0/3040116127 learned_addr learned my addr 172.21.15.46:0/3040116127 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:16.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327259c700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274069f80 0x7f327415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3272d9d700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3274160a00 0x7f327406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 -- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274069f80 msgr2=0x7f327415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274069f80 0x7f327415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 -- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3274160a00 msgr2=0x7f327406ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3274160a00 0x7f327406ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 -- 172.21.15.46:0/3040116127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c009b30 con 0x7f3274070ed0 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3271d9b700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f327415fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f326800e940 tx=0x7f326800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268013680 con 0x7f3274070ed0 2023-05-21T16:54:16.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32680137e0 con 0x7f3274070ed0 2023-05-21T16:54:16.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32740cd400 con 0x7f3274070ed0 2023-05-21T16:54:16.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268013b70 con 0x7f3274070ed0 2023-05-21T16:54:16.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.913+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32740cd120 con 0x7f3274070ed0 2023-05-21T16:54:16.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.917+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32740cd6e0 con 0x7f3274070ed0 2023-05-21T16:54:16.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.917+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3268013cd0 con 0x7f3274070ed0 2023-05-21T16:54:16.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.917+0000 7f3262ffd700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32540662f0 0x7f32540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:16.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.917+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3268083b10 con 0x7f3274070ed0 2023-05-21T16:54:16.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.917+0000 7f327259c700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32540662f0 0x7f32540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:16.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.917+0000 7f327259c700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32540662f0 0x7f32540687a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3264009b50 tx=0x7f3264009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:16.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:16.925+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3268054b60 con 0x7f3274070ed0 2023-05-21T16:54:17.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.093+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3274073cb0 con 0x7f3274070ed0 2023-05-21T16:54:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.765+0000 7f3262ffd700 1 -- 172.21.15.46:0/3040116127 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f32680170d0 con 0x7f3274070ed0 2023-05-21T16:54:17.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.777+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32540662f0 msgr2=0x7f32540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:17.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.777+0000 7f327359e700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32540662f0 0x7f32540687a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3264009b50 tx=0x7f3264009240 comp rx=0 tx=0).stop 2023-05-21T16:54:17.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.777+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 msgr2=0x7f327415fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:17.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.777+0000 7f327359e700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f327415fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f326800e940 tx=0x7f326800ec50 comp rx=0 tx=0).stop 2023-05-21T16:54:17.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.781+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 shutdown_connections 2023-05-21T16:54:17.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.781+0000 7f327359e700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32540662f0 0x7f32540687a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.781+0000 7f327359e700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3274160a00 0x7f327406ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.781+0000 7f327359e700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3274070ed0 0x7f327415fca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.781+0000 7f327359e700 1 --2- 172.21.15.46:0/3040116127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3274069f80 0x7f327415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.781+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 >> 172.21.15.46:0/3040116127 conn(0x7f32740cfeb0 msgr2=0x7f327406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.785+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 shutdown_connections 2023-05-21T16:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.785+0000 7f327359e700 1 -- 172.21.15.46:0/3040116127 wait complete. 2023-05-21T16:54:17.791 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-05-21T16:54:17.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-21T16:54:17.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 Processor -- start 2023-05-21T16:54:17.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 -- start start 2023-05-21T16:54:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48bc15ca20 0x7f48bc06b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0b5370 con 0x7f48bc0b49e0 2023-05-21T16:54:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0d0e60 con 0x7f48bc15ca20 2023-05-21T16:54:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48c0eff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0d1420 con 0x7f48bc0d28c0 2023-05-21T16:54:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48ba59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48bc15ca20 0x7f48bc06b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc0b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:56060/0 (socket says 172.21.15.46:56060) 2023-05-21T16:54:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 -- 172.21.15.46:0/1001154692 learned_addr learned my addr 172.21.15.46:0/1001154692 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 -- 172.21.15.46:0/1001154692 >> v2:172.21.15.142:3300/0 conn(0x7f48bc15ca20 msgr2=0x7f48bc06b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 --2- 172.21.15.46:0/1001154692 >> v2:172.21.15.142:3300/0 conn(0x7f48bc15ca20 0x7f48bc06b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 -- 172.21.15.46:0/1001154692 >> v1:172.21.15.142:6789/0 conn(0x7f48bc0b49e0 legacy=0x7f48bc069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 -- 172.21.15.46:0/1001154692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0cd920 con 0x7f48bc0d28c0 2023-05-21T16:54:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48ba59c700 1 --2- 172.21.15.46:0/1001154692 >> v2:172.21.15.142:3300/0 conn(0x7f48bc15ca20 0x7f48bc06b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.917+0000 7f48bad9d700 1 --2- 172.21.15.46:0/1001154692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc0b4e30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009e50 tx=0x7f48b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb975520aa58fda server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48b959a700 1 -- 172.21.15.46:0/1001154692 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400e070 con 0x7f48bc0d28c0 2023-05-21T16:54:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48b959a700 1 -- 172.21.15.46:0/1001154692 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b400b910 con 0x7f48bc0d28c0 2023-05-21T16:54:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48b959a700 1 -- 172.21.15.46:0/1001154692 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400bcc0 con 0x7f48bc0d28c0 2023-05-21T16:54:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 -- 172.21.15.46:0/1001154692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 msgr2=0x7f48bc0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 --2- 172.21.15.46:0/1001154692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc0b4e30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009e50 tx=0x7f48b400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:17.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 -- 172.21.15.46:0/1001154692 shutdown_connections 2023-05-21T16:54:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 --2- 172.21.15.46:0/1001154692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc0b4e30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 --2- 172.21.15.46:0/1001154692 >> v2:172.21.15.142:3300/0 conn(0x7f48bc15ca20 0x7f48bc06b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 -- 172.21.15.46:0/1001154692 >> 172.21.15.46:0/1001154692 conn(0x7f48bc06cd50 msgr2=0x7f48bc0d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 -- 172.21.15.46:0/1001154692 shutdown_connections 2023-05-21T16:54:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 -- 172.21.15.46:0/1001154692 wait complete. 2023-05-21T16:54:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 Processor -- start 2023-05-21T16:54:17.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.921+0000 7f48c0eff700 1 -- start start 2023-05-21T16:54:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48bc0b49e0 0x7f48bc159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc1f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:17.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 0x7f48bc1f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:17.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1f2fe0 con 0x7f48bc15ca20 2023-05-21T16:54:17.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc15aad0 con 0x7f48bc0b49e0 2023-05-21T16:54:17.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1f55f0 con 0x7f48bc0d28c0 2023-05-21T16:54:17.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 0x7f48bc1f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:17.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 0x7f48bc1f2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58644/0 (socket says 172.21.15.46:58644) 2023-05-21T16:54:17.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 -- 172.21.15.46:0/224452020 learned_addr learned my addr 172.21.15.46:0/224452020 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:17.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48ba59c700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48bc0b49e0 0x7f48bc159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:17.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48b9d9b700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc1f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:17.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 -- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 msgr2=0x7f48bc1f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:17.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc1f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 -- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48bc0b49e0 msgr2=0x7f48bc159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48bc0b49e0 0x7f48bc159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 -- 172.21.15.46:0/224452020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0094b0 con 0x7f48bc15ca20 2023-05-21T16:54:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48bad9d700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 0x7f48bc1f2aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0d1560 tx=0x7f48b4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40048c0 con 0x7f48bc15ca20 2023-05-21T16:54:17.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b40092e0 con 0x7f48bc15ca20 2023-05-21T16:54:17.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b4009b30 con 0x7f48bc15ca20 2023-05-21T16:54:17.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc0d10b0 con 0x7f48bc15ca20 2023-05-21T16:54:17.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4025650 con 0x7f48bc15ca20 2023-05-21T16:54:17.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0cdc00 con 0x7f48bc15ca20 2023-05-21T16:54:17.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48b40257b0 con 0x7f48bc15ca20 2023-05-21T16:54:17.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.925+0000 7f48aaffd700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f489c0662f0 0x7f489c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:17.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.929+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f48b40857f0 con 0x7f48bc15ca20 2023-05-21T16:54:17.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.929+0000 7f48ba59c700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f489c0662f0 0x7f489c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:17.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.929+0000 7f48ba59c700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f489c0662f0 0x7f489c0687a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009ce0 tx=0x7f48ac009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:17.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:17.937+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48b4052ce0 con 0x7f48bc15ca20 2023-05-21T16:54:18.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.133+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f48bc06b850 con 0x7f48bc15ca20 2023-05-21T16:54:18.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.149+0000 7f48aaffd700 1 -- 172.21.15.46:0/224452020 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f48b4056300 con 0x7f48bc15ca20 2023-05-21T16:54:18.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f489c0662f0 msgr2=0x7f489c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f489c0662f0 0x7f489c0687a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009ce0 tx=0x7f48ac009240 comp rx=0 tx=0).stop 2023-05-21T16:54:18.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 msgr2=0x7f48bc1f2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 0x7f48bc1f2aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0d1560 tx=0x7f48b4004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 shutdown_connections 2023-05-21T16:54:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f489c0662f0 0x7f489c0687a0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009ce0 tx=0x7f48ac009240 comp rx=0 tx=0).stop 2023-05-21T16:54:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48bc15ca20 0x7f48bc1f2aa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48bc0d28c0 0x7f48bc1f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 --2- 172.21.15.46:0/224452020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48bc0b49e0 0x7f48bc159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.153+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 >> 172.21.15.46:0/224452020 conn(0x7f48bc06cd50 msgr2=0x7f48bc0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.157+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 shutdown_connections 2023-05-21T16:54:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.157+0000 7f48c0eff700 1 -- 172.21.15.46:0/224452020 wait complete. 2023-05-21T16:54:18.165 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 3 and data pool 4 2023-05-21T16:54:18.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf53fff700 1 Processor -- start 2023-05-21T16:54:18.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf53fff700 1 -- start start 2023-05-21T16:54:18.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf53fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf4c0e29f0 0x7fbf4c055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf53fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c007360 con 0x7fbf4c03b330 2023-05-21T16:54:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf53fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c053f70 con 0x7fbf4c038560 2023-05-21T16:54:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf53fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0e2dc0 con 0x7fbf4c0e29f0 2023-05-21T16:54:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf537fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbf4c03b330 0x7fbf4c057210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57254/0 (socket says 172.21.15.46:57254) 2023-05-21T16:54:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf537fe700 1 -- 172.21.15.46:0/2414331020 learned_addr learned my addr 172.21.15.46:0/2414331020 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf52ffd700 1 --2- 172.21.15.46:0/2414331020 >> v2:172.21.15.142:3300/0 conn(0x7fbf4c0e29f0 0x7fbf4c055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf51ffb700 1 -- 172.21.15.46:0/2414331020 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145646355 0 0) 0x7fbf4c007360 con 0x7fbf4c03b330 2023-05-21T16:54:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf51ffb700 1 -- 172.21.15.46:0/2414331020 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf400035d0 con 0x7fbf4c03b330 2023-05-21T16:54:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf52ffd700 1 -- 172.21.15.46:0/2414331020 >> v1:172.21.15.142:6789/0 conn(0x7fbf4c038560 legacy=0x7fbf4c03ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf52ffd700 1 -- 172.21.15.46:0/2414331020 >> v1:172.21.15.46:6789/0 conn(0x7fbf4c03b330 legacy=0x7fbf4c057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf52ffd700 1 -- 172.21.15.46:0/2414331020 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c006dc0 con 0x7fbf4c0e29f0 2023-05-21T16:54:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf52ffd700 1 --2- 172.21.15.46:0/2414331020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c055490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009850 tx=0x7fbf3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882c4366034e5a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf51ffb700 1 -- 172.21.15.46:0/2414331020 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c011830 con 0x7fbf4c0e29f0 2023-05-21T16:54:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf51ffb700 1 -- 172.21.15.46:0/2414331020 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c011990 con 0x7fbf4c0e29f0 2023-05-21T16:54:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.285+0000 7fbf51ffb700 1 -- 172.21.15.46:0/2414331020 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c011d40 con 0x7fbf4c0e29f0 2023-05-21T16:54:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 -- 172.21.15.46:0/2414331020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 msgr2=0x7fbf4c055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 --2- 172.21.15.46:0/2414331020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c055490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009850 tx=0x7fbf3c009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 -- 172.21.15.46:0/2414331020 shutdown_connections 2023-05-21T16:54:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 --2- 172.21.15.46:0/2414331020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c055490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 -- 172.21.15.46:0/2414331020 >> 172.21.15.46:0/2414331020 conn(0x7fbf4c055c20 msgr2=0x7fbf4c056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 -- 172.21.15.46:0/2414331020 shutdown_connections 2023-05-21T16:54:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 -- 172.21.15.46:0/2414331020 wait complete. 2023-05-21T16:54:18.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 Processor -- start 2023-05-21T16:54:18.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.289+0000 7fbf53fff700 1 -- start start 2023-05-21T16:54:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c038560 0x7fbf4c0e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 0x7fbf4c04ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c050270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c04f700 con 0x7fbf4c03b330 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0dfa80 con 0x7fbf4c0e29f0 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0df190 con 0x7fbf4c038560 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 0x7fbf4c04ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 0x7fbf4c04ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58650/0 (socket says 172.21.15.46:58650) 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 -- 172.21.15.46:0/3279854467 learned_addr learned my addr 172.21.15.46:0/3279854467 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf52ffd700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c038560 0x7fbf4c0e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf537fe700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c050270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 -- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c038560 msgr2=0x7fbf4c0e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c038560 0x7fbf4c0e5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 -- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 msgr2=0x7fbf4c050270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c050270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 -- 172.21.15.46:0/3279854467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0094b0 con 0x7fbf4c03b330 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf537fe700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c050270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf527fc700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 0x7fbf4c04ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf54066cf0 tx=0x7fbf540744a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54067100 con 0x7fbf4c03b330 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf54067260 con 0x7fbf4c03b330 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c053920 con 0x7fbf4c03b330 2023-05-21T16:54:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54092420 con 0x7fbf4c03b330 2023-05-21T16:54:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.293+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c007080 con 0x7fbf4c03b330 2023-05-21T16:54:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.297+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c053c00 con 0x7fbf4c03b330 2023-05-21T16:54:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.297+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf5408f020 con 0x7fbf4c03b330 2023-05-21T16:54:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.297+0000 7fbf4bfff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf340662f0 0x7fbf340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.297+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf540fd9a0 con 0x7fbf4c03b330 2023-05-21T16:54:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.297+0000 7fbf52ffd700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf340662f0 0x7fbf340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.297+0000 7fbf52ffd700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf340662f0 0x7fbf340687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0090b0 tx=0x7fbf3c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.301+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbf540cae20 con 0x7fbf4c03b330 2023-05-21T16:54:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.465+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf4c005570 con 0x7fbf4c03b330 2023-05-21T16:54:18.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf4bfff700 1 -- 172.21.15.46:0/3279854467 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7fbf54097020 con 0x7fbf4c03b330 2023-05-21T16:54:18.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:18.473 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:18.139702+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:18.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf340662f0 msgr2=0x7fbf340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf340662f0 0x7fbf340687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0090b0 tx=0x7fbf3c01c040 comp rx=0 tx=0).stop 2023-05-21T16:54:18.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 msgr2=0x7fbf4c04ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 0x7fbf4c04ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf54066cf0 tx=0x7fbf540744a0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 shutdown_connections 2023-05-21T16:54:18.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf340662f0 0x7fbf340687a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c0e29f0 0x7fbf4c050270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf4c03b330 0x7fbf4c04ec40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 --2- 172.21.15.46:0/3279854467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c038560 0x7fbf4c0e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 >> 172.21.15.46:0/3279854467 conn(0x7fbf4c055c20 msgr2=0x7fbf4c055ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:18.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 shutdown_connections 2023-05-21T16:54:18.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.469+0000 7fbf53fff700 1 -- 172.21.15.46:0/3279854467 wait complete. 2023-05-21T16:54:18.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:18.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.593+0000 7fb2e7331700 1 Processor -- start 2023-05-21T16:54:18.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.593+0000 7fb2e7331700 1 -- start start 2023-05-21T16:54:18.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.593+0000 7fb2e7331700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb2e006a810 0x7fb2e00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.593+0000 7fb2e7331700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e00caa40 0x7fb2e00cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e7331700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e01597d0 con 0x7fb2e0159400 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e7331700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e015cf00 con 0x7fb2e006a810 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e7331700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e006ad80 con 0x7fb2e00caa40 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e632f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb2e0159400 0x7fb2e0071f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57264/0 (socket says 172.21.15.46:57264) 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e632f700 1 -- 172.21.15.46:0/3801636498 learned_addr learned my addr 172.21.15.46:0/3801636498 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e5b2e700 1 --2- 172.21.15.46:0/3801636498 >> v2:172.21.15.46:3300/0 conn(0x7fb2e006a810 0x7fb2e00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e6b30700 1 --2- 172.21.15.46:0/3801636498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e00caa40 0x7fb2e00cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e5b2e700 1 -- 172.21.15.46:0/3801636498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e00caa40 msgr2=0x7fb2e00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e5b2e700 1 --2- 172.21.15.46:0/3801636498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e00caa40 0x7fb2e00cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e5b2e700 1 -- 172.21.15.46:0/3801636498 >> v1:172.21.15.46:6789/0 conn(0x7fb2e0159400 legacy=0x7fb2e0071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e5b2e700 1 -- 172.21.15.46:0/3801636498 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e006b060 con 0x7fb2e006a810 2023-05-21T16:54:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e5b2e700 1 --2- 172.21.15.46:0/3801636498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e006a810 0x7fb2e00ca500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009850 tx=0x7fb2d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6779039fd5d75cfc server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.597+0000 7fb2e532d700 1 -- 172.21.15.46:0/3801636498 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0011830 con 0x7fb2e006a810 2023-05-21T16:54:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e532d700 1 -- 172.21.15.46:0/3801636498 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0011990 con 0x7fb2e006a810 2023-05-21T16:54:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e532d700 1 -- 172.21.15.46:0/3801636498 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0011d40 con 0x7fb2e006a810 2023-05-21T16:54:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 -- 172.21.15.46:0/3801636498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e006a810 msgr2=0x7fb2e00ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 --2- 172.21.15.46:0/3801636498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e006a810 0x7fb2e00ca500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009850 tx=0x7fb2d0009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 -- 172.21.15.46:0/3801636498 shutdown_connections 2023-05-21T16:54:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 --2- 172.21.15.46:0/3801636498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e00caa40 0x7fb2e00cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 --2- 172.21.15.46:0/3801636498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e006a810 0x7fb2e00ca500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 -- 172.21.15.46:0/3801636498 >> 172.21.15.46:0/3801636498 conn(0x7fb2e00cbd90 msgr2=0x7fb2e00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 -- 172.21.15.46:0/3801636498 shutdown_connections 2023-05-21T16:54:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 -- 172.21.15.46:0/3801636498 wait complete. 2023-05-21T16:54:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 Processor -- start 2023-05-21T16:54:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 -- start start 2023-05-21T16:54:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e006a810 0x7fb2e014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e00caa40 0x7fb2e00c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.601+0000 7fb2e7331700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 0x7fb2e00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e7331700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e014ed50 con 0x7fb2e0159400 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e7331700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00a7550 con 0x7fb2e00caa40 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e7331700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0155ce0 con 0x7fb2e006a810 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 0x7fb2e00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 0x7fb2e00c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58666/0 (socket says 172.21.15.46:58666) 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 -- 172.21.15.46:0/2956587687 learned_addr learned my addr 172.21.15.46:0/2956587687 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e632f700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e006a810 0x7fb2e014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e5b2e700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e00caa40 0x7fb2e00c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 -- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e006a810 msgr2=0x7fb2e014e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e006a810 0x7fb2e014e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 -- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e00caa40 msgr2=0x7fb2e00c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e00caa40 0x7fb2e00c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 -- 172.21.15.46:0/2956587687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00094b0 con 0x7fb2e0159400 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e6b30700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 0x7fb2e00c8560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800efc0 tx=0x7fb2d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800cc90 con 0x7fb2e0159400 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800f040 con 0x7fb2e0159400 2023-05-21T16:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e006b620 con 0x7fb2e0159400 2023-05-21T16:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80146c0 con 0x7fb2e0159400 2023-05-21T16:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e006b340 con 0x7fb2e0159400 2023-05-21T16:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e00ce410 con 0x7fb2e0159400 2023-05-21T16:54:18.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.605+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2d8014820 con 0x7fb2e0159400 2023-05-21T16:54:18.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.609+0000 7fb2d6ffd700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2c40662f0 0x7fb2c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.609+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2d8084860 con 0x7fb2e0159400 2023-05-21T16:54:18.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.609+0000 7fb2e632f700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2c40662f0 0x7fb2c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.609+0000 7fb2e632f700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2c40662f0 0x7fb2c40687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005930 tx=0x7fb2dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.613+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb2d8055770 con 0x7fb2e0159400 2023-05-21T16:54:18.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.777+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2e00733b0 con 0x7fb2e0159400 2023-05-21T16:54:18.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.777+0000 7fb2d6ffd700 1 -- 172.21.15.46:0/2956587687 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7fb2d8018090 con 0x7fb2e0159400 2023-05-21T16:54:18.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:18.784 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:18.139702+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:18.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2c40662f0 msgr2=0x7fb2c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2c40662f0 0x7fb2c40687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005930 tx=0x7fb2dc009040 comp rx=0 tx=0).stop 2023-05-21T16:54:18.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 msgr2=0x7fb2e00c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 0x7fb2e00c8560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800efc0 tx=0x7fb2d800c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 shutdown_connections 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2c40662f0 0x7fb2c40687a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2e0159400 0x7fb2e00c8560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2e00caa40 0x7fb2e00c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 --2- 172.21.15.46:0/2956587687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2e006a810 0x7fb2e014e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 >> 172.21.15.46:0/2956587687 conn(0x7fb2e00cbd90 msgr2=0x7fb2e00b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 shutdown_connections 2023-05-21T16:54:18.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.781+0000 7fb2e7331700 1 -- 172.21.15.46:0/2956587687 wait complete. 2023-05-21T16:54:18.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-21T16:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 Processor -- start 2023-05-21T16:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 -- start start 2023-05-21T16:54:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bcc070250 0x7f5bcc15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5bcc070620 0x7f5bcc06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc06db30 con 0x7f5bcc070620 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0cb1d0 con 0x7f5bcc070250 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.913+0000 7f5bd1c8e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc15efc0 con 0x7f5bcc0ccdd0 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5bcc070620 0x7f5bcc06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5bcc070620 0x7f5bcc06df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58674/0 (socket says 172.21.15.46:58674) 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 -- 172.21.15.46:0/2938793090 learned_addr learned my addr 172.21.15.46:0/2938793090 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bcbfff700 1 --2- 172.21.15.46:0/2938793090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd0c8c700 1 --2- 172.21.15.46:0/2938793090 >> v2:172.21.15.142:3300/0 conn(0x7f5bcc070250 0x7f5bcc15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 -- 172.21.15.46:0/2938793090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 msgr2=0x7f5bcc0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 --2- 172.21.15.46:0/2938793090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 -- 172.21.15.46:0/2938793090 >> v2:172.21.15.142:3300/0 conn(0x7f5bcc070250 msgr2=0x7f5bcc15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 --2- 172.21.15.46:0/2938793090 >> v2:172.21.15.142:3300/0 conn(0x7f5bcc070250 0x7f5bcc15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 -- 172.21.15.46:0/2938793090 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0cb9a0 con 0x7f5bcc070620 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd148d700 1 --2- 172.21.15.46:0/2938793090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070620 0x7f5bcc06df50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc072680 tx=0x7f5bc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f468aef437cd7d04 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bcb7fe700 1 -- 172.21.15.46:0/2938793090 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400e070 con 0x7f5bcc070620 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bcb7fe700 1 -- 172.21.15.46:0/2938793090 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc400b910 con 0x7f5bcc070620 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bcb7fe700 1 -- 172.21.15.46:0/2938793090 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400bcc0 con 0x7f5bcc070620 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/2938793090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070620 msgr2=0x7f5bcc06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/2938793090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070620 0x7f5bcc06df50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc072680 tx=0x7f5bc400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/2938793090 shutdown_connections 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/2938793090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070620 0x7f5bcc06df50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/2938793090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/2938793090 >> v2:172.21.15.142:3300/0 conn(0x7f5bcc070250 0x7f5bcc15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/2938793090 >> 172.21.15.46:0/2938793090 conn(0x7f5bcc0d0b80 msgr2=0x7f5bcc0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/2938793090 shutdown_connections 2023-05-21T16:54:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.917+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/2938793090 wait complete. 2023-05-21T16:54:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 Processor -- start 2023-05-21T16:54:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 -- start start 2023-05-21T16:54:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 0x7f5bcc157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bcc070620 0x7f5bcc15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b1fc0 con 0x7f5bcc070250 2023-05-21T16:54:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc157970 con 0x7f5bcc070620 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b13b0 con 0x7f5bcc0ccdd0 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 0x7f5bcc157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 0x7f5bcc157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58676/0 (socket says 172.21.15.46:58676) 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 -- 172.21.15.46:0/334796420 learned_addr learned my addr 172.21.15.46:0/334796420 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bcbfff700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bcc070620 0x7f5bcc15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd148d700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 -- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 msgr2=0x7f5bcc0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 -- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bcc070620 msgr2=0x7f5bcc15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:18.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bcc070620 0x7f5bcc15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:18.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 -- 172.21.15.46:0/334796420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4009b30 con 0x7f5bcc070250 2023-05-21T16:54:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd0c8c700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 0x7f5bcc157430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00e940 tx=0x7f5bbc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc013680 con 0x7f5bcc070250 2023-05-21T16:54:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0137e0 con 0x7f5bcc070250 2023-05-21T16:54:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc15a960 con 0x7f5bcc070250 2023-05-21T16:54:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.921+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc013b70 con 0x7f5bcc070250 2023-05-21T16:54:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.925+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc0b3f10 con 0x7f5bcc070250 2023-05-21T16:54:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.925+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc0cd270 con 0x7f5bcc070250 2023-05-21T16:54:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.925+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5bbc013cd0 con 0x7f5bcc070250 2023-05-21T16:54:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.925+0000 7f5bc97fa700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5bac0662f0 0x7f5bac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:18.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.929+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bbc083c00 con 0x7f5bcc070250 2023-05-21T16:54:18.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.929+0000 7f5bcbfff700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5bac0662f0 0x7f5bac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:18.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.929+0000 7f5bcbfff700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5bac0662f0 0x7f5bac0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0b60b0 tx=0x7f5bb4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:18.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:18.937+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5bbc08a080 con 0x7f5bcc070250 2023-05-21T16:54:19.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.141+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5bcc073cb0 con 0x7f5bcc070250 2023-05-21T16:54:19.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.769+0000 7f5bc97fa700 1 -- 172.21.15.46:0/334796420 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5bbc051080 con 0x7f5bcc070250 2023-05-21T16:54:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5bac0662f0 msgr2=0x7f5bac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5bac0662f0 0x7f5bac0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0b60b0 tx=0x7f5bb4009240 comp rx=0 tx=0).stop 2023-05-21T16:54:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 msgr2=0x7f5bcc157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 0x7f5bcc157430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00e940 tx=0x7f5bbc00ec50 comp rx=0 tx=0).stop 2023-05-21T16:54:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 shutdown_connections 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5bac0662f0 0x7f5bac0687a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bcc0ccdd0 0x7f5bcc0b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bcc070620 0x7f5bcc15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 --2- 172.21.15.46:0/334796420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bcc070250 0x7f5bcc157430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 >> 172.21.15.46:0/334796420 conn(0x7f5bcc0d0b80 msgr2=0x7f5bcc158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 shutdown_connections 2023-05-21T16:54:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.773+0000 7f5bd1c8e700 1 -- 172.21.15.46:0/334796420 wait complete. 2023-05-21T16:54:19.795 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-21T16:54:19.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-21T16:54:19.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 Processor -- start 2023-05-21T16:54:19.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 -- start start 2023-05-21T16:54:19.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32e00cd800 0x7f32e006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:19.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e00c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:19.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e006ed50 con 0x7f32e0142c60 2023-05-21T16:54:19.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e00cdff0 con 0x7f32e00cd800 2023-05-21T16:54:19.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e600b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00ce200 con 0x7f32e006e8f0 2023-05-21T16:54:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32e00cd800 0x7f32e006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f32e00cd800 0x7f32e006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58680/0 (socket says 172.21.15.46:58680) 2023-05-21T16:54:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 -- 172.21.15.46:0/3176869834 learned_addr learned my addr 172.21.15.46:0/3176869834 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:19.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e580a700 1 --2- 172.21.15.46:0/3176869834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e00c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:19.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 -- 172.21.15.46:0/3176869834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 msgr2=0x7f32e00c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:19.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 --2- 172.21.15.46:0/3176869834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e00c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 -- 172.21.15.46:0/3176869834 >> v1:172.21.15.142:6789/0 conn(0x7f32e0142c60 legacy=0x7f32e00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 -- 172.21.15.46:0/3176869834 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00ce4e0 con 0x7f32e00cd800 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.917+0000 7f32e4808700 1 --2- 172.21.15.46:0/3176869834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e00cd800 0x7f32e006e3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009910 tx=0x7f32d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c285feb2cc3563d server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32d7fff700 1 -- 172.21.15.46:0/3176869834 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011830 con 0x7f32e00cd800 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32d7fff700 1 -- 172.21.15.46:0/3176869834 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0011990 con 0x7f32e00cd800 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32d7fff700 1 -- 172.21.15.46:0/3176869834 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011d40 con 0x7f32e00cd800 2023-05-21T16:54:19.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 -- 172.21.15.46:0/3176869834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e00cd800 msgr2=0x7f32e006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 --2- 172.21.15.46:0/3176869834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e00cd800 0x7f32e006e3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009910 tx=0x7f32d0009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 -- 172.21.15.46:0/3176869834 shutdown_connections 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 --2- 172.21.15.46:0/3176869834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e00c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 --2- 172.21.15.46:0/3176869834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e00cd800 0x7f32e006e3b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 -- 172.21.15.46:0/3176869834 >> 172.21.15.46:0/3176869834 conn(0x7f32e00cfeb0 msgr2=0x7f32e00cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 -- 172.21.15.46:0/3176869834 shutdown_connections 2023-05-21T16:54:19.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 -- 172.21.15.46:0/3176869834 wait complete. 2023-05-21T16:54:19.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.921+0000 7f32e600b700 1 Processor -- start 2023-05-21T16:54:19.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 -- start start 2023-05-21T16:54:19.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e013b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:19.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0142c60 0x7f32e006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:19.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 0x7f32e006b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:19.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e013a6d0 con 0x7f32e013d860 2023-05-21T16:54:19.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e013caa0 con 0x7f32e0142c60 2023-05-21T16:54:19.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e013cd80 con 0x7f32e006e8f0 2023-05-21T16:54:19.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 0x7f32e006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 0x7f32e006b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58682/0 (socket says 172.21.15.46:58682) 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 -- 172.21.15.46:0/2485007728 learned_addr learned my addr 172.21.15.46:0/2485007728 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e5009700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e013b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e4808700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0142c60 0x7f32e006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 -- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 msgr2=0x7f32e013b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e013b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 -- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0142c60 msgr2=0x7f32e006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0142c60 0x7f32e006afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 -- 172.21.15.46:0/2485007728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d0009570 con 0x7f32e013d860 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e4808700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0142c60 0x7f32e006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e580a700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 0x7f32e006b510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32d800efc0 tx=0x7f32d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8009ea0 con 0x7f32e013d860 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d800f040 con 0x7f32e013d860 2023-05-21T16:54:19.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8014480 con 0x7f32e013d860 2023-05-21T16:54:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00c4160 con 0x7f32e013d860 2023-05-21T16:54:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.925+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e00ce7c0 con 0x7f32e013d860 2023-05-21T16:54:19.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.929+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e00ceaa0 con 0x7f32e013d860 2023-05-21T16:54:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.929+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32d80145e0 con 0x7f32e013d860 2023-05-21T16:54:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.929+0000 7f32d5ffb700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32c40662f0 0x7f32c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.929+0000 7f32e5009700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32c40662f0 0x7f32c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.929+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32d8084510 con 0x7f32e013d860 2023-05-21T16:54:19.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.929+0000 7f32e5009700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32c40662f0 0x7f32c40687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000f60 tx=0x7f32dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:19.937+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f32d8051a20 con 0x7f32e013d860 2023-05-21T16:54:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.145+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f32e013cbe0 con 0x7f32e013d860 2023-05-21T16:54:20.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.785+0000 7f32d5ffb700 1 -- 172.21.15.46:0/2485007728 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32e013cbe0 con 0x7f32e013d860 2023-05-21T16:54:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32c40662f0 msgr2=0x7f32c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32c40662f0 0x7f32c40687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000f60 tx=0x7f32dc009040 comp rx=0 tx=0).stop 2023-05-21T16:54:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 msgr2=0x7f32e006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 0x7f32e006b510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32d800efc0 tx=0x7f32d800c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 shutdown_connections 2023-05-21T16:54:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32c40662f0 0x7f32c40687a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e013d860 0x7f32e006b510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0142c60 0x7f32e006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 --2- 172.21.15.46:0/2485007728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32e006e8f0 0x7f32e013b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 >> 172.21.15.46:0/2485007728 conn(0x7f32e00cfeb0 msgr2=0x7f32e00ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:20.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 shutdown_connections 2023-05-21T16:54:20.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.793+0000 7f32e600b700 1 -- 172.21.15.46:0/2485007728 wait complete. 2023-05-21T16:54:20.814 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-21T16:54:20.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:54:20.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 Processor -- start 2023-05-21T16:54:20.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 -- start start 2023-05-21T16:54:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 0x7f8a6815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680ccec0 0x7f8a68070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a68159df0 con 0x7f8a68070ad0 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a68070f50 con 0x7f8a68158d90 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6815a280 con 0x7f8a680ccec0 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 0x7f8a6815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a66d9d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8a68070ad0 0x7f8a680cbc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:49344/0 (socket says 172.21.15.46:49344) 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a66d9d700 1 -- 172.21.15.46:0/1256977748 learned_addr learned my addr 172.21.15.46:0/1256977748 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a65d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680ccec0 0x7f8a68070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 0x7f8a6815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58694/0 (socket says 172.21.15.46:58694) 2023-05-21T16:54:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6559a700 1 -- 172.21.15.46:0/1256977748 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377667405 0 0) 0x7f8a68159df0 con 0x7f8a68070ad0 2023-05-21T16:54:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6559a700 1 -- 172.21.15.46:0/1256977748 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a500035d0 con 0x7f8a68070ad0 2023-05-21T16:54:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a65d9b700 1 -- 172.21.15.46:0/1256977748 >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 msgr2=0x7f8a6815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a65d9b700 1 --2- 172.21.15.46:0/1256977748 >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 0x7f8a6815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a65d9b700 1 -- 172.21.15.46:0/1256977748 >> v1:172.21.15.142:6789/0 conn(0x7f8a68070ad0 legacy=0x7f8a680cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a65d9b700 1 -- 172.21.15.46:0/1256977748 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a680cd730 con 0x7f8a680ccec0 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6659c700 1 --2- 172.21.15.46:0/1256977748 >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 0x7f8a6815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a65d9b700 1 --2- 172.21.15.46:0/1256977748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680ccec0 0x7f8a68070590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009d90 tx=0x7f8a5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9757ae019d6577b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.933+0000 7f8a6559a700 1 -- 172.21.15.46:0/1256977748 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800e070 con 0x7f8a680ccec0 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6559a700 1 -- 172.21.15.46:0/1256977748 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5800bb20 con 0x7f8a680ccec0 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6559a700 1 -- 172.21.15.46:0/1256977748 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58012430 con 0x7f8a680ccec0 2023-05-21T16:54:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- 172.21.15.46:0/1256977748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680ccec0 msgr2=0x7f8a68070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 --2- 172.21.15.46:0/1256977748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680ccec0 0x7f8a68070590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009d90 tx=0x7f8a5800b330 comp rx=0 tx=0).stop 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- 172.21.15.46:0/1256977748 shutdown_connections 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 --2- 172.21.15.46:0/1256977748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680ccec0 0x7f8a68070590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 --2- 172.21.15.46:0/1256977748 >> v2:172.21.15.46:3300/0 conn(0x7f8a68158d90 0x7f8a6815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- 172.21.15.46:0/1256977748 >> 172.21.15.46:0/1256977748 conn(0x7f8a680cf720 msgr2=0x7f8a680cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- 172.21.15.46:0/1256977748 shutdown_connections 2023-05-21T16:54:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- 172.21.15.46:0/1256977748 wait complete. 2023-05-21T16:54:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 Processor -- start 2023-05-21T16:54:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- start start 2023-05-21T16:54:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68070ad0 0x7f8a6814c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 0x7f8a680c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a68158d90 0x7f8a6815b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680b18e0 con 0x7f8a680ccec0 2023-05-21T16:54:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680c4ed0 con 0x7f8a68070ad0 2023-05-21T16:54:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.937+0000 7f8a6759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680c51b0 con 0x7f8a68158d90 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 0x7f8a680c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 0x7f8a680c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58702/0 (socket says 172.21.15.46:58702) 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 -- 172.21.15.46:0/3202973309 learned_addr learned my addr 172.21.15.46:0/3202973309 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a66d9d700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a68158d90 0x7f8a6815b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a6659c700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68070ad0 0x7f8a6814c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 -- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a68158d90 msgr2=0x7f8a6815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a68158d90 0x7f8a6815b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 -- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68070ad0 msgr2=0x7f8a6814c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68070ad0 0x7f8a6814c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 -- 172.21.15.46:0/3202973309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0094b0 con 0x7f8a680ccec0 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a6659c700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68070ad0 0x7f8a6814c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a65d9b700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 0x7f8a680c44f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a58014040 tx=0x7f8a58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58012430 con 0x7f8a680ccec0 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58020070 con 0x7f8a680ccec0 2023-05-21T16:54:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a58009a70 con 0x7f8a680ccec0 2023-05-21T16:54:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58004280 con 0x7f8a680ccec0 2023-05-21T16:54:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a681597a0 con 0x7f8a680ccec0 2023-05-21T16:54:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a681594c0 con 0x7f8a680ccec0 2023-05-21T16:54:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.941+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a580043e0 con 0x7f8a680ccec0 2023-05-21T16:54:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.945+0000 7f8a56ffd700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a480662f0 0x7f8a480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.945+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a58022070 con 0x7f8a680ccec0 2023-05-21T16:54:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.945+0000 7f8a6659c700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a480662f0 0x7f8a480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.945+0000 7f8a6659c700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a480662f0 0x7f8a480687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009d30 tx=0x7f8a5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:20.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:20.949+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8a58053180 con 0x7f8a680ccec0 2023-05-21T16:54:21.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.153+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a68159a80 con 0x7f8a680ccec0 2023-05-21T16:54:21.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.153+0000 7f8a56ffd700 1 -- 172.21.15.46:0/3202973309 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f8a580567a0 con 0x7f8a680ccec0 2023-05-21T16:54:21.158 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:21.158 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:54:21.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a480662f0 msgr2=0x7f8a480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a480662f0 0x7f8a480687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009d30 tx=0x7f8a5c008040 comp rx=0 tx=0).stop 2023-05-21T16:54:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 msgr2=0x7f8a680c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 0x7f8a680c44f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a58014040 tx=0x7f8a58004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 shutdown_connections 2023-05-21T16:54:21.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a480662f0 0x7f8a480687a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a68158d90 0x7f8a6815b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a680ccec0 0x7f8a680c44f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 --2- 172.21.15.46:0/3202973309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68070ad0 0x7f8a6814c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 >> 172.21.15.46:0/3202973309 conn(0x7f8a680cf720 msgr2=0x7f8a681e5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 shutdown_connections 2023-05-21T16:54:21.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.157+0000 7f8a6759e700 1 -- 172.21.15.46:0/3202973309 wait complete. 2023-05-21T16:54:21.163 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:54:21.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 Processor -- start 2023-05-21T16:54:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 -- start start 2023-05-21T16:54:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f593815d460 0x7f5938158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59380ccec0 0x7f59380cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5938070590 0x7f59380709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59381592d0 con 0x7f59380ccec0 2023-05-21T16:54:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593815a280 con 0x7f593815d460 2023-05-21T16:54:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593e281700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593815d830 con 0x7f5938070590 2023-05-21T16:54:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59380ccec0 0x7f59380cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59380ccec0 0x7f59380cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58712/0 (socket says 172.21.15.46:58712) 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 -- 172.21.15.46:0/36248469 learned_addr learned my addr 172.21.15.46:0/36248469 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593da80700 1 --2- 172.21.15.46:0/36248469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5938070590 0x7f59380709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593d27f700 1 --2- 172.21.15.46:0/36248469 >> v2:172.21.15.142:3300/0 conn(0x7f593815d460 0x7f5938158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 -- 172.21.15.46:0/36248469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5938070590 msgr2=0x7f59380709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 --2- 172.21.15.46:0/36248469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5938070590 0x7f59380709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 -- 172.21.15.46:0/36248469 >> v2:172.21.15.142:3300/0 conn(0x7f593815d460 msgr2=0x7f5938158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 --2- 172.21.15.46:0/36248469 >> v2:172.21.15.142:3300/0 conn(0x7f593815d460 0x7f5938158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 -- 172.21.15.46:0/36248469 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938159df0 con 0x7f59380ccec0 2023-05-21T16:54:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593d27f700 1 --2- 172.21.15.46:0/36248469 >> v2:172.21.15.142:3300/0 conn(0x7f593815d460 0x7f5938158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f593ca7e700 1 --2- 172.21.15.46:0/36248469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f59380cbc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f593806f520 tx=0x7f593400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f222ceadcde94b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f592ffff700 1 -- 172.21.15.46:0/36248469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400e070 con 0x7f59380ccec0 2023-05-21T16:54:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f592ffff700 1 -- 172.21.15.46:0/36248469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400b980 con 0x7f59380ccec0 2023-05-21T16:54:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.285+0000 7f592ffff700 1 -- 172.21.15.46:0/36248469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400bd30 con 0x7f59380ccec0 2023-05-21T16:54:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 -- 172.21.15.46:0/36248469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 msgr2=0x7f59380cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 --2- 172.21.15.46:0/36248469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f59380cbc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f593806f520 tx=0x7f593400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 -- 172.21.15.46:0/36248469 shutdown_connections 2023-05-21T16:54:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 --2- 172.21.15.46:0/36248469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5938070590 0x7f59380709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 --2- 172.21.15.46:0/36248469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f59380cbc20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 --2- 172.21.15.46:0/36248469 >> v2:172.21.15.142:3300/0 conn(0x7f593815d460 0x7f5938158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 -- 172.21.15.46:0/36248469 >> 172.21.15.46:0/36248469 conn(0x7f59380cf720 msgr2=0x7f59380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 -- 172.21.15.46:0/36248469 shutdown_connections 2023-05-21T16:54:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 -- 172.21.15.46:0/36248469 wait complete. 2023-05-21T16:54:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 Processor -- start 2023-05-21T16:54:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.289+0000 7f593e281700 1 -- start start 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5938070590 0x7f593814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f593814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f593815d460 0x7f59380b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380b43b0 con 0x7f59380ccec0 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380b18e0 con 0x7f5938070590 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593814ac80 con 0x7f593815d460 2023-05-21T16:54:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f593814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f593814c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58726/0 (socket says 172.21.15.46:58726) 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 -- 172.21.15.46:0/1211588255 learned_addr learned my addr 172.21.15.46:0/1211588255 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593d27f700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5938070590 0x7f593814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593da80700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f593815d460 0x7f59380b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 -- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f593815d460 msgr2=0x7f59380b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f593815d460 0x7f59380b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 -- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5938070590 msgr2=0x7f593814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5938070590 0x7f593814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 -- 172.21.15.46:0/1211588255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934009b30 con 0x7f59380ccec0 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593ca7e700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f593814c2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f593806e870 tx=0x7f5934004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934004450 con 0x7f59380ccec0 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59340045d0 con 0x7f59380ccec0 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934004980 con 0x7f59380ccec0 2023-05-21T16:54:21.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5938070ee0 con 0x7f59380ccec0 2023-05-21T16:54:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59380cd730 con 0x7f59380ccec0 2023-05-21T16:54:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59381594c0 con 0x7f59380ccec0 2023-05-21T16:54:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.293+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5934025450 con 0x7f59380ccec0 2023-05-21T16:54:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.297+0000 7f592dffb700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f591c0662f0 0x7f591c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.297+0000 7f593d27f700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f591c0662f0 0x7f591c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.297+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59340858a0 con 0x7f59380ccec0 2023-05-21T16:54:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.297+0000 7f593d27f700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f591c0662f0 0x7f591c0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5928006fd0 tx=0x7f5928008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.301+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5934056960 con 0x7f59380ccec0 2023-05-21T16:54:21.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.457+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59380733b0 con 0x7f59380ccec0 2023-05-21T16:54:21.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f592dffb700 1 -- 172.21.15.46:0/1211588255 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f59340564f0 con 0x7f59380ccec0 2023-05-21T16:54:21.466 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:21.466 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f591c0662f0 msgr2=0x7f591c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f591c0662f0 0x7f591c0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5928006fd0 tx=0x7f5928008040 comp rx=0 tx=0).stop 2023-05-21T16:54:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 msgr2=0x7f593814c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f593814c2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f593806e870 tx=0x7f5934004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 shutdown_connections 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f591c0662f0 0x7f591c0687a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f593815d460 0x7f59380b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380ccec0 0x7f593814c2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 --2- 172.21.15.46:0/1211588255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5938070590 0x7f593814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.461+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 >> 172.21.15.46:0/1211588255 conn(0x7f59380cf720 msgr2=0x7f5938069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.465+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 shutdown_connections 2023-05-21T16:54:21.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.465+0000 7f593e281700 1 -- 172.21.15.46:0/1211588255 wait complete. 2023-05-21T16:54:21.480 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-21T16:54:21.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:54:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 Processor -- start 2023-05-21T16:54:21.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- start start 2023-05-21T16:54:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc8015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc80070ca0 0x7fcc800ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80159df0 con 0x7fcc800ccec0 2023-05-21T16:54:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8015a280 con 0x7fcc80070ca0 2023-05-21T16:54:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cd730 con 0x7fcc80158d90 2023-05-21T16:54:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc85fce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc80070ca0 0x7fcc800ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc85fce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc80070ca0 0x7fcc800ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58728/0 (socket says 172.21.15.46:58728) 2023-05-21T16:54:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc85fce700 1 -- 172.21.15.46:0/3420086507 learned_addr learned my addr 172.21.15.46:0/3420086507 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:21.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc857cd700 1 --2- 172.21.15.46:0/3420086507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc8015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc857cd700 1 -- 172.21.15.46:0/3420086507 >> v2:172.21.15.46:3300/0 conn(0x7fcc80070ca0 msgr2=0x7fcc800ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc857cd700 1 --2- 172.21.15.46:0/3420086507 >> v2:172.21.15.46:3300/0 conn(0x7fcc80070ca0 0x7fcc800ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc857cd700 1 -- 172.21.15.46:0/3420086507 >> v1:172.21.15.142:6789/0 conn(0x7fcc800ccec0 legacy=0x7fcc80070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc857cd700 1 -- 172.21.15.46:0/3420086507 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc801594c0 con 0x7fcc80158d90 2023-05-21T16:54:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc857cd700 1 --2- 172.21.15.46:0/3420086507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc8015d460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009850 tx=0x7fcc70009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67e708ed425b8e54 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc77fff700 1 -- 172.21.15.46:0/3420086507 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70011830 con 0x7fcc80158d90 2023-05-21T16:54:21.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc77fff700 1 -- 172.21.15.46:0/3420086507 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70011990 con 0x7fcc80158d90 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc77fff700 1 -- 172.21.15.46:0/3420086507 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70011d40 con 0x7fcc80158d90 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- 172.21.15.46:0/3420086507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 msgr2=0x7fcc8015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 --2- 172.21.15.46:0/3420086507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc8015d460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009850 tx=0x7fcc70009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- 172.21.15.46:0/3420086507 shutdown_connections 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 --2- 172.21.15.46:0/3420086507 >> v2:172.21.15.46:3300/0 conn(0x7fcc80070ca0 0x7fcc800ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 --2- 172.21.15.46:0/3420086507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc8015d460 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- 172.21.15.46:0/3420086507 >> 172.21.15.46:0/3420086507 conn(0x7fcc800cf720 msgr2=0x7fcc800cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:21.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- 172.21.15.46:0/3420086507 shutdown_connections 2023-05-21T16:54:21.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.589+0000 7fcc867cf700 1 -- 172.21.15.46:0/3420086507 wait complete. 2023-05-21T16:54:21.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 Processor -- start 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 -- start start 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc80070ca0 0x7fcc80147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc800ccec0 0x7fcc80158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc800b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014f920 con 0x7fcc80070ca0 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014ea30 con 0x7fcc800ccec0 2023-05-21T16:54:21.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014ed10 con 0x7fcc80158d90 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc857cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc80070ca0 0x7fcc80147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc857cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc80070ca0 0x7fcc80147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58744/0 (socket says 172.21.15.46:58744) 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc800b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc857cd700 1 -- 172.21.15.46:0/1696092890 learned_addr learned my addr 172.21.15.46:0/1696092890 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc84fcc700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc800ccec0 0x7fcc80158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 -- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc800ccec0 msgr2=0x7fcc80158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc800ccec0 0x7fcc80158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 -- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc80070ca0 msgr2=0x7fcc80147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc80070ca0 0x7fcc80147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 -- 172.21.15.46:0/1696092890 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700094b0 con 0x7fcc80158d90 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc85fce700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc800b18e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800ef90 tx=0x7fcc7800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78003c40 con 0x7fcc80158d90 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80159a80 con 0x7fcc80158d90 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800f040 con 0x7fcc80158d90 2023-05-21T16:54:21.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78009e60 con 0x7fcc80158d90 2023-05-21T16:54:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.593+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc801597a0 con 0x7fcc80158d90 2023-05-21T16:54:21.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.597+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80159160 con 0x7fcc80158d90 2023-05-21T16:54:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.597+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc7800c880 con 0x7fcc80158d90 2023-05-21T16:54:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.597+0000 7fcc75ffb700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc640662f0 0x7fcc640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.597+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc78084d40 con 0x7fcc80158d90 2023-05-21T16:54:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.597+0000 7fcc857cd700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc640662f0 0x7fcc640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.597+0000 7fcc857cd700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc640662f0 0x7fcc640687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009ba0 tx=0x7fcc7001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.609+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcc780521c0 con 0x7fcc80158d90 2023-05-21T16:54:21.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.773+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc8014fa90 con 0x7fcc640662f0 2023-05-21T16:54:21.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.789+0000 7fcc75ffb700 1 -- 172.21.15.46:0/1696092890 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286717 (secure 0 0 0) 0x7fcc8014fa90 con 0x7fcc640662f0 2023-05-21T16:54:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:21.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc640662f0 msgr2=0x7fcc640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc640662f0 0x7fcc640687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009ba0 tx=0x7fcc7001c040 comp rx=0 tx=0).stop 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 msgr2=0x7fcc800b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc800b18e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800ef90 tx=0x7fcc7800c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 shutdown_connections 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc640662f0 0x7fcc640687a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc80158d90 0x7fcc800b18e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc800ccec0 0x7fcc80158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 --2- 172.21.15.46:0/1696092890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc80070ca0 0x7fcc80147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.793+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 >> 172.21.15.46:0/1696092890 conn(0x7fcc800cf720 msgr2=0x7fcc8006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:21.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.797+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 shutdown_connections 2023-05-21T16:54:21.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.797+0000 7fcc867cf700 1 -- 172.21.15.46:0/1696092890 wait complete. 2023-05-21T16:54:21.802 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:54:21.814 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-21T16:54:20.783062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82876,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":79616,"kb_avail":754891844,"statfs":{"total":773094113280,"available":773009248256,"internally_reserved":0,"allocated":3272704,"data_stored":1932967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81526784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031016"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507946+0000","last_change":"2023-05-21T16:54:18.173535+0000","last_active":"2023-05-21T16:54:19.507946+0000","last_peered":"2023-05-21T16:54:19.507946+0000","last_clean":"2023-05-21T16:54:19.507946+0000","last_became_active":"2023-05-21T16:54:18.172985+0000","last_became_peered":"2023-05-21T16:54:18.172985+0000","last_unstale":"2023-05-21T16:54:19.507946+0000","last_undegraded":"2023-05-21T16:54:19.507946+0000","last_fullsized":"2023-05-21T16:54:19.507946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:03:41.302203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955404+0000","last_change":"2023-05-21T16:54:18.168645+0000","last_active":"2023-05-21T16:54:19.955404+0000","last_peered":"2023-05-21T16:54:19.955404+0000","last_clean":"2023-05-21T16:54:19.955404+0000","last_became_active":"2023-05-21T16:54:18.168325+0000","last_became_peered":"2023-05-21T16:54:18.168325+0000","last_unstale":"2023-05-21T16:54:19.955404+0000","last_undegraded":"2023-05-21T16:54:19.955404+0000","last_fullsized":"2023-05-21T16:54:19.955404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231233+0000","last_change":"2023-05-21T16:54:18.174946+0000","last_active":"2023-05-21T16:54:19.231233+0000","last_peered":"2023-05-21T16:54:19.231233+0000","last_clean":"2023-05-21T16:54:19.231233+0000","last_became_active":"2023-05-21T16:54:18.174596+0000","last_became_peered":"2023-05-21T16:54:18.174596+0000","last_unstale":"2023-05-21T16:54:19.231233+0000","last_undegraded":"2023-05-21T16:54:19.231233+0000","last_fullsized":"2023-05-21T16:54:19.231233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153865+0000","last_change":"2023-05-21T16:54:18.168066+0000","last_active":"2023-05-21T16:54:19.153865+0000","last_peered":"2023-05-21T16:54:19.153865+0000","last_clean":"2023-05-21T16:54:19.153865+0000","last_became_active":"2023-05-21T16:54:18.167782+0000","last_became_peered":"2023-05-21T16:54:18.167782+0000","last_unstale":"2023-05-21T16:54:19.153865+0000","last_undegraded":"2023-05-21T16:54:19.153865+0000","last_fullsized":"2023-05-21T16:54:19.153865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:39:57.359288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151402+0000","last_change":"2023-05-21T16:54:18.179965+0000","last_active":"2023-05-21T16:54:19.151402+0000","last_peered":"2023-05-21T16:54:19.151402+0000","last_clean":"2023-05-21T16:54:19.151402+0000","last_became_active":"2023-05-21T16:54:18.179618+0000","last_became_peered":"2023-05-21T16:54:18.179618+0000","last_unstale":"2023-05-21T16:54:19.151402+0000","last_undegraded":"2023-05-21T16:54:19.151402+0000","last_fullsized":"2023-05-21T16:54:19.151402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230210+0000","last_change":"2023-05-21T16:54:18.174594+0000","last_active":"2023-05-21T16:54:19.230210+0000","last_peered":"2023-05-21T16:54:19.230210+0000","last_clean":"2023-05-21T16:54:19.230210+0000","last_became_active":"2023-05-21T16:54:18.170519+0000","last_became_peered":"2023-05-21T16:54:18.170519+0000","last_unstale":"2023-05-21T16:54:19.230210+0000","last_undegraded":"2023-05-21T16:54:19.230210+0000","last_fullsized":"2023-05-21T16:54:19.230210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152878+0000","last_change":"2023-05-21T16:54:18.169270+0000","last_active":"2023-05-21T16:54:19.152878+0000","last_peered":"2023-05-21T16:54:19.152878+0000","last_clean":"2023-05-21T16:54:19.152878+0000","last_became_active":"2023-05-21T16:54:18.168977+0000","last_became_peered":"2023-05-21T16:54:18.168977+0000","last_unstale":"2023-05-21T16:54:19.152878+0000","last_undegraded":"2023-05-21T16:54:19.152878+0000","last_fullsized":"2023-05-21T16:54:19.152878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954983+0000","last_change":"2023-05-21T16:54:18.165262+0000","last_active":"2023-05-21T16:54:19.954983+0000","last_peered":"2023-05-21T16:54:19.954983+0000","last_clean":"2023-05-21T16:54:19.954983+0000","last_became_active":"2023-05-21T16:54:18.164916+0000","last_became_peered":"2023-05-21T16:54:18.164916+0000","last_unstale":"2023-05-21T16:54:19.954983+0000","last_undegraded":"2023-05-21T16:54:19.954983+0000","last_fullsized":"2023-05-21T16:54:19.954983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151737+0000","last_change":"2023-05-21T16:54:18.174319+0000","last_active":"2023-05-21T16:54:19.151737+0000","last_peered":"2023-05-21T16:54:19.151737+0000","last_clean":"2023-05-21T16:54:19.151737+0000","last_became_active":"2023-05-21T16:54:18.174006+0000","last_became_peered":"2023-05-21T16:54:18.174006+0000","last_unstale":"2023-05-21T16:54:19.151737+0000","last_undegraded":"2023-05-21T16:54:19.151737+0000","last_fullsized":"2023-05-21T16:54:19.151737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955479+0000","last_change":"2023-05-21T16:54:18.172783+0000","last_active":"2023-05-21T16:54:19.955479+0000","last_peered":"2023-05-21T16:54:19.955479+0000","last_clean":"2023-05-21T16:54:19.955479+0000","last_became_active":"2023-05-21T16:54:18.172479+0000","last_became_peered":"2023-05-21T16:54:18.172479+0000","last_unstale":"2023-05-21T16:54:19.955479+0000","last_undegraded":"2023-05-21T16:54:19.955479+0000","last_fullsized":"2023-05-21T16:54:19.955479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231502+0000","last_change":"2023-05-21T16:54:18.177992+0000","last_active":"2023-05-21T16:54:19.231502+0000","last_peered":"2023-05-21T16:54:19.231502+0000","last_clean":"2023-05-21T16:54:19.231502+0000","last_became_active":"2023-05-21T16:54:18.177672+0000","last_became_peered":"2023-05-21T16:54:18.177672+0000","last_unstale":"2023-05-21T16:54:19.231502+0000","last_undegraded":"2023-05-21T16:54:19.231502+0000","last_fullsized":"2023-05-21T16:54:19.231502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507861+0000","last_change":"2023-05-21T16:54:18.178845+0000","last_active":"2023-05-21T16:54:19.507861+0000","last_peered":"2023-05-21T16:54:19.507861+0000","last_clean":"2023-05-21T16:54:19.507861+0000","last_became_active":"2023-05-21T16:54:18.178443+0000","last_became_peered":"2023-05-21T16:54:18.178443+0000","last_unstale":"2023-05-21T16:54:19.507861+0000","last_undegraded":"2023-05-21T16:54:19.507861+0000","last_fullsized":"2023-05-21T16:54:19.507861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:04.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507567+0000","last_change":"2023-05-21T16:54:18.173619+0000","last_active":"2023-05-21T16:54:19.507567+0000","last_peered":"2023-05-21T16:54:19.507567+0000","last_clean":"2023-05-21T16:54:19.507567+0000","last_became_active":"2023-05-21T16:54:18.173111+0000","last_became_peered":"2023-05-21T16:54:18.173111+0000","last_unstale":"2023-05-21T16:54:19.507567+0000","last_undegraded":"2023-05-21T16:54:19.507567+0000","last_fullsized":"2023-05-21T16:54:19.507567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:59:59.660879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955292+0000","last_change":"2023-05-21T16:54:18.161833+0000","last_active":"2023-05-21T16:54:19.955292+0000","last_peered":"2023-05-21T16:54:19.955292+0000","last_clean":"2023-05-21T16:54:19.955292+0000","last_became_active":"2023-05-21T16:54:18.161537+0000","last_became_peered":"2023-05-21T16:54:18.161537+0000","last_unstale":"2023-05-21T16:54:19.955292+0000","last_undegraded":"2023-05-21T16:54:19.955292+0000","last_fullsized":"2023-05-21T16:54:19.955292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153194+0000","last_change":"2023-05-21T16:54:18.167967+0000","last_active":"2023-05-21T16:54:19.153194+0000","last_peered":"2023-05-21T16:54:19.153194+0000","last_clean":"2023-05-21T16:54:19.153194+0000","last_became_active":"2023-05-21T16:54:18.167679+0000","last_became_peered":"2023-05-21T16:54:18.167679+0000","last_unstale":"2023-05-21T16:54:19.153194+0000","last_undegraded":"2023-05-21T16:54:19.153194+0000","last_fullsized":"2023-05-21T16:54:19.153194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229833+0000","last_change":"2023-05-21T16:54:18.174428+0000","last_active":"2023-05-21T16:54:19.229833+0000","last_peered":"2023-05-21T16:54:19.229833+0000","last_clean":"2023-05-21T16:54:19.229833+0000","last_became_active":"2023-05-21T16:54:18.171683+0000","last_became_peered":"2023-05-21T16:54:18.171683+0000","last_unstale":"2023-05-21T16:54:19.229833+0000","last_undegraded":"2023-05-21T16:54:19.229833+0000","last_fullsized":"2023-05-21T16:54:19.229833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151801+0000","last_change":"2023-05-21T16:54:18.174341+0000","last_active":"2023-05-21T16:54:19.151801+0000","last_peered":"2023-05-21T16:54:19.151801+0000","last_clean":"2023-05-21T16:54:19.151801+0000","last_became_active":"2023-05-21T16:54:18.172475+0000","last_became_peered":"2023-05-21T16:54:18.172475+0000","last_unstale":"2023-05-21T16:54:19.151801+0000","last_undegraded":"2023-05-21T16:54:19.151801+0000","last_fullsized":"2023-05-21T16:54:19.151801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230882+0000","last_change":"2023-05-21T16:54:18.172503+0000","last_active":"2023-05-21T16:54:19.230882+0000","last_peered":"2023-05-21T16:54:19.230882+0000","last_clean":"2023-05-21T16:54:19.230882+0000","last_became_active":"2023-05-21T16:54:18.171759+0000","last_became_peered":"2023-05-21T16:54:18.171759+0000","last_unstale":"2023-05-21T16:54:19.230882+0000","last_undegraded":"2023-05-21T16:54:19.230882+0000","last_fullsized":"2023-05-21T16:54:19.230882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507738+0000","last_change":"2023-05-21T16:54:18.177321+0000","last_active":"2023-05-21T16:54:19.507738+0000","last_peered":"2023-05-21T16:54:19.507738+0000","last_clean":"2023-05-21T16:54:19.507738+0000","last_became_active":"2023-05-21T16:54:18.177032+0000","last_became_peered":"2023-05-21T16:54:18.177032+0000","last_unstale":"2023-05-21T16:54:19.507738+0000","last_undegraded":"2023-05-21T16:54:19.507738+0000","last_fullsized":"2023-05-21T16:54:19.507738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:53:28.141995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231058+0000","last_change":"2023-05-21T16:54:18.174907+0000","last_active":"2023-05-21T16:54:19.231058+0000","last_peered":"2023-05-21T16:54:19.231058+0000","last_clean":"2023-05-21T16:54:19.231058+0000","last_became_active":"2023-05-21T16:54:18.174528+0000","last_became_peered":"2023-05-21T16:54:18.174528+0000","last_unstale":"2023-05-21T16:54:19.231058+0000","last_undegraded":"2023-05-21T16:54:19.231058+0000","last_fullsized":"2023-05-21T16:54:19.231058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153215+0000","last_change":"2023-05-21T16:54:18.172031+0000","last_active":"2023-05-21T16:54:19.153215+0000","last_peered":"2023-05-21T16:54:19.153215+0000","last_clean":"2023-05-21T16:54:19.153215+0000","last_became_active":"2023-05-21T16:54:18.170754+0000","last_became_peered":"2023-05-21T16:54:18.170754+0000","last_unstale":"2023-05-21T16:54:19.153215+0000","last_undegraded":"2023-05-21T16:54:19.153215+0000","last_fullsized":"2023-05-21T16:54:19.153215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151032+0000","last_change":"2023-05-21T16:54:18.177700+0000","last_active":"2023-05-21T16:54:19.151032+0000","last_peered":"2023-05-21T16:54:19.151032+0000","last_clean":"2023-05-21T16:54:19.151032+0000","last_became_active":"2023-05-21T16:54:18.177419+0000","last_became_peered":"2023-05-21T16:54:18.177419+0000","last_unstale":"2023-05-21T16:54:19.151032+0000","last_undegraded":"2023-05-21T16:54:19.151032+0000","last_fullsized":"2023-05-21T16:54:19.151032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009407+0000","last_change":"2023-05-21T16:54:18.173893+0000","last_active":"2023-05-21T16:54:20.009407+0000","last_peered":"2023-05-21T16:54:20.009407+0000","last_clean":"2023-05-21T16:54:20.009407+0000","last_became_active":"2023-05-21T16:54:18.173618+0000","last_became_peered":"2023-05-21T16:54:18.173618+0000","last_unstale":"2023-05-21T16:54:20.009407+0000","last_undegraded":"2023-05-21T16:54:20.009407+0000","last_fullsized":"2023-05-21T16:54:20.009407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152740+0000","last_change":"2023-05-21T16:54:18.178690+0000","last_active":"2023-05-21T16:54:19.152740+0000","last_peered":"2023-05-21T16:54:19.152740+0000","last_clean":"2023-05-21T16:54:19.152740+0000","last_became_active":"2023-05-21T16:54:18.178395+0000","last_became_peered":"2023-05-21T16:54:18.178395+0000","last_unstale":"2023-05-21T16:54:19.152740+0000","last_undegraded":"2023-05-21T16:54:19.152740+0000","last_fullsized":"2023-05-21T16:54:19.152740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010601+0000","last_change":"2023-05-21T16:54:18.174128+0000","last_active":"2023-05-21T16:54:20.010601+0000","last_peered":"2023-05-21T16:54:20.010601+0000","last_clean":"2023-05-21T16:54:20.010601+0000","last_became_active":"2023-05-21T16:54:18.173436+0000","last_became_peered":"2023-05-21T16:54:18.173436+0000","last_unstale":"2023-05-21T16:54:20.010601+0000","last_undegraded":"2023-05-21T16:54:20.010601+0000","last_fullsized":"2023-05-21T16:54:20.010601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010387+0000","last_change":"2023-05-21T16:54:18.166373+0000","last_active":"2023-05-21T16:54:20.010387+0000","last_peered":"2023-05-21T16:54:20.010387+0000","last_clean":"2023-05-21T16:54:20.010387+0000","last_became_active":"2023-05-21T16:54:18.166106+0000","last_became_peered":"2023-05-21T16:54:18.166106+0000","last_unstale":"2023-05-21T16:54:20.010387+0000","last_undegraded":"2023-05-21T16:54:20.010387+0000","last_fullsized":"2023-05-21T16:54:20.010387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955908+0000","last_change":"2023-05-21T16:54:18.165081+0000","last_active":"2023-05-21T16:54:19.955908+0000","last_peered":"2023-05-21T16:54:19.955908+0000","last_clean":"2023-05-21T16:54:19.955908+0000","last_became_active":"2023-05-21T16:54:18.164749+0000","last_became_peered":"2023-05-21T16:54:18.164749+0000","last_unstale":"2023-05-21T16:54:19.955908+0000","last_undegraded":"2023-05-21T16:54:19.955908+0000","last_fullsized":"2023-05-21T16:54:19.955908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010630+0000","last_change":"2023-05-21T16:54:18.178240+0000","last_active":"2023-05-21T16:54:20.010630+0000","last_peered":"2023-05-21T16:54:20.010630+0000","last_clean":"2023-05-21T16:54:20.010630+0000","last_became_active":"2023-05-21T16:54:18.177953+0000","last_became_peered":"2023-05-21T16:54:18.177953+0000","last_unstale":"2023-05-21T16:54:20.010630+0000","last_undegraded":"2023-05-21T16:54:20.010630+0000","last_fullsized":"2023-05-21T16:54:20.010630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011193+0000","last_change":"2023-05-21T16:54:18.171995+0000","last_active":"2023-05-21T16:54:20.011193+0000","last_peered":"2023-05-21T16:54:20.011193+0000","last_clean":"2023-05-21T16:54:20.011193+0000","last_became_active":"2023-05-21T16:54:18.170850+0000","last_became_peered":"2023-05-21T16:54:18.170850+0000","last_unstale":"2023-05-21T16:54:20.011193+0000","last_undegraded":"2023-05-21T16:54:20.011193+0000","last_fullsized":"2023-05-21T16:54:20.011193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230580+0000","last_change":"2023-05-21T16:54:18.175264+0000","last_active":"2023-05-21T16:54:19.230580+0000","last_peered":"2023-05-21T16:54:19.230580+0000","last_clean":"2023-05-21T16:54:19.230580+0000","last_became_active":"2023-05-21T16:54:18.174923+0000","last_became_peered":"2023-05-21T16:54:18.174923+0000","last_unstale":"2023-05-21T16:54:19.230580+0000","last_undegraded":"2023-05-21T16:54:19.230580+0000","last_fullsized":"2023-05-21T16:54:19.230580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009553+0000","last_change":"2023-05-21T16:54:18.178259+0000","last_active":"2023-05-21T16:54:20.009553+0000","last_peered":"2023-05-21T16:54:20.009553+0000","last_clean":"2023-05-21T16:54:20.009553+0000","last_became_active":"2023-05-21T16:54:18.177972+0000","last_became_peered":"2023-05-21T16:54:18.177972+0000","last_unstale":"2023-05-21T16:54:20.009553+0000","last_undegraded":"2023-05-21T16:54:20.009553+0000","last_fullsized":"2023-05-21T16:54:20.009553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153058+0000","last_change":"2023-05-21T16:54:18.169342+0000","last_active":"2023-05-21T16:54:19.153058+0000","last_peered":"2023-05-21T16:54:19.153058+0000","last_clean":"2023-05-21T16:54:19.153058+0000","last_became_active":"2023-05-21T16:54:18.169078+0000","last_became_peered":"2023-05-21T16:54:18.169078+0000","last_unstale":"2023-05-21T16:54:19.153058+0000","last_undegraded":"2023-05-21T16:54:19.153058+0000","last_fullsized":"2023-05-21T16:54:19.153058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011024+0000","last_change":"2023-05-21T16:54:18.178151+0000","last_active":"2023-05-21T16:54:20.011024+0000","last_peered":"2023-05-21T16:54:20.011024+0000","last_clean":"2023-05-21T16:54:20.011024+0000","last_became_active":"2023-05-21T16:54:18.177832+0000","last_became_peered":"2023-05-21T16:54:18.177832+0000","last_unstale":"2023-05-21T16:54:20.011024+0000","last_undegraded":"2023-05-21T16:54:20.011024+0000","last_fullsized":"2023-05-21T16:54:20.011024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153512+0000","last_change":"2023-05-21T16:54:17.791377+0000","last_active":"2023-05-21T16:54:19.153512+0000","last_peered":"2023-05-21T16:54:19.153512+0000","last_clean":"2023-05-21T16:54:19.153512+0000","last_became_active":"2023-05-21T16:54:17.791033+0000","last_became_peered":"2023-05-21T16:54:17.791033+0000","last_unstale":"2023-05-21T16:54:19.153512+0000","last_undegraded":"2023-05-21T16:54:19.153512+0000","last_fullsized":"2023-05-21T16:54:19.153512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956058+0000","last_change":"2023-05-21T16:54:18.160039+0000","last_active":"2023-05-21T16:54:19.956058+0000","last_peered":"2023-05-21T16:54:19.956058+0000","last_clean":"2023-05-21T16:54:19.956058+0000","last_became_active":"2023-05-21T16:54:18.159784+0000","last_became_peered":"2023-05-21T16:54:18.159784+0000","last_unstale":"2023-05-21T16:54:19.956058+0000","last_undegraded":"2023-05-21T16:54:19.956058+0000","last_fullsized":"2023-05-21T16:54:19.956058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151174+0000","last_change":"2023-05-21T16:54:17.793000+0000","last_active":"2023-05-21T16:54:19.151174+0000","last_peered":"2023-05-21T16:54:19.151174+0000","last_clean":"2023-05-21T16:54:19.151174+0000","last_became_active":"2023-05-21T16:54:17.792628+0000","last_became_peered":"2023-05-21T16:54:17.792628+0000","last_unstale":"2023-05-21T16:54:19.151174+0000","last_undegraded":"2023-05-21T16:54:19.151174+0000","last_fullsized":"2023-05-21T16:54:19.151174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151621+0000","last_change":"2023-05-21T16:54:18.171993+0000","last_active":"2023-05-21T16:54:19.151621+0000","last_peered":"2023-05-21T16:54:19.151621+0000","last_clean":"2023-05-21T16:54:19.151621+0000","last_became_active":"2023-05-21T16:54:18.171691+0000","last_became_peered":"2023-05-21T16:54:18.171691+0000","last_unstale":"2023-05-21T16:54:19.151621+0000","last_undegraded":"2023-05-21T16:54:19.151621+0000","last_fullsized":"2023-05-21T16:54:19.151621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153638+0000","last_change":"2023-05-21T16:54:17.792641+0000","last_active":"2023-05-21T16:54:19.153638+0000","last_peered":"2023-05-21T16:54:19.153638+0000","last_clean":"2023-05-21T16:54:19.153638+0000","last_became_active":"2023-05-21T16:54:17.792197+0000","last_became_peered":"2023-05-21T16:54:17.792197+0000","last_unstale":"2023-05-21T16:54:19.153638+0000","last_undegraded":"2023-05-21T16:54:19.153638+0000","last_fullsized":"2023-05-21T16:54:19.153638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:46:25.331076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011544+0000","last_change":"2023-05-21T16:54:18.171873+0000","last_active":"2023-05-21T16:54:20.011544+0000","last_peered":"2023-05-21T16:54:20.011544+0000","last_clean":"2023-05-21T16:54:20.011544+0000","last_became_active":"2023-05-21T16:54:18.171463+0000","last_became_peered":"2023-05-21T16:54:18.171463+0000","last_unstale":"2023-05-21T16:54:20.011544+0000","last_undegraded":"2023-05-21T16:54:20.011544+0000","last_fullsized":"2023-05-21T16:54:20.011544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153427+0000","last_change":"2023-05-21T16:54:17.793533+0000","last_active":"2023-05-21T16:54:19.153427+0000","last_peered":"2023-05-21T16:54:19.153427+0000","last_clean":"2023-05-21T16:54:19.153427+0000","last_became_active":"2023-05-21T16:54:17.793152+0000","last_became_peered":"2023-05-21T16:54:17.793152+0000","last_unstale":"2023-05-21T16:54:19.153427+0000","last_undegraded":"2023-05-21T16:54:19.153427+0000","last_fullsized":"2023-05-21T16:54:19.153427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:40:00.667703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154574+0000","last_change":"2023-05-21T16:54:17.792133+0000","last_active":"2023-05-21T16:54:19.154574+0000","last_peered":"2023-05-21T16:54:19.154574+0000","last_clean":"2023-05-21T16:54:19.154574+0000","last_became_active":"2023-05-21T16:54:17.791681+0000","last_became_peered":"2023-05-21T16:54:17.791681+0000","last_unstale":"2023-05-21T16:54:19.154574+0000","last_undegraded":"2023-05-21T16:54:19.154574+0000","last_fullsized":"2023-05-21T16:54:19.154574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:46:05.629379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954986+0000","last_change":"2023-05-21T16:54:18.159536+0000","last_active":"2023-05-21T16:54:19.954986+0000","last_peered":"2023-05-21T16:54:19.954986+0000","last_clean":"2023-05-21T16:54:19.954986+0000","last_became_active":"2023-05-21T16:54:18.158995+0000","last_became_peered":"2023-05-21T16:54:18.158995+0000","last_unstale":"2023-05-21T16:54:19.954986+0000","last_undegraded":"2023-05-21T16:54:19.954986+0000","last_fullsized":"2023-05-21T16:54:19.954986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153940+0000","last_change":"2023-05-21T16:54:17.791717+0000","last_active":"2023-05-21T16:54:19.153940+0000","last_peered":"2023-05-21T16:54:19.153940+0000","last_clean":"2023-05-21T16:54:19.153940+0000","last_became_active":"2023-05-21T16:54:17.791323+0000","last_became_peered":"2023-05-21T16:54:17.791323+0000","last_unstale":"2023-05-21T16:54:19.153940+0000","last_undegraded":"2023-05-21T16:54:19.153940+0000","last_fullsized":"2023-05-21T16:54:19.153940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:30:06.548887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229939+0000","last_change":"2023-05-21T16:54:18.176794+0000","last_active":"2023-05-21T16:54:19.229939+0000","last_peered":"2023-05-21T16:54:19.229939+0000","last_clean":"2023-05-21T16:54:19.229939+0000","last_became_active":"2023-05-21T16:54:18.176500+0000","last_became_peered":"2023-05-21T16:54:18.176500+0000","last_unstale":"2023-05-21T16:54:19.229939+0000","last_undegraded":"2023-05-21T16:54:19.229939+0000","last_fullsized":"2023-05-21T16:54:19.229939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153977+0000","last_change":"2023-05-21T16:54:17.791693+0000","last_active":"2023-05-21T16:54:19.153977+0000","last_peered":"2023-05-21T16:54:19.153977+0000","last_clean":"2023-05-21T16:54:19.153977+0000","last_became_active":"2023-05-21T16:54:17.790907+0000","last_became_peered":"2023-05-21T16:54:17.790907+0000","last_unstale":"2023-05-21T16:54:19.153977+0000","last_undegraded":"2023-05-21T16:54:19.153977+0000","last_fullsized":"2023-05-21T16:54:19.153977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:48.881822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153098+0000","last_change":"2023-05-21T16:54:18.176109+0000","last_active":"2023-05-21T16:54:19.153098+0000","last_peered":"2023-05-21T16:54:19.153098+0000","last_clean":"2023-05-21T16:54:19.153098+0000","last_became_active":"2023-05-21T16:54:18.175825+0000","last_became_peered":"2023-05-21T16:54:18.175825+0000","last_unstale":"2023-05-21T16:54:19.153098+0000","last_undegraded":"2023-05-21T16:54:19.153098+0000","last_fullsized":"2023-05-21T16:54:19.153098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:16.831930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955462+0000","last_change":"2023-05-21T16:54:17.785136+0000","last_active":"2023-05-21T16:54:19.955462+0000","last_peered":"2023-05-21T16:54:19.955462+0000","last_clean":"2023-05-21T16:54:19.955462+0000","last_became_active":"2023-05-21T16:54:17.784827+0000","last_became_peered":"2023-05-21T16:54:17.784827+0000","last_unstale":"2023-05-21T16:54:19.955462+0000","last_undegraded":"2023-05-21T16:54:19.955462+0000","last_fullsized":"2023-05-21T16:54:19.955462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151228+0000","last_change":"2023-05-21T16:54:18.177151+0000","last_active":"2023-05-21T16:54:19.151228+0000","last_peered":"2023-05-21T16:54:19.151228+0000","last_clean":"2023-05-21T16:54:19.151228+0000","last_became_active":"2023-05-21T16:54:18.176855+0000","last_became_peered":"2023-05-21T16:54:18.176855+0000","last_unstale":"2023-05-21T16:54:19.151228+0000","last_undegraded":"2023-05-21T16:54:19.151228+0000","last_fullsized":"2023-05-21T16:54:19.151228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011786+0000","last_change":"2023-05-21T16:54:17.797286+0000","last_active":"2023-05-21T16:54:20.011786+0000","last_peered":"2023-05-21T16:54:20.011786+0000","last_clean":"2023-05-21T16:54:20.011786+0000","last_became_active":"2023-05-21T16:54:17.796986+0000","last_became_peered":"2023-05-21T16:54:17.796986+0000","last_unstale":"2023-05-21T16:54:20.011786+0000","last_undegraded":"2023-05-21T16:54:20.011786+0000","last_fullsized":"2023-05-21T16:54:20.011786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231228+0000","last_change":"2023-05-21T16:54:18.178953+0000","last_active":"2023-05-21T16:54:19.231228+0000","last_peered":"2023-05-21T16:54:19.231228+0000","last_clean":"2023-05-21T16:54:19.231228+0000","last_became_active":"2023-05-21T16:54:18.178614+0000","last_became_peered":"2023-05-21T16:54:18.178614+0000","last_unstale":"2023-05-21T16:54:19.231228+0000","last_undegraded":"2023-05-21T16:54:19.231228+0000","last_fullsized":"2023-05-21T16:54:19.231228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:56.406296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154181+0000","last_change":"2023-05-21T16:54:17.788405+0000","last_active":"2023-05-21T16:54:19.154181+0000","last_peered":"2023-05-21T16:54:19.154181+0000","last_clean":"2023-05-21T16:54:19.154181+0000","last_became_active":"2023-05-21T16:54:17.788095+0000","last_became_peered":"2023-05-21T16:54:17.788095+0000","last_unstale":"2023-05-21T16:54:19.154181+0000","last_undegraded":"2023-05-21T16:54:19.154181+0000","last_fullsized":"2023-05-21T16:54:19.154181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231523+0000","last_change":"2023-05-21T16:54:18.171511+0000","last_active":"2023-05-21T16:54:19.231523+0000","last_peered":"2023-05-21T16:54:19.231523+0000","last_clean":"2023-05-21T16:54:19.231523+0000","last_became_active":"2023-05-21T16:54:18.171154+0000","last_became_peered":"2023-05-21T16:54:18.171154+0000","last_unstale":"2023-05-21T16:54:19.231523+0000","last_undegraded":"2023-05-21T16:54:19.231523+0000","last_fullsized":"2023-05-21T16:54:19.231523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:20.770522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230303+0000","last_change":"2023-05-21T16:54:17.786737+0000","last_active":"2023-05-21T16:54:19.230303+0000","last_peered":"2023-05-21T16:54:19.230303+0000","last_clean":"2023-05-21T16:54:19.230303+0000","last_became_active":"2023-05-21T16:54:17.786296+0000","last_became_peered":"2023-05-21T16:54:17.786296+0000","last_unstale":"2023-05-21T16:54:19.230303+0000","last_undegraded":"2023-05-21T16:54:19.230303+0000","last_fullsized":"2023-05-21T16:54:19.230303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230914+0000","last_change":"2023-05-21T16:54:18.174307+0000","last_active":"2023-05-21T16:54:19.230914+0000","last_peered":"2023-05-21T16:54:19.230914+0000","last_clean":"2023-05-21T16:54:19.230914+0000","last_became_active":"2023-05-21T16:54:18.172216+0000","last_became_peered":"2023-05-21T16:54:18.172216+0000","last_unstale":"2023-05-21T16:54:19.230914+0000","last_undegraded":"2023-05-21T16:54:19.230914+0000","last_fullsized":"2023-05-21T16:54:19.230914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009210+0000","last_change":"2023-05-21T16:54:17.789635+0000","last_active":"2023-05-21T16:54:20.009210+0000","last_peered":"2023-05-21T16:54:20.009210+0000","last_clean":"2023-05-21T16:54:20.009210+0000","last_became_active":"2023-05-21T16:54:17.789269+0000","last_became_peered":"2023-05-21T16:54:17.789269+0000","last_unstale":"2023-05-21T16:54:20.009210+0000","last_undegraded":"2023-05-21T16:54:20.009210+0000","last_fullsized":"2023-05-21T16:54:20.009210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010922+0000","last_change":"2023-05-21T16:54:18.172894+0000","last_active":"2023-05-21T16:54:20.010922+0000","last_peered":"2023-05-21T16:54:20.010922+0000","last_clean":"2023-05-21T16:54:20.010922+0000","last_became_active":"2023-05-21T16:54:18.172589+0000","last_became_peered":"2023-05-21T16:54:18.172589+0000","last_unstale":"2023-05-21T16:54:20.010922+0000","last_undegraded":"2023-05-21T16:54:20.010922+0000","last_fullsized":"2023-05-21T16:54:20.010922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152965+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:54:19.152965+0000","last_peered":"2023-05-21T16:54:19.152965+0000","last_clean":"2023-05-21T16:54:19.152965+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:54:19.152965+0000","last_undegraded":"2023-05-21T16:54:19.152965+0000","last_fullsized":"2023-05-21T16:54:19.152965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:58:58.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955263+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:54:19.955263+0000","last_peered":"2023-05-21T16:54:19.955263+0000","last_clean":"2023-05-21T16:54:19.955263+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:54:19.955263+0000","last_undegraded":"2023-05-21T16:54:19.955263+0000","last_fullsized":"2023-05-21T16:54:19.955263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011043+0000","last_change":"2023-05-21T16:54:17.787923+0000","last_active":"2023-05-21T16:54:20.011043+0000","last_peered":"2023-05-21T16:54:20.011043+0000","last_clean":"2023-05-21T16:54:20.011043+0000","last_became_active":"2023-05-21T16:54:17.786954+0000","last_became_peered":"2023-05-21T16:54:17.786954+0000","last_unstale":"2023-05-21T16:54:20.011043+0000","last_undegraded":"2023-05-21T16:54:20.011043+0000","last_fullsized":"2023-05-21T16:54:20.011043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154038+0000","last_change":"2023-05-21T16:54:18.178971+0000","last_active":"2023-05-21T16:54:19.154038+0000","last_peered":"2023-05-21T16:54:19.154038+0000","last_clean":"2023-05-21T16:54:19.154038+0000","last_became_active":"2023-05-21T16:54:18.178660+0000","last_became_peered":"2023-05-21T16:54:18.178660+0000","last_unstale":"2023-05-21T16:54:19.154038+0000","last_undegraded":"2023-05-21T16:54:19.154038+0000","last_fullsized":"2023-05-21T16:54:19.154038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152822+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:54:19.152822+0000","last_peered":"2023-05-21T16:54:19.152822+0000","last_clean":"2023-05-21T16:54:19.152822+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:54:19.152822+0000","last_undegraded":"2023-05-21T16:54:19.152822+0000","last_fullsized":"2023-05-21T16:54:19.152822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:51.273053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151242+0000","last_change":"2023-05-21T16:54:17.789501+0000","last_active":"2023-05-21T16:54:19.151242+0000","last_peered":"2023-05-21T16:54:19.151242+0000","last_clean":"2023-05-21T16:54:19.151242+0000","last_became_active":"2023-05-21T16:54:17.789206+0000","last_became_peered":"2023-05-21T16:54:17.789206+0000","last_unstale":"2023-05-21T16:54:19.151242+0000","last_undegraded":"2023-05-21T16:54:19.151242+0000","last_fullsized":"2023-05-21T16:54:19.151242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:23.152767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151696+0000","last_change":"2023-05-21T16:54:18.177266+0000","last_active":"2023-05-21T16:54:19.151696+0000","last_peered":"2023-05-21T16:54:19.151696+0000","last_clean":"2023-05-21T16:54:19.151696+0000","last_became_active":"2023-05-21T16:54:18.176940+0000","last_became_peered":"2023-05-21T16:54:18.176940+0000","last_unstale":"2023-05-21T16:54:19.151696+0000","last_undegraded":"2023-05-21T16:54:19.151696+0000","last_fullsized":"2023-05-21T16:54:19.151696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507390+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:54:19.507390+0000","last_peered":"2023-05-21T16:54:19.507390+0000","last_clean":"2023-05-21T16:54:19.507390+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:54:19.507390+0000","last_undegraded":"2023-05-21T16:54:19.507390+0000","last_fullsized":"2023-05-21T16:54:19.507390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:33:24.899208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.007932+0000","last_change":"2023-05-21T16:54:17.788365+0000","last_active":"2023-05-21T16:54:20.007932+0000","last_peered":"2023-05-21T16:54:20.007932+0000","last_clean":"2023-05-21T16:54:20.007932+0000","last_became_active":"2023-05-21T16:54:17.788057+0000","last_became_peered":"2023-05-21T16:54:17.788057+0000","last_unstale":"2023-05-21T16:54:20.007932+0000","last_undegraded":"2023-05-21T16:54:20.007932+0000","last_fullsized":"2023-05-21T16:54:20.007932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011232+0000","last_change":"2023-05-21T16:54:18.171962+0000","last_active":"2023-05-21T16:54:20.011232+0000","last_peered":"2023-05-21T16:54:20.011232+0000","last_clean":"2023-05-21T16:54:20.011232+0000","last_became_active":"2023-05-21T16:54:18.171665+0000","last_became_peered":"2023-05-21T16:54:18.171665+0000","last_unstale":"2023-05-21T16:54:20.011232+0000","last_undegraded":"2023-05-21T16:54:20.011232+0000","last_fullsized":"2023-05-21T16:54:20.011232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955100+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:54:19.955100+0000","last_peered":"2023-05-21T16:54:19.955100+0000","last_clean":"2023-05-21T16:54:19.955100+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:54:19.955100+0000","last_undegraded":"2023-05-21T16:54:19.955100+0000","last_fullsized":"2023-05-21T16:54:19.955100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:21.763386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231112+0000","last_change":"2023-05-21T16:54:17.793714+0000","last_active":"2023-05-21T16:54:19.231112+0000","last_peered":"2023-05-21T16:54:19.231112+0000","last_clean":"2023-05-21T16:54:19.231112+0000","last_became_active":"2023-05-21T16:54:17.793497+0000","last_became_peered":"2023-05-21T16:54:17.793497+0000","last_unstale":"2023-05-21T16:54:19.231112+0000","last_undegraded":"2023-05-21T16:54:19.231112+0000","last_fullsized":"2023-05-21T16:54:19.231112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:32.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010033+0000","last_change":"2023-05-21T16:54:18.172642+0000","last_active":"2023-05-21T16:54:20.010033+0000","last_peered":"2023-05-21T16:54:20.010033+0000","last_clean":"2023-05-21T16:54:20.010033+0000","last_became_active":"2023-05-21T16:54:18.172368+0000","last_became_peered":"2023-05-21T16:54:18.172368+0000","last_unstale":"2023-05-21T16:54:20.010033+0000","last_undegraded":"2023-05-21T16:54:20.010033+0000","last_fullsized":"2023-05-21T16:54:20.010033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956342+0000","last_change":"2023-05-21T16:54:17.786742+0000","last_active":"2023-05-21T16:54:19.956342+0000","last_peered":"2023-05-21T16:54:19.956342+0000","last_clean":"2023-05-21T16:54:19.956342+0000","last_became_active":"2023-05-21T16:54:17.785555+0000","last_became_peered":"2023-05-21T16:54:17.785555+0000","last_unstale":"2023-05-21T16:54:19.956342+0000","last_undegraded":"2023-05-21T16:54:19.956342+0000","last_fullsized":"2023-05-21T16:54:19.956342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011595+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:54:20.011595+0000","last_peered":"2023-05-21T16:54:20.011595+0000","last_clean":"2023-05-21T16:54:20.011595+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:54:20.011595+0000","last_undegraded":"2023-05-21T16:54:20.011595+0000","last_fullsized":"2023-05-21T16:54:20.011595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:28.413313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009230+0000","last_change":"2023-05-21T16:54:18.168021+0000","last_active":"2023-05-21T16:54:20.009230+0000","last_peered":"2023-05-21T16:54:20.009230+0000","last_clean":"2023-05-21T16:54:20.009230+0000","last_became_active":"2023-05-21T16:54:18.167737+0000","last_became_peered":"2023-05-21T16:54:18.167737+0000","last_unstale":"2023-05-21T16:54:20.009230+0000","last_undegraded":"2023-05-21T16:54:20.009230+0000","last_fullsized":"2023-05-21T16:54:20.009230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010243+0000","last_change":"2023-05-21T16:54:17.790619+0000","last_active":"2023-05-21T16:54:20.010243+0000","last_peered":"2023-05-21T16:54:20.010243+0000","last_clean":"2023-05-21T16:54:20.010243+0000","last_became_active":"2023-05-21T16:54:17.790299+0000","last_became_peered":"2023-05-21T16:54:17.790299+0000","last_unstale":"2023-05-21T16:54:20.010243+0000","last_undegraded":"2023-05-21T16:54:20.010243+0000","last_fullsized":"2023-05-21T16:54:20.010243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154364+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:54:19.154364+0000","last_peered":"2023-05-21T16:54:19.154364+0000","last_clean":"2023-05-21T16:54:19.154364+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:54:19.154364+0000","last_undegraded":"2023-05-21T16:54:19.154364+0000","last_fullsized":"2023-05-21T16:54:19.154364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:10:31.136089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151575+0000","last_change":"2023-05-21T16:54:18.171071+0000","last_active":"2023-05-21T16:54:19.151575+0000","last_peered":"2023-05-21T16:54:19.151575+0000","last_clean":"2023-05-21T16:54:19.151575+0000","last_became_active":"2023-05-21T16:54:18.170780+0000","last_became_peered":"2023-05-21T16:54:18.170780+0000","last_unstale":"2023-05-21T16:54:19.151575+0000","last_undegraded":"2023-05-21T16:54:19.151575+0000","last_fullsized":"2023-05-21T16:54:19.151575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011773+0000","last_change":"2023-05-21T16:54:17.797231+0000","last_active":"2023-05-21T16:54:20.011773+0000","last_peered":"2023-05-21T16:54:20.011773+0000","last_clean":"2023-05-21T16:54:20.011773+0000","last_became_active":"2023-05-21T16:54:17.796914+0000","last_became_peered":"2023-05-21T16:54:17.796914+0000","last_unstale":"2023-05-21T16:54:20.011773+0000","last_undegraded":"2023-05-21T16:54:20.011773+0000","last_fullsized":"2023-05-21T16:54:20.011773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:56.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010479+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:54:20.010479+0000","last_peered":"2023-05-21T16:54:20.010479+0000","last_clean":"2023-05-21T16:54:20.010479+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:54:20.010479+0000","last_undegraded":"2023-05-21T16:54:20.010479+0000","last_fullsized":"2023-05-21T16:54:20.010479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008889+0000","last_change":"2023-05-21T16:54:18.165428+0000","last_active":"2023-05-21T16:54:20.008889+0000","last_peered":"2023-05-21T16:54:20.008889+0000","last_clean":"2023-05-21T16:54:20.008889+0000","last_became_active":"2023-05-21T16:54:18.164994+0000","last_became_peered":"2023-05-21T16:54:18.164994+0000","last_unstale":"2023-05-21T16:54:20.008889+0000","last_undegraded":"2023-05-21T16:54:20.008889+0000","last_fullsized":"2023-05-21T16:54:20.008889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151685+0000","last_change":"2023-05-21T16:54:17.789570+0000","last_active":"2023-05-21T16:54:19.151685+0000","last_peered":"2023-05-21T16:54:19.151685+0000","last_clean":"2023-05-21T16:54:19.151685+0000","last_became_active":"2023-05-21T16:54:17.789267+0000","last_became_peered":"2023-05-21T16:54:17.789267+0000","last_unstale":"2023-05-21T16:54:19.151685+0000","last_undegraded":"2023-05-21T16:54:19.151685+0000","last_fullsized":"2023-05-21T16:54:19.151685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:26.101781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154723+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:54:19.154723+0000","last_peered":"2023-05-21T16:54:19.154723+0000","last_clean":"2023-05-21T16:54:19.154723+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:54:19.154723+0000","last_undegraded":"2023-05-21T16:54:19.154723+0000","last_fullsized":"2023-05-21T16:54:19.154723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:02.287898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230335+0000","last_change":"2023-05-21T16:54:18.171372+0000","last_active":"2023-05-21T16:54:19.230335+0000","last_peered":"2023-05-21T16:54:19.230335+0000","last_clean":"2023-05-21T16:54:19.230335+0000","last_became_active":"2023-05-21T16:54:18.171041+0000","last_became_peered":"2023-05-21T16:54:18.171041+0000","last_unstale":"2023-05-21T16:54:19.230335+0000","last_undegraded":"2023-05-21T16:54:19.230335+0000","last_fullsized":"2023-05-21T16:54:19.230335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230870+0000","last_change":"2023-05-21T16:54:18.171452+0000","last_active":"2023-05-21T16:54:19.230870+0000","last_peered":"2023-05-21T16:54:19.230870+0000","last_clean":"2023-05-21T16:54:19.230870+0000","last_became_active":"2023-05-21T16:54:18.170959+0000","last_became_peered":"2023-05-21T16:54:18.170959+0000","last_unstale":"2023-05-21T16:54:19.230870+0000","last_undegraded":"2023-05-21T16:54:19.230870+0000","last_fullsized":"2023-05-21T16:54:19.230870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231346+0000","last_change":"2023-05-21T16:54:17.791905+0000","last_active":"2023-05-21T16:54:19.231346+0000","last_peered":"2023-05-21T16:54:19.231346+0000","last_clean":"2023-05-21T16:54:19.231346+0000","last_became_active":"2023-05-21T16:54:17.791648+0000","last_became_peered":"2023-05-21T16:54:17.791648+0000","last_unstale":"2023-05-21T16:54:19.231346+0000","last_undegraded":"2023-05-21T16:54:19.231346+0000","last_fullsized":"2023-05-21T16:54:19.231346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:43.421675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008777+0000","last_change":"2023-05-21T16:54:18.173713+0000","last_active":"2023-05-21T16:54:20.008777+0000","last_peered":"2023-05-21T16:54:20.008777+0000","last_clean":"2023-05-21T16:54:20.008777+0000","last_became_active":"2023-05-21T16:54:18.173426+0000","last_became_peered":"2023-05-21T16:54:18.173426+0000","last_unstale":"2023-05-21T16:54:20.008777+0000","last_undegraded":"2023-05-21T16:54:20.008777+0000","last_fullsized":"2023-05-21T16:54:20.008777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153630+0000","last_change":"2023-05-21T16:54:17.792289+0000","last_active":"2023-05-21T16:54:19.153630+0000","last_peered":"2023-05-21T16:54:19.153630+0000","last_clean":"2023-05-21T16:54:19.153630+0000","last_became_active":"2023-05-21T16:54:17.791948+0000","last_became_peered":"2023-05-21T16:54:17.791948+0000","last_unstale":"2023-05-21T16:54:19.153630+0000","last_undegraded":"2023-05-21T16:54:19.153630+0000","last_fullsized":"2023-05-21T16:54:19.153630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:07:52.585290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955638+0000","last_change":"2023-05-21T16:54:17.793117+0000","last_active":"2023-05-21T16:54:19.955638+0000","last_peered":"2023-05-21T16:54:19.955638+0000","last_clean":"2023-05-21T16:54:19.955638+0000","last_became_active":"2023-05-21T16:54:17.792787+0000","last_became_peered":"2023-05-21T16:54:17.792787+0000","last_unstale":"2023-05-21T16:54:19.955638+0000","last_undegraded":"2023-05-21T16:54:19.955638+0000","last_fullsized":"2023-05-21T16:54:19.955638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:55.401719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009694+0000","last_change":"2023-05-21T16:54:18.170857+0000","last_active":"2023-05-21T16:54:20.009694+0000","last_peered":"2023-05-21T16:54:20.009694+0000","last_clean":"2023-05-21T16:54:20.009694+0000","last_became_active":"2023-05-21T16:54:18.170581+0000","last_became_peered":"2023-05-21T16:54:18.170581+0000","last_unstale":"2023-05-21T16:54:20.009694+0000","last_undegraded":"2023-05-21T16:54:20.009694+0000","last_fullsized":"2023-05-21T16:54:20.009694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151922+0000","last_change":"2023-05-21T16:54:17.786946+0000","last_active":"2023-05-21T16:54:19.151922+0000","last_peered":"2023-05-21T16:54:19.151922+0000","last_clean":"2023-05-21T16:54:19.151922+0000","last_became_active":"2023-05-21T16:54:17.786198+0000","last_became_peered":"2023-05-21T16:54:17.786198+0000","last_unstale":"2023-05-21T16:54:19.151922+0000","last_undegraded":"2023-05-21T16:54:19.151922+0000","last_fullsized":"2023-05-21T16:54:19.151922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:09.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008455+0000","last_change":"2023-05-21T16:54:18.169451+0000","last_active":"2023-05-21T16:54:20.008455+0000","last_peered":"2023-05-21T16:54:20.008455+0000","last_clean":"2023-05-21T16:54:20.008455+0000","last_became_active":"2023-05-21T16:54:18.169174+0000","last_became_peered":"2023-05-21T16:54:18.169174+0000","last_unstale":"2023-05-21T16:54:20.008455+0000","last_undegraded":"2023-05-21T16:54:20.008455+0000","last_fullsized":"2023-05-21T16:54:20.008455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154470+0000","last_change":"2023-05-21T16:54:18.168251+0000","last_active":"2023-05-21T16:54:19.154470+0000","last_peered":"2023-05-21T16:54:19.154470+0000","last_clean":"2023-05-21T16:54:19.154470+0000","last_became_active":"2023-05-21T16:54:18.167942+0000","last_became_peered":"2023-05-21T16:54:18.167942+0000","last_unstale":"2023-05-21T16:54:19.154470+0000","last_undegraded":"2023-05-21T16:54:19.154470+0000","last_fullsized":"2023-05-21T16:54:19.154470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008745+0000","last_change":"2023-05-21T16:54:17.797264+0000","last_active":"2023-05-21T16:54:20.008745+0000","last_peered":"2023-05-21T16:54:20.008745+0000","last_clean":"2023-05-21T16:54:20.008745+0000","last_became_active":"2023-05-21T16:54:17.796966+0000","last_became_peered":"2023-05-21T16:54:17.796966+0000","last_unstale":"2023-05-21T16:54:20.008745+0000","last_undegraded":"2023-05-21T16:54:20.008745+0000","last_fullsized":"2023-05-21T16:54:20.008745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:06.416563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151506+0000","last_change":"2023-05-21T16:54:18.171476+0000","last_active":"2023-05-21T16:54:19.151506+0000","last_peered":"2023-05-21T16:54:19.151506+0000","last_clean":"2023-05-21T16:54:19.151506+0000","last_became_active":"2023-05-21T16:54:18.171200+0000","last_became_peered":"2023-05-21T16:54:18.171200+0000","last_unstale":"2023-05-21T16:54:19.151506+0000","last_undegraded":"2023-05-21T16:54:19.151506+0000","last_fullsized":"2023-05-21T16:54:19.151506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008926+0000","last_change":"2023-05-21T16:54:17.791998+0000","last_active":"2023-05-21T16:54:20.008926+0000","last_peered":"2023-05-21T16:54:20.008926+0000","last_clean":"2023-05-21T16:54:20.008926+0000","last_became_active":"2023-05-21T16:54:17.791713+0000","last_became_peered":"2023-05-21T16:54:17.791713+0000","last_unstale":"2023-05-21T16:54:20.008926+0000","last_undegraded":"2023-05-21T16:54:20.008926+0000","last_fullsized":"2023-05-21T16:54:20.008926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011837+0000","last_change":"2023-05-21T16:54:18.169485+0000","last_active":"2023-05-21T16:54:20.011837+0000","last_peered":"2023-05-21T16:54:20.011837+0000","last_clean":"2023-05-21T16:54:20.011837+0000","last_became_active":"2023-05-21T16:54:18.169213+0000","last_became_peered":"2023-05-21T16:54:18.169213+0000","last_unstale":"2023-05-21T16:54:20.011837+0000","last_undegraded":"2023-05-21T16:54:20.011837+0000","last_fullsized":"2023-05-21T16:54:20.011837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230735+0000","last_change":"2023-05-21T16:54:17.789625+0000","last_active":"2023-05-21T16:54:19.230735+0000","last_peered":"2023-05-21T16:54:19.230735+0000","last_clean":"2023-05-21T16:54:19.230735+0000","last_became_active":"2023-05-21T16:54:17.789405+0000","last_became_peered":"2023-05-21T16:54:17.789405+0000","last_unstale":"2023-05-21T16:54:19.230735+0000","last_undegraded":"2023-05-21T16:54:19.230735+0000","last_fullsized":"2023-05-21T16:54:19.230735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:25.892052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.508051+0000","last_change":"2023-05-21T16:54:18.177566+0000","last_active":"2023-05-21T16:54:19.508051+0000","last_peered":"2023-05-21T16:54:19.508051+0000","last_clean":"2023-05-21T16:54:19.508051+0000","last_became_active":"2023-05-21T16:54:18.177265+0000","last_became_peered":"2023-05-21T16:54:18.177265+0000","last_unstale":"2023-05-21T16:54:19.508051+0000","last_undegraded":"2023-05-21T16:54:19.508051+0000","last_fullsized":"2023-05-21T16:54:19.508051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151553+0000","last_change":"2023-05-21T16:54:17.789123+0000","last_active":"2023-05-21T16:54:19.151553+0000","last_peered":"2023-05-21T16:54:19.151553+0000","last_clean":"2023-05-21T16:54:19.151553+0000","last_became_active":"2023-05-21T16:54:17.788842+0000","last_became_peered":"2023-05-21T16:54:17.788842+0000","last_unstale":"2023-05-21T16:54:19.151553+0000","last_undegraded":"2023-05-21T16:54:19.151553+0000","last_fullsized":"2023-05-21T16:54:19.151553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:26.181658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230869+0000","last_change":"2023-05-21T16:54:18.179233+0000","last_active":"2023-05-21T16:54:19.230869+0000","last_peered":"2023-05-21T16:54:19.230869+0000","last_clean":"2023-05-21T16:54:19.230869+0000","last_became_active":"2023-05-21T16:54:18.178643+0000","last_became_peered":"2023-05-21T16:54:18.178643+0000","last_unstale":"2023-05-21T16:54:19.230869+0000","last_undegraded":"2023-05-21T16:54:19.230869+0000","last_fullsized":"2023-05-21T16:54:19.230869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955235+0000","last_change":"2023-05-21T16:54:17.786129+0000","last_active":"2023-05-21T16:54:19.955235+0000","last_peered":"2023-05-21T16:54:19.955235+0000","last_clean":"2023-05-21T16:54:19.955235+0000","last_became_active":"2023-05-21T16:54:17.785487+0000","last_became_peered":"2023-05-21T16:54:17.785487+0000","last_unstale":"2023-05-21T16:54:19.955235+0000","last_undegraded":"2023-05-21T16:54:19.955235+0000","last_fullsized":"2023-05-21T16:54:19.955235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230365+0000","last_change":"2023-05-21T16:54:18.175866+0000","last_active":"2023-05-21T16:54:19.230365+0000","last_peered":"2023-05-21T16:54:19.230365+0000","last_clean":"2023-05-21T16:54:19.230365+0000","last_became_active":"2023-05-21T16:54:18.175140+0000","last_became_peered":"2023-05-21T16:54:18.175140+0000","last_unstale":"2023-05-21T16:54:19.230365+0000","last_undegraded":"2023-05-21T16:54:19.230365+0000","last_fullsized":"2023-05-21T16:54:19.230365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956206+0000","last_change":"2023-05-21T16:54:17.786929+0000","last_active":"2023-05-21T16:54:19.956206+0000","last_peered":"2023-05-21T16:54:19.956206+0000","last_clean":"2023-05-21T16:54:19.956206+0000","last_became_active":"2023-05-21T16:54:17.786470+0000","last_became_peered":"2023-05-21T16:54:17.786470+0000","last_unstale":"2023-05-21T16:54:19.956206+0000","last_undegraded":"2023-05-21T16:54:19.956206+0000","last_fullsized":"2023-05-21T16:54:19.956206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:42.194752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010107+0000","last_change":"2023-05-21T16:54:18.173334+0000","last_active":"2023-05-21T16:54:20.010107+0000","last_peered":"2023-05-21T16:54:20.010107+0000","last_clean":"2023-05-21T16:54:20.010107+0000","last_became_active":"2023-05-21T16:54:18.173027+0000","last_became_peered":"2023-05-21T16:54:18.173027+0000","last_unstale":"2023-05-21T16:54:20.010107+0000","last_undegraded":"2023-05-21T16:54:20.010107+0000","last_fullsized":"2023-05-21T16:54:20.010107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010797+0000","last_change":"2023-05-21T16:54:17.788520+0000","last_active":"2023-05-21T16:54:20.010797+0000","last_peered":"2023-05-21T16:54:20.010797+0000","last_clean":"2023-05-21T16:54:20.010797+0000","last_became_active":"2023-05-21T16:54:17.788210+0000","last_became_peered":"2023-05-21T16:54:17.788210+0000","last_unstale":"2023-05-21T16:54:20.010797+0000","last_undegraded":"2023-05-21T16:54:20.010797+0000","last_fullsized":"2023-05-21T16:54:20.010797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229927+0000","last_change":"2023-05-21T16:54:18.175394+0000","last_active":"2023-05-21T16:54:19.229927+0000","last_peered":"2023-05-21T16:54:19.229927+0000","last_clean":"2023-05-21T16:54:19.229927+0000","last_became_active":"2023-05-21T16:54:18.174764+0000","last_became_peered":"2023-05-21T16:54:18.174764+0000","last_unstale":"2023-05-21T16:54:19.229927+0000","last_undegraded":"2023-05-21T16:54:19.229927+0000","last_fullsized":"2023-05-21T16:54:19.229927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151863+0000","last_change":"2023-05-21T16:54:17.786133+0000","last_active":"2023-05-21T16:54:19.151863+0000","last_peered":"2023-05-21T16:54:19.151863+0000","last_clean":"2023-05-21T16:54:19.151863+0000","last_became_active":"2023-05-21T16:54:17.785810+0000","last_became_peered":"2023-05-21T16:54:17.785810+0000","last_unstale":"2023-05-21T16:54:19.151863+0000","last_undegraded":"2023-05-21T16:54:19.151863+0000","last_fullsized":"2023-05-21T16:54:19.151863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:34.911070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12164,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359676,"statfs":{"total":96636764160,"available":96624308224,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12096,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359744,"statfs":{"total":96636764160,"available":96624377856,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12148,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359692,"statfs":{"total":96636764160,"available":96624324608,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13256,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358584,"statfs":{"total":96636764160,"available":96623190016,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:54:21.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:54:21.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5596cc700 1 Processor -- start 2023-05-21T16:54:21.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5596cc700 1 -- start start 2023-05-21T16:54:21.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5596cc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff55415c9b0 0x7ff5540d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5596cc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5540b3ac0 con 0x7ff5540ccaa0 2023-05-21T16:54:21.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5596cc700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5540cf620 con 0x7ff5540709d0 2023-05-21T16:54:21.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5596cc700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5540cc4f0 con 0x7ff55415c9b0 2023-05-21T16:54:21.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5537fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff5540ccaa0 0x7ff5540702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57270/0 (socket says 172.21.15.46:57270) 2023-05-21T16:54:21.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.929+0000 7ff5537fe700 1 -- 172.21.15.46:0/1106186571 learned_addr learned my addr 172.21.15.46:0/1106186571 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:21.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff553fff700 1 --2- 172.21.15.46:0/1106186571 >> v2:172.21.15.142:3300/0 conn(0x7ff55415c9b0 0x7ff5540d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326302815 0 0) 0x7ff5540b3ac0 con 0x7ff5540ccaa0 2023-05-21T16:54:21.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c0035d0 con 0x7ff5540ccaa0 2023-05-21T16:54:21.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650417342 0 0) 0x7ff53c0035d0 con 0x7ff5540ccaa0 2023-05-21T16:54:21.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 >> v2:172.21.15.142:3300/0 conn(0x7ff55415c9b0 msgr2=0x7ff5540d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 --2- 172.21.15.46:0/1106186571 >> v2:172.21.15.142:3300/0 conn(0x7ff55415c9b0 0x7ff5540d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 >> v1:172.21.15.142:6789/0 conn(0x7ff5540709d0 legacy=0x7ff554160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540cf890 con 0x7ff5540ccaa0 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7ff544001670 con 0x7ff5540ccaa0 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 >> v1:172.21.15.46:6789/0 conn(0x7ff5540ccaa0 legacy=0x7ff5540702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff53c003a20 0x7ff53c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c004870 0x7ff53c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff53c005220 0x7ff53c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540cc4f0 con 0x7ff53c005220 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c00c130 con 0x7ff53c003a20 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c00c2f0 con 0x7ff53c004870 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff553fff700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff53c003a20 0x7ff53c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff53c005220 0x7ff53c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5537fe700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c004870 0x7ff53c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 -- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c004870 msgr2=0x7ff53c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c004870 0x7ff53c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 -- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff53c003a20 msgr2=0x7ff53c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff53c003a20 0x7ff53c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 -- 172.21.15.46:0/1106186571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0035d0 con 0x7ff53c005220 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff553fff700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff53c003a20 0x7ff53c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 -- 172.21.15.46:0/1106186571 reap_dead start 2023-05-21T16:54:21.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff558ecb700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff53c005220 0x7ff53c00ba30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00c160 tx=0x7ff53c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e7d48ffecc8138 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c001db0 con 0x7ff53c005220 2023-05-21T16:54:21.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c00ccc0 con 0x7ff53c005220 2023-05-21T16:54:21.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff552ffd700 1 -- 172.21.15.46:0/1106186571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c003c60 con 0x7ff53c005220 2023-05-21T16:54:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 -- 172.21.15.46:0/1106186571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff53c005220 msgr2=0x7ff53c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff53c005220 0x7ff53c00ba30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00c160 tx=0x7ff53c0058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 -- 172.21.15.46:0/1106186571 shutdown_connections 2023-05-21T16:54:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 --2- 172.21.15.46:0/1106186571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff53c005220 0x7ff53c00ba30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 -- 172.21.15.46:0/1106186571 >> 172.21.15.46:0/1106186571 conn(0x7ff5540cd6f0 msgr2=0x7ff5540cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 -- 172.21.15.46:0/1106186571 shutdown_connections 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.933+0000 7ff5596cc700 1 -- 172.21.15.46:0/1106186571 wait complete. 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 Processor -- start 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 -- start start 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c005220 0x7ff5540add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 0x7ff5541577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554157d00 0x7ff5540abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540ad920 con 0x7ff5540c6970 2023-05-21T16:54:21.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554158170 con 0x7ff554157d00 2023-05-21T16:54:21.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540acca0 con 0x7ff53c005220 2023-05-21T16:54:21.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 0x7ff5541577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 0x7ff5541577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58758/0 (socket says 172.21.15.46:58758) 2023-05-21T16:54:21.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 -- 172.21.15.46:0/3934664164 learned_addr learned my addr 172.21.15.46:0/3934664164 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:21.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff558ecb700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554157d00 0x7ff5540abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff553fff700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c005220 0x7ff5540add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 -- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c005220 msgr2=0x7ff5540add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c005220 0x7ff5540add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 -- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554157d00 msgr2=0x7ff5540abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554157d00 0x7ff5540abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 -- 172.21.15.46:0/3934664164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540cd440 con 0x7ff5540c6970 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5537fe700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 0x7ff5541577c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5440072f0 tx=0x7ff544007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400f6c0 con 0x7ff5540c6970 2023-05-21T16:54:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54400f840 con 0x7ff5540c6970 2023-05-21T16:54:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400fbf0 con 0x7ff5540c6970 2023-05-21T16:54:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55415cd80 con 0x7ff5540c6970 2023-05-21T16:54:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.937+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5540cc7d0 con 0x7ff5540c6970 2023-05-21T16:54:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.941+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5540ada60 con 0x7ff5540c6970 2023-05-21T16:54:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.941+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff54400fd50 con 0x7ff5540c6970 2023-05-21T16:54:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.941+0000 7ff550ff9700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5400662f0 0x7ff5400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.941+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff544083300 con 0x7ff5540c6970 2023-05-21T16:54:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.941+0000 7ff553fff700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5400662f0 0x7ff5400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.941+0000 7ff553fff700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5400662f0 0x7ff5400687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff548009d90 tx=0x7ff548009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:21.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:21.949+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff5540ada60 con 0x7ff5540c6970 2023-05-21T16:54:22.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.113+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5540733b0 con 0x7ff5400662f0 2023-05-21T16:54:22.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.125+0000 7ff550ff9700 1 -- 172.21.15.46:0/3934664164 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286717 (secure 0 0 0) 0x7ff5540733b0 con 0x7ff5400662f0 2023-05-21T16:54:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:22.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5400662f0 msgr2=0x7ff5400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5400662f0 0x7ff5400687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff548009d90 tx=0x7ff548009240 comp rx=0 tx=0).stop 2023-05-21T16:54:22.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 msgr2=0x7ff5541577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 0x7ff5541577c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5440072f0 tx=0x7ff544007600 comp rx=0 tx=0).stop 2023-05-21T16:54:22.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 shutdown_connections 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5400662f0 0x7ff5400687a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff554157d00 0x7ff5540abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5540c6970 0x7ff5541577c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 --2- 172.21.15.46:0/3934664164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff53c005220 0x7ff5540add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 >> 172.21.15.46:0/3934664164 conn(0x7ff5540cd6f0 msgr2=0x7ff554159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 shutdown_connections 2023-05-21T16:54:22.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.133+0000 7ff5596cc700 1 -- 172.21.15.46:0/3934664164 wait complete. 2023-05-21T16:54:22.140 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:54:22.152 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-05-21T16:54:20.783062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82876,"kb_used_data":3196,"kb_used_omap":0,"kb_used_meta":79616,"kb_avail":754891844,"statfs":{"total":773094113280,"available":773009248256,"internally_reserved":0,"allocated":3272704,"data_stored":1932967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81526784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031016"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507946+0000","last_change":"2023-05-21T16:54:18.173535+0000","last_active":"2023-05-21T16:54:19.507946+0000","last_peered":"2023-05-21T16:54:19.507946+0000","last_clean":"2023-05-21T16:54:19.507946+0000","last_became_active":"2023-05-21T16:54:18.172985+0000","last_became_peered":"2023-05-21T16:54:18.172985+0000","last_unstale":"2023-05-21T16:54:19.507946+0000","last_undegraded":"2023-05-21T16:54:19.507946+0000","last_fullsized":"2023-05-21T16:54:19.507946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:03:41.302203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955404+0000","last_change":"2023-05-21T16:54:18.168645+0000","last_active":"2023-05-21T16:54:19.955404+0000","last_peered":"2023-05-21T16:54:19.955404+0000","last_clean":"2023-05-21T16:54:19.955404+0000","last_became_active":"2023-05-21T16:54:18.168325+0000","last_became_peered":"2023-05-21T16:54:18.168325+0000","last_unstale":"2023-05-21T16:54:19.955404+0000","last_undegraded":"2023-05-21T16:54:19.955404+0000","last_fullsized":"2023-05-21T16:54:19.955404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231233+0000","last_change":"2023-05-21T16:54:18.174946+0000","last_active":"2023-05-21T16:54:19.231233+0000","last_peered":"2023-05-21T16:54:19.231233+0000","last_clean":"2023-05-21T16:54:19.231233+0000","last_became_active":"2023-05-21T16:54:18.174596+0000","last_became_peered":"2023-05-21T16:54:18.174596+0000","last_unstale":"2023-05-21T16:54:19.231233+0000","last_undegraded":"2023-05-21T16:54:19.231233+0000","last_fullsized":"2023-05-21T16:54:19.231233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153865+0000","last_change":"2023-05-21T16:54:18.168066+0000","last_active":"2023-05-21T16:54:19.153865+0000","last_peered":"2023-05-21T16:54:19.153865+0000","last_clean":"2023-05-21T16:54:19.153865+0000","last_became_active":"2023-05-21T16:54:18.167782+0000","last_became_peered":"2023-05-21T16:54:18.167782+0000","last_unstale":"2023-05-21T16:54:19.153865+0000","last_undegraded":"2023-05-21T16:54:19.153865+0000","last_fullsized":"2023-05-21T16:54:19.153865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:39:57.359288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151402+0000","last_change":"2023-05-21T16:54:18.179965+0000","last_active":"2023-05-21T16:54:19.151402+0000","last_peered":"2023-05-21T16:54:19.151402+0000","last_clean":"2023-05-21T16:54:19.151402+0000","last_became_active":"2023-05-21T16:54:18.179618+0000","last_became_peered":"2023-05-21T16:54:18.179618+0000","last_unstale":"2023-05-21T16:54:19.151402+0000","last_undegraded":"2023-05-21T16:54:19.151402+0000","last_fullsized":"2023-05-21T16:54:19.151402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230210+0000","last_change":"2023-05-21T16:54:18.174594+0000","last_active":"2023-05-21T16:54:19.230210+0000","last_peered":"2023-05-21T16:54:19.230210+0000","last_clean":"2023-05-21T16:54:19.230210+0000","last_became_active":"2023-05-21T16:54:18.170519+0000","last_became_peered":"2023-05-21T16:54:18.170519+0000","last_unstale":"2023-05-21T16:54:19.230210+0000","last_undegraded":"2023-05-21T16:54:19.230210+0000","last_fullsized":"2023-05-21T16:54:19.230210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152878+0000","last_change":"2023-05-21T16:54:18.169270+0000","last_active":"2023-05-21T16:54:19.152878+0000","last_peered":"2023-05-21T16:54:19.152878+0000","last_clean":"2023-05-21T16:54:19.152878+0000","last_became_active":"2023-05-21T16:54:18.168977+0000","last_became_peered":"2023-05-21T16:54:18.168977+0000","last_unstale":"2023-05-21T16:54:19.152878+0000","last_undegraded":"2023-05-21T16:54:19.152878+0000","last_fullsized":"2023-05-21T16:54:19.152878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954983+0000","last_change":"2023-05-21T16:54:18.165262+0000","last_active":"2023-05-21T16:54:19.954983+0000","last_peered":"2023-05-21T16:54:19.954983+0000","last_clean":"2023-05-21T16:54:19.954983+0000","last_became_active":"2023-05-21T16:54:18.164916+0000","last_became_peered":"2023-05-21T16:54:18.164916+0000","last_unstale":"2023-05-21T16:54:19.954983+0000","last_undegraded":"2023-05-21T16:54:19.954983+0000","last_fullsized":"2023-05-21T16:54:19.954983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151737+0000","last_change":"2023-05-21T16:54:18.174319+0000","last_active":"2023-05-21T16:54:19.151737+0000","last_peered":"2023-05-21T16:54:19.151737+0000","last_clean":"2023-05-21T16:54:19.151737+0000","last_became_active":"2023-05-21T16:54:18.174006+0000","last_became_peered":"2023-05-21T16:54:18.174006+0000","last_unstale":"2023-05-21T16:54:19.151737+0000","last_undegraded":"2023-05-21T16:54:19.151737+0000","last_fullsized":"2023-05-21T16:54:19.151737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955479+0000","last_change":"2023-05-21T16:54:18.172783+0000","last_active":"2023-05-21T16:54:19.955479+0000","last_peered":"2023-05-21T16:54:19.955479+0000","last_clean":"2023-05-21T16:54:19.955479+0000","last_became_active":"2023-05-21T16:54:18.172479+0000","last_became_peered":"2023-05-21T16:54:18.172479+0000","last_unstale":"2023-05-21T16:54:19.955479+0000","last_undegraded":"2023-05-21T16:54:19.955479+0000","last_fullsized":"2023-05-21T16:54:19.955479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231502+0000","last_change":"2023-05-21T16:54:18.177992+0000","last_active":"2023-05-21T16:54:19.231502+0000","last_peered":"2023-05-21T16:54:19.231502+0000","last_clean":"2023-05-21T16:54:19.231502+0000","last_became_active":"2023-05-21T16:54:18.177672+0000","last_became_peered":"2023-05-21T16:54:18.177672+0000","last_unstale":"2023-05-21T16:54:19.231502+0000","last_undegraded":"2023-05-21T16:54:19.231502+0000","last_fullsized":"2023-05-21T16:54:19.231502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507861+0000","last_change":"2023-05-21T16:54:18.178845+0000","last_active":"2023-05-21T16:54:19.507861+0000","last_peered":"2023-05-21T16:54:19.507861+0000","last_clean":"2023-05-21T16:54:19.507861+0000","last_became_active":"2023-05-21T16:54:18.178443+0000","last_became_peered":"2023-05-21T16:54:18.178443+0000","last_unstale":"2023-05-21T16:54:19.507861+0000","last_undegraded":"2023-05-21T16:54:19.507861+0000","last_fullsized":"2023-05-21T16:54:19.507861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:04.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507567+0000","last_change":"2023-05-21T16:54:18.173619+0000","last_active":"2023-05-21T16:54:19.507567+0000","last_peered":"2023-05-21T16:54:19.507567+0000","last_clean":"2023-05-21T16:54:19.507567+0000","last_became_active":"2023-05-21T16:54:18.173111+0000","last_became_peered":"2023-05-21T16:54:18.173111+0000","last_unstale":"2023-05-21T16:54:19.507567+0000","last_undegraded":"2023-05-21T16:54:19.507567+0000","last_fullsized":"2023-05-21T16:54:19.507567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:59:59.660879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955292+0000","last_change":"2023-05-21T16:54:18.161833+0000","last_active":"2023-05-21T16:54:19.955292+0000","last_peered":"2023-05-21T16:54:19.955292+0000","last_clean":"2023-05-21T16:54:19.955292+0000","last_became_active":"2023-05-21T16:54:18.161537+0000","last_became_peered":"2023-05-21T16:54:18.161537+0000","last_unstale":"2023-05-21T16:54:19.955292+0000","last_undegraded":"2023-05-21T16:54:19.955292+0000","last_fullsized":"2023-05-21T16:54:19.955292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153194+0000","last_change":"2023-05-21T16:54:18.167967+0000","last_active":"2023-05-21T16:54:19.153194+0000","last_peered":"2023-05-21T16:54:19.153194+0000","last_clean":"2023-05-21T16:54:19.153194+0000","last_became_active":"2023-05-21T16:54:18.167679+0000","last_became_peered":"2023-05-21T16:54:18.167679+0000","last_unstale":"2023-05-21T16:54:19.153194+0000","last_undegraded":"2023-05-21T16:54:19.153194+0000","last_fullsized":"2023-05-21T16:54:19.153194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229833+0000","last_change":"2023-05-21T16:54:18.174428+0000","last_active":"2023-05-21T16:54:19.229833+0000","last_peered":"2023-05-21T16:54:19.229833+0000","last_clean":"2023-05-21T16:54:19.229833+0000","last_became_active":"2023-05-21T16:54:18.171683+0000","last_became_peered":"2023-05-21T16:54:18.171683+0000","last_unstale":"2023-05-21T16:54:19.229833+0000","last_undegraded":"2023-05-21T16:54:19.229833+0000","last_fullsized":"2023-05-21T16:54:19.229833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151801+0000","last_change":"2023-05-21T16:54:18.174341+0000","last_active":"2023-05-21T16:54:19.151801+0000","last_peered":"2023-05-21T16:54:19.151801+0000","last_clean":"2023-05-21T16:54:19.151801+0000","last_became_active":"2023-05-21T16:54:18.172475+0000","last_became_peered":"2023-05-21T16:54:18.172475+0000","last_unstale":"2023-05-21T16:54:19.151801+0000","last_undegraded":"2023-05-21T16:54:19.151801+0000","last_fullsized":"2023-05-21T16:54:19.151801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230882+0000","last_change":"2023-05-21T16:54:18.172503+0000","last_active":"2023-05-21T16:54:19.230882+0000","last_peered":"2023-05-21T16:54:19.230882+0000","last_clean":"2023-05-21T16:54:19.230882+0000","last_became_active":"2023-05-21T16:54:18.171759+0000","last_became_peered":"2023-05-21T16:54:18.171759+0000","last_unstale":"2023-05-21T16:54:19.230882+0000","last_undegraded":"2023-05-21T16:54:19.230882+0000","last_fullsized":"2023-05-21T16:54:19.230882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507738+0000","last_change":"2023-05-21T16:54:18.177321+0000","last_active":"2023-05-21T16:54:19.507738+0000","last_peered":"2023-05-21T16:54:19.507738+0000","last_clean":"2023-05-21T16:54:19.507738+0000","last_became_active":"2023-05-21T16:54:18.177032+0000","last_became_peered":"2023-05-21T16:54:18.177032+0000","last_unstale":"2023-05-21T16:54:19.507738+0000","last_undegraded":"2023-05-21T16:54:19.507738+0000","last_fullsized":"2023-05-21T16:54:19.507738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:53:28.141995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231058+0000","last_change":"2023-05-21T16:54:18.174907+0000","last_active":"2023-05-21T16:54:19.231058+0000","last_peered":"2023-05-21T16:54:19.231058+0000","last_clean":"2023-05-21T16:54:19.231058+0000","last_became_active":"2023-05-21T16:54:18.174528+0000","last_became_peered":"2023-05-21T16:54:18.174528+0000","last_unstale":"2023-05-21T16:54:19.231058+0000","last_undegraded":"2023-05-21T16:54:19.231058+0000","last_fullsized":"2023-05-21T16:54:19.231058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153215+0000","last_change":"2023-05-21T16:54:18.172031+0000","last_active":"2023-05-21T16:54:19.153215+0000","last_peered":"2023-05-21T16:54:19.153215+0000","last_clean":"2023-05-21T16:54:19.153215+0000","last_became_active":"2023-05-21T16:54:18.170754+0000","last_became_peered":"2023-05-21T16:54:18.170754+0000","last_unstale":"2023-05-21T16:54:19.153215+0000","last_undegraded":"2023-05-21T16:54:19.153215+0000","last_fullsized":"2023-05-21T16:54:19.153215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151032+0000","last_change":"2023-05-21T16:54:18.177700+0000","last_active":"2023-05-21T16:54:19.151032+0000","last_peered":"2023-05-21T16:54:19.151032+0000","last_clean":"2023-05-21T16:54:19.151032+0000","last_became_active":"2023-05-21T16:54:18.177419+0000","last_became_peered":"2023-05-21T16:54:18.177419+0000","last_unstale":"2023-05-21T16:54:19.151032+0000","last_undegraded":"2023-05-21T16:54:19.151032+0000","last_fullsized":"2023-05-21T16:54:19.151032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009407+0000","last_change":"2023-05-21T16:54:18.173893+0000","last_active":"2023-05-21T16:54:20.009407+0000","last_peered":"2023-05-21T16:54:20.009407+0000","last_clean":"2023-05-21T16:54:20.009407+0000","last_became_active":"2023-05-21T16:54:18.173618+0000","last_became_peered":"2023-05-21T16:54:18.173618+0000","last_unstale":"2023-05-21T16:54:20.009407+0000","last_undegraded":"2023-05-21T16:54:20.009407+0000","last_fullsized":"2023-05-21T16:54:20.009407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152740+0000","last_change":"2023-05-21T16:54:18.178690+0000","last_active":"2023-05-21T16:54:19.152740+0000","last_peered":"2023-05-21T16:54:19.152740+0000","last_clean":"2023-05-21T16:54:19.152740+0000","last_became_active":"2023-05-21T16:54:18.178395+0000","last_became_peered":"2023-05-21T16:54:18.178395+0000","last_unstale":"2023-05-21T16:54:19.152740+0000","last_undegraded":"2023-05-21T16:54:19.152740+0000","last_fullsized":"2023-05-21T16:54:19.152740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010601+0000","last_change":"2023-05-21T16:54:18.174128+0000","last_active":"2023-05-21T16:54:20.010601+0000","last_peered":"2023-05-21T16:54:20.010601+0000","last_clean":"2023-05-21T16:54:20.010601+0000","last_became_active":"2023-05-21T16:54:18.173436+0000","last_became_peered":"2023-05-21T16:54:18.173436+0000","last_unstale":"2023-05-21T16:54:20.010601+0000","last_undegraded":"2023-05-21T16:54:20.010601+0000","last_fullsized":"2023-05-21T16:54:20.010601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010387+0000","last_change":"2023-05-21T16:54:18.166373+0000","last_active":"2023-05-21T16:54:20.010387+0000","last_peered":"2023-05-21T16:54:20.010387+0000","last_clean":"2023-05-21T16:54:20.010387+0000","last_became_active":"2023-05-21T16:54:18.166106+0000","last_became_peered":"2023-05-21T16:54:18.166106+0000","last_unstale":"2023-05-21T16:54:20.010387+0000","last_undegraded":"2023-05-21T16:54:20.010387+0000","last_fullsized":"2023-05-21T16:54:20.010387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955908+0000","last_change":"2023-05-21T16:54:18.165081+0000","last_active":"2023-05-21T16:54:19.955908+0000","last_peered":"2023-05-21T16:54:19.955908+0000","last_clean":"2023-05-21T16:54:19.955908+0000","last_became_active":"2023-05-21T16:54:18.164749+0000","last_became_peered":"2023-05-21T16:54:18.164749+0000","last_unstale":"2023-05-21T16:54:19.955908+0000","last_undegraded":"2023-05-21T16:54:19.955908+0000","last_fullsized":"2023-05-21T16:54:19.955908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010630+0000","last_change":"2023-05-21T16:54:18.178240+0000","last_active":"2023-05-21T16:54:20.010630+0000","last_peered":"2023-05-21T16:54:20.010630+0000","last_clean":"2023-05-21T16:54:20.010630+0000","last_became_active":"2023-05-21T16:54:18.177953+0000","last_became_peered":"2023-05-21T16:54:18.177953+0000","last_unstale":"2023-05-21T16:54:20.010630+0000","last_undegraded":"2023-05-21T16:54:20.010630+0000","last_fullsized":"2023-05-21T16:54:20.010630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011193+0000","last_change":"2023-05-21T16:54:18.171995+0000","last_active":"2023-05-21T16:54:20.011193+0000","last_peered":"2023-05-21T16:54:20.011193+0000","last_clean":"2023-05-21T16:54:20.011193+0000","last_became_active":"2023-05-21T16:54:18.170850+0000","last_became_peered":"2023-05-21T16:54:18.170850+0000","last_unstale":"2023-05-21T16:54:20.011193+0000","last_undegraded":"2023-05-21T16:54:20.011193+0000","last_fullsized":"2023-05-21T16:54:20.011193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230580+0000","last_change":"2023-05-21T16:54:18.175264+0000","last_active":"2023-05-21T16:54:19.230580+0000","last_peered":"2023-05-21T16:54:19.230580+0000","last_clean":"2023-05-21T16:54:19.230580+0000","last_became_active":"2023-05-21T16:54:18.174923+0000","last_became_peered":"2023-05-21T16:54:18.174923+0000","last_unstale":"2023-05-21T16:54:19.230580+0000","last_undegraded":"2023-05-21T16:54:19.230580+0000","last_fullsized":"2023-05-21T16:54:19.230580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009553+0000","last_change":"2023-05-21T16:54:18.178259+0000","last_active":"2023-05-21T16:54:20.009553+0000","last_peered":"2023-05-21T16:54:20.009553+0000","last_clean":"2023-05-21T16:54:20.009553+0000","last_became_active":"2023-05-21T16:54:18.177972+0000","last_became_peered":"2023-05-21T16:54:18.177972+0000","last_unstale":"2023-05-21T16:54:20.009553+0000","last_undegraded":"2023-05-21T16:54:20.009553+0000","last_fullsized":"2023-05-21T16:54:20.009553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153058+0000","last_change":"2023-05-21T16:54:18.169342+0000","last_active":"2023-05-21T16:54:19.153058+0000","last_peered":"2023-05-21T16:54:19.153058+0000","last_clean":"2023-05-21T16:54:19.153058+0000","last_became_active":"2023-05-21T16:54:18.169078+0000","last_became_peered":"2023-05-21T16:54:18.169078+0000","last_unstale":"2023-05-21T16:54:19.153058+0000","last_undegraded":"2023-05-21T16:54:19.153058+0000","last_fullsized":"2023-05-21T16:54:19.153058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011024+0000","last_change":"2023-05-21T16:54:18.178151+0000","last_active":"2023-05-21T16:54:20.011024+0000","last_peered":"2023-05-21T16:54:20.011024+0000","last_clean":"2023-05-21T16:54:20.011024+0000","last_became_active":"2023-05-21T16:54:18.177832+0000","last_became_peered":"2023-05-21T16:54:18.177832+0000","last_unstale":"2023-05-21T16:54:20.011024+0000","last_undegraded":"2023-05-21T16:54:20.011024+0000","last_fullsized":"2023-05-21T16:54:20.011024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153512+0000","last_change":"2023-05-21T16:54:17.791377+0000","last_active":"2023-05-21T16:54:19.153512+0000","last_peered":"2023-05-21T16:54:19.153512+0000","last_clean":"2023-05-21T16:54:19.153512+0000","last_became_active":"2023-05-21T16:54:17.791033+0000","last_became_peered":"2023-05-21T16:54:17.791033+0000","last_unstale":"2023-05-21T16:54:19.153512+0000","last_undegraded":"2023-05-21T16:54:19.153512+0000","last_fullsized":"2023-05-21T16:54:19.153512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956058+0000","last_change":"2023-05-21T16:54:18.160039+0000","last_active":"2023-05-21T16:54:19.956058+0000","last_peered":"2023-05-21T16:54:19.956058+0000","last_clean":"2023-05-21T16:54:19.956058+0000","last_became_active":"2023-05-21T16:54:18.159784+0000","last_became_peered":"2023-05-21T16:54:18.159784+0000","last_unstale":"2023-05-21T16:54:19.956058+0000","last_undegraded":"2023-05-21T16:54:19.956058+0000","last_fullsized":"2023-05-21T16:54:19.956058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151174+0000","last_change":"2023-05-21T16:54:17.793000+0000","last_active":"2023-05-21T16:54:19.151174+0000","last_peered":"2023-05-21T16:54:19.151174+0000","last_clean":"2023-05-21T16:54:19.151174+0000","last_became_active":"2023-05-21T16:54:17.792628+0000","last_became_peered":"2023-05-21T16:54:17.792628+0000","last_unstale":"2023-05-21T16:54:19.151174+0000","last_undegraded":"2023-05-21T16:54:19.151174+0000","last_fullsized":"2023-05-21T16:54:19.151174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151621+0000","last_change":"2023-05-21T16:54:18.171993+0000","last_active":"2023-05-21T16:54:19.151621+0000","last_peered":"2023-05-21T16:54:19.151621+0000","last_clean":"2023-05-21T16:54:19.151621+0000","last_became_active":"2023-05-21T16:54:18.171691+0000","last_became_peered":"2023-05-21T16:54:18.171691+0000","last_unstale":"2023-05-21T16:54:19.151621+0000","last_undegraded":"2023-05-21T16:54:19.151621+0000","last_fullsized":"2023-05-21T16:54:19.151621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153638+0000","last_change":"2023-05-21T16:54:17.792641+0000","last_active":"2023-05-21T16:54:19.153638+0000","last_peered":"2023-05-21T16:54:19.153638+0000","last_clean":"2023-05-21T16:54:19.153638+0000","last_became_active":"2023-05-21T16:54:17.792197+0000","last_became_peered":"2023-05-21T16:54:17.792197+0000","last_unstale":"2023-05-21T16:54:19.153638+0000","last_undegraded":"2023-05-21T16:54:19.153638+0000","last_fullsized":"2023-05-21T16:54:19.153638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:46:25.331076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011544+0000","last_change":"2023-05-21T16:54:18.171873+0000","last_active":"2023-05-21T16:54:20.011544+0000","last_peered":"2023-05-21T16:54:20.011544+0000","last_clean":"2023-05-21T16:54:20.011544+0000","last_became_active":"2023-05-21T16:54:18.171463+0000","last_became_peered":"2023-05-21T16:54:18.171463+0000","last_unstale":"2023-05-21T16:54:20.011544+0000","last_undegraded":"2023-05-21T16:54:20.011544+0000","last_fullsized":"2023-05-21T16:54:20.011544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153427+0000","last_change":"2023-05-21T16:54:17.793533+0000","last_active":"2023-05-21T16:54:19.153427+0000","last_peered":"2023-05-21T16:54:19.153427+0000","last_clean":"2023-05-21T16:54:19.153427+0000","last_became_active":"2023-05-21T16:54:17.793152+0000","last_became_peered":"2023-05-21T16:54:17.793152+0000","last_unstale":"2023-05-21T16:54:19.153427+0000","last_undegraded":"2023-05-21T16:54:19.153427+0000","last_fullsized":"2023-05-21T16:54:19.153427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:40:00.667703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154574+0000","last_change":"2023-05-21T16:54:17.792133+0000","last_active":"2023-05-21T16:54:19.154574+0000","last_peered":"2023-05-21T16:54:19.154574+0000","last_clean":"2023-05-21T16:54:19.154574+0000","last_became_active":"2023-05-21T16:54:17.791681+0000","last_became_peered":"2023-05-21T16:54:17.791681+0000","last_unstale":"2023-05-21T16:54:19.154574+0000","last_undegraded":"2023-05-21T16:54:19.154574+0000","last_fullsized":"2023-05-21T16:54:19.154574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:46:05.629379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954986+0000","last_change":"2023-05-21T16:54:18.159536+0000","last_active":"2023-05-21T16:54:19.954986+0000","last_peered":"2023-05-21T16:54:19.954986+0000","last_clean":"2023-05-21T16:54:19.954986+0000","last_became_active":"2023-05-21T16:54:18.158995+0000","last_became_peered":"2023-05-21T16:54:18.158995+0000","last_unstale":"2023-05-21T16:54:19.954986+0000","last_undegraded":"2023-05-21T16:54:19.954986+0000","last_fullsized":"2023-05-21T16:54:19.954986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153940+0000","last_change":"2023-05-21T16:54:17.791717+0000","last_active":"2023-05-21T16:54:19.153940+0000","last_peered":"2023-05-21T16:54:19.153940+0000","last_clean":"2023-05-21T16:54:19.153940+0000","last_became_active":"2023-05-21T16:54:17.791323+0000","last_became_peered":"2023-05-21T16:54:17.791323+0000","last_unstale":"2023-05-21T16:54:19.153940+0000","last_undegraded":"2023-05-21T16:54:19.153940+0000","last_fullsized":"2023-05-21T16:54:19.153940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:30:06.548887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229939+0000","last_change":"2023-05-21T16:54:18.176794+0000","last_active":"2023-05-21T16:54:19.229939+0000","last_peered":"2023-05-21T16:54:19.229939+0000","last_clean":"2023-05-21T16:54:19.229939+0000","last_became_active":"2023-05-21T16:54:18.176500+0000","last_became_peered":"2023-05-21T16:54:18.176500+0000","last_unstale":"2023-05-21T16:54:19.229939+0000","last_undegraded":"2023-05-21T16:54:19.229939+0000","last_fullsized":"2023-05-21T16:54:19.229939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153977+0000","last_change":"2023-05-21T16:54:17.791693+0000","last_active":"2023-05-21T16:54:19.153977+0000","last_peered":"2023-05-21T16:54:19.153977+0000","last_clean":"2023-05-21T16:54:19.153977+0000","last_became_active":"2023-05-21T16:54:17.790907+0000","last_became_peered":"2023-05-21T16:54:17.790907+0000","last_unstale":"2023-05-21T16:54:19.153977+0000","last_undegraded":"2023-05-21T16:54:19.153977+0000","last_fullsized":"2023-05-21T16:54:19.153977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:48.881822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153098+0000","last_change":"2023-05-21T16:54:18.176109+0000","last_active":"2023-05-21T16:54:19.153098+0000","last_peered":"2023-05-21T16:54:19.153098+0000","last_clean":"2023-05-21T16:54:19.153098+0000","last_became_active":"2023-05-21T16:54:18.175825+0000","last_became_peered":"2023-05-21T16:54:18.175825+0000","last_unstale":"2023-05-21T16:54:19.153098+0000","last_undegraded":"2023-05-21T16:54:19.153098+0000","last_fullsized":"2023-05-21T16:54:19.153098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:16.831930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955462+0000","last_change":"2023-05-21T16:54:17.785136+0000","last_active":"2023-05-21T16:54:19.955462+0000","last_peered":"2023-05-21T16:54:19.955462+0000","last_clean":"2023-05-21T16:54:19.955462+0000","last_became_active":"2023-05-21T16:54:17.784827+0000","last_became_peered":"2023-05-21T16:54:17.784827+0000","last_unstale":"2023-05-21T16:54:19.955462+0000","last_undegraded":"2023-05-21T16:54:19.955462+0000","last_fullsized":"2023-05-21T16:54:19.955462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151228+0000","last_change":"2023-05-21T16:54:18.177151+0000","last_active":"2023-05-21T16:54:19.151228+0000","last_peered":"2023-05-21T16:54:19.151228+0000","last_clean":"2023-05-21T16:54:19.151228+0000","last_became_active":"2023-05-21T16:54:18.176855+0000","last_became_peered":"2023-05-21T16:54:18.176855+0000","last_unstale":"2023-05-21T16:54:19.151228+0000","last_undegraded":"2023-05-21T16:54:19.151228+0000","last_fullsized":"2023-05-21T16:54:19.151228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011786+0000","last_change":"2023-05-21T16:54:17.797286+0000","last_active":"2023-05-21T16:54:20.011786+0000","last_peered":"2023-05-21T16:54:20.011786+0000","last_clean":"2023-05-21T16:54:20.011786+0000","last_became_active":"2023-05-21T16:54:17.796986+0000","last_became_peered":"2023-05-21T16:54:17.796986+0000","last_unstale":"2023-05-21T16:54:20.011786+0000","last_undegraded":"2023-05-21T16:54:20.011786+0000","last_fullsized":"2023-05-21T16:54:20.011786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231228+0000","last_change":"2023-05-21T16:54:18.178953+0000","last_active":"2023-05-21T16:54:19.231228+0000","last_peered":"2023-05-21T16:54:19.231228+0000","last_clean":"2023-05-21T16:54:19.231228+0000","last_became_active":"2023-05-21T16:54:18.178614+0000","last_became_peered":"2023-05-21T16:54:18.178614+0000","last_unstale":"2023-05-21T16:54:19.231228+0000","last_undegraded":"2023-05-21T16:54:19.231228+0000","last_fullsized":"2023-05-21T16:54:19.231228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:56.406296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154181+0000","last_change":"2023-05-21T16:54:17.788405+0000","last_active":"2023-05-21T16:54:19.154181+0000","last_peered":"2023-05-21T16:54:19.154181+0000","last_clean":"2023-05-21T16:54:19.154181+0000","last_became_active":"2023-05-21T16:54:17.788095+0000","last_became_peered":"2023-05-21T16:54:17.788095+0000","last_unstale":"2023-05-21T16:54:19.154181+0000","last_undegraded":"2023-05-21T16:54:19.154181+0000","last_fullsized":"2023-05-21T16:54:19.154181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231523+0000","last_change":"2023-05-21T16:54:18.171511+0000","last_active":"2023-05-21T16:54:19.231523+0000","last_peered":"2023-05-21T16:54:19.231523+0000","last_clean":"2023-05-21T16:54:19.231523+0000","last_became_active":"2023-05-21T16:54:18.171154+0000","last_became_peered":"2023-05-21T16:54:18.171154+0000","last_unstale":"2023-05-21T16:54:19.231523+0000","last_undegraded":"2023-05-21T16:54:19.231523+0000","last_fullsized":"2023-05-21T16:54:19.231523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:20.770522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230303+0000","last_change":"2023-05-21T16:54:17.786737+0000","last_active":"2023-05-21T16:54:19.230303+0000","last_peered":"2023-05-21T16:54:19.230303+0000","last_clean":"2023-05-21T16:54:19.230303+0000","last_became_active":"2023-05-21T16:54:17.786296+0000","last_became_peered":"2023-05-21T16:54:17.786296+0000","last_unstale":"2023-05-21T16:54:19.230303+0000","last_undegraded":"2023-05-21T16:54:19.230303+0000","last_fullsized":"2023-05-21T16:54:19.230303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230914+0000","last_change":"2023-05-21T16:54:18.174307+0000","last_active":"2023-05-21T16:54:19.230914+0000","last_peered":"2023-05-21T16:54:19.230914+0000","last_clean":"2023-05-21T16:54:19.230914+0000","last_became_active":"2023-05-21T16:54:18.172216+0000","last_became_peered":"2023-05-21T16:54:18.172216+0000","last_unstale":"2023-05-21T16:54:19.230914+0000","last_undegraded":"2023-05-21T16:54:19.230914+0000","last_fullsized":"2023-05-21T16:54:19.230914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009210+0000","last_change":"2023-05-21T16:54:17.789635+0000","last_active":"2023-05-21T16:54:20.009210+0000","last_peered":"2023-05-21T16:54:20.009210+0000","last_clean":"2023-05-21T16:54:20.009210+0000","last_became_active":"2023-05-21T16:54:17.789269+0000","last_became_peered":"2023-05-21T16:54:17.789269+0000","last_unstale":"2023-05-21T16:54:20.009210+0000","last_undegraded":"2023-05-21T16:54:20.009210+0000","last_fullsized":"2023-05-21T16:54:20.009210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010922+0000","last_change":"2023-05-21T16:54:18.172894+0000","last_active":"2023-05-21T16:54:20.010922+0000","last_peered":"2023-05-21T16:54:20.010922+0000","last_clean":"2023-05-21T16:54:20.010922+0000","last_became_active":"2023-05-21T16:54:18.172589+0000","last_became_peered":"2023-05-21T16:54:18.172589+0000","last_unstale":"2023-05-21T16:54:20.010922+0000","last_undegraded":"2023-05-21T16:54:20.010922+0000","last_fullsized":"2023-05-21T16:54:20.010922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152965+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:54:19.152965+0000","last_peered":"2023-05-21T16:54:19.152965+0000","last_clean":"2023-05-21T16:54:19.152965+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:54:19.152965+0000","last_undegraded":"2023-05-21T16:54:19.152965+0000","last_fullsized":"2023-05-21T16:54:19.152965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:58:58.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955263+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:54:19.955263+0000","last_peered":"2023-05-21T16:54:19.955263+0000","last_clean":"2023-05-21T16:54:19.955263+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:54:19.955263+0000","last_undegraded":"2023-05-21T16:54:19.955263+0000","last_fullsized":"2023-05-21T16:54:19.955263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011043+0000","last_change":"2023-05-21T16:54:17.787923+0000","last_active":"2023-05-21T16:54:20.011043+0000","last_peered":"2023-05-21T16:54:20.011043+0000","last_clean":"2023-05-21T16:54:20.011043+0000","last_became_active":"2023-05-21T16:54:17.786954+0000","last_became_peered":"2023-05-21T16:54:17.786954+0000","last_unstale":"2023-05-21T16:54:20.011043+0000","last_undegraded":"2023-05-21T16:54:20.011043+0000","last_fullsized":"2023-05-21T16:54:20.011043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154038+0000","last_change":"2023-05-21T16:54:18.178971+0000","last_active":"2023-05-21T16:54:19.154038+0000","last_peered":"2023-05-21T16:54:19.154038+0000","last_clean":"2023-05-21T16:54:19.154038+0000","last_became_active":"2023-05-21T16:54:18.178660+0000","last_became_peered":"2023-05-21T16:54:18.178660+0000","last_unstale":"2023-05-21T16:54:19.154038+0000","last_undegraded":"2023-05-21T16:54:19.154038+0000","last_fullsized":"2023-05-21T16:54:19.154038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152822+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:54:19.152822+0000","last_peered":"2023-05-21T16:54:19.152822+0000","last_clean":"2023-05-21T16:54:19.152822+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:54:19.152822+0000","last_undegraded":"2023-05-21T16:54:19.152822+0000","last_fullsized":"2023-05-21T16:54:19.152822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:51.273053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151242+0000","last_change":"2023-05-21T16:54:17.789501+0000","last_active":"2023-05-21T16:54:19.151242+0000","last_peered":"2023-05-21T16:54:19.151242+0000","last_clean":"2023-05-21T16:54:19.151242+0000","last_became_active":"2023-05-21T16:54:17.789206+0000","last_became_peered":"2023-05-21T16:54:17.789206+0000","last_unstale":"2023-05-21T16:54:19.151242+0000","last_undegraded":"2023-05-21T16:54:19.151242+0000","last_fullsized":"2023-05-21T16:54:19.151242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:23.152767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151696+0000","last_change":"2023-05-21T16:54:18.177266+0000","last_active":"2023-05-21T16:54:19.151696+0000","last_peered":"2023-05-21T16:54:19.151696+0000","last_clean":"2023-05-21T16:54:19.151696+0000","last_became_active":"2023-05-21T16:54:18.176940+0000","last_became_peered":"2023-05-21T16:54:18.176940+0000","last_unstale":"2023-05-21T16:54:19.151696+0000","last_undegraded":"2023-05-21T16:54:19.151696+0000","last_fullsized":"2023-05-21T16:54:19.151696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507390+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:54:19.507390+0000","last_peered":"2023-05-21T16:54:19.507390+0000","last_clean":"2023-05-21T16:54:19.507390+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:54:19.507390+0000","last_undegraded":"2023-05-21T16:54:19.507390+0000","last_fullsized":"2023-05-21T16:54:19.507390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:33:24.899208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.007932+0000","last_change":"2023-05-21T16:54:17.788365+0000","last_active":"2023-05-21T16:54:20.007932+0000","last_peered":"2023-05-21T16:54:20.007932+0000","last_clean":"2023-05-21T16:54:20.007932+0000","last_became_active":"2023-05-21T16:54:17.788057+0000","last_became_peered":"2023-05-21T16:54:17.788057+0000","last_unstale":"2023-05-21T16:54:20.007932+0000","last_undegraded":"2023-05-21T16:54:20.007932+0000","last_fullsized":"2023-05-21T16:54:20.007932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011232+0000","last_change":"2023-05-21T16:54:18.171962+0000","last_active":"2023-05-21T16:54:20.011232+0000","last_peered":"2023-05-21T16:54:20.011232+0000","last_clean":"2023-05-21T16:54:20.011232+0000","last_became_active":"2023-05-21T16:54:18.171665+0000","last_became_peered":"2023-05-21T16:54:18.171665+0000","last_unstale":"2023-05-21T16:54:20.011232+0000","last_undegraded":"2023-05-21T16:54:20.011232+0000","last_fullsized":"2023-05-21T16:54:20.011232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955100+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:54:19.955100+0000","last_peered":"2023-05-21T16:54:19.955100+0000","last_clean":"2023-05-21T16:54:19.955100+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:54:19.955100+0000","last_undegraded":"2023-05-21T16:54:19.955100+0000","last_fullsized":"2023-05-21T16:54:19.955100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:21.763386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231112+0000","last_change":"2023-05-21T16:54:17.793714+0000","last_active":"2023-05-21T16:54:19.231112+0000","last_peered":"2023-05-21T16:54:19.231112+0000","last_clean":"2023-05-21T16:54:19.231112+0000","last_became_active":"2023-05-21T16:54:17.793497+0000","last_became_peered":"2023-05-21T16:54:17.793497+0000","last_unstale":"2023-05-21T16:54:19.231112+0000","last_undegraded":"2023-05-21T16:54:19.231112+0000","last_fullsized":"2023-05-21T16:54:19.231112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:32.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010033+0000","last_change":"2023-05-21T16:54:18.172642+0000","last_active":"2023-05-21T16:54:20.010033+0000","last_peered":"2023-05-21T16:54:20.010033+0000","last_clean":"2023-05-21T16:54:20.010033+0000","last_became_active":"2023-05-21T16:54:18.172368+0000","last_became_peered":"2023-05-21T16:54:18.172368+0000","last_unstale":"2023-05-21T16:54:20.010033+0000","last_undegraded":"2023-05-21T16:54:20.010033+0000","last_fullsized":"2023-05-21T16:54:20.010033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956342+0000","last_change":"2023-05-21T16:54:17.786742+0000","last_active":"2023-05-21T16:54:19.956342+0000","last_peered":"2023-05-21T16:54:19.956342+0000","last_clean":"2023-05-21T16:54:19.956342+0000","last_became_active":"2023-05-21T16:54:17.785555+0000","last_became_peered":"2023-05-21T16:54:17.785555+0000","last_unstale":"2023-05-21T16:54:19.956342+0000","last_undegraded":"2023-05-21T16:54:19.956342+0000","last_fullsized":"2023-05-21T16:54:19.956342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011595+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:54:20.011595+0000","last_peered":"2023-05-21T16:54:20.011595+0000","last_clean":"2023-05-21T16:54:20.011595+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:54:20.011595+0000","last_undegraded":"2023-05-21T16:54:20.011595+0000","last_fullsized":"2023-05-21T16:54:20.011595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:28.413313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009230+0000","last_change":"2023-05-21T16:54:18.168021+0000","last_active":"2023-05-21T16:54:20.009230+0000","last_peered":"2023-05-21T16:54:20.009230+0000","last_clean":"2023-05-21T16:54:20.009230+0000","last_became_active":"2023-05-21T16:54:18.167737+0000","last_became_peered":"2023-05-21T16:54:18.167737+0000","last_unstale":"2023-05-21T16:54:20.009230+0000","last_undegraded":"2023-05-21T16:54:20.009230+0000","last_fullsized":"2023-05-21T16:54:20.009230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010243+0000","last_change":"2023-05-21T16:54:17.790619+0000","last_active":"2023-05-21T16:54:20.010243+0000","last_peered":"2023-05-21T16:54:20.010243+0000","last_clean":"2023-05-21T16:54:20.010243+0000","last_became_active":"2023-05-21T16:54:17.790299+0000","last_became_peered":"2023-05-21T16:54:17.790299+0000","last_unstale":"2023-05-21T16:54:20.010243+0000","last_undegraded":"2023-05-21T16:54:20.010243+0000","last_fullsized":"2023-05-21T16:54:20.010243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154364+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:54:19.154364+0000","last_peered":"2023-05-21T16:54:19.154364+0000","last_clean":"2023-05-21T16:54:19.154364+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:54:19.154364+0000","last_undegraded":"2023-05-21T16:54:19.154364+0000","last_fullsized":"2023-05-21T16:54:19.154364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:10:31.136089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151575+0000","last_change":"2023-05-21T16:54:18.171071+0000","last_active":"2023-05-21T16:54:19.151575+0000","last_peered":"2023-05-21T16:54:19.151575+0000","last_clean":"2023-05-21T16:54:19.151575+0000","last_became_active":"2023-05-21T16:54:18.170780+0000","last_became_peered":"2023-05-21T16:54:18.170780+0000","last_unstale":"2023-05-21T16:54:19.151575+0000","last_undegraded":"2023-05-21T16:54:19.151575+0000","last_fullsized":"2023-05-21T16:54:19.151575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011773+0000","last_change":"2023-05-21T16:54:17.797231+0000","last_active":"2023-05-21T16:54:20.011773+0000","last_peered":"2023-05-21T16:54:20.011773+0000","last_clean":"2023-05-21T16:54:20.011773+0000","last_became_active":"2023-05-21T16:54:17.796914+0000","last_became_peered":"2023-05-21T16:54:17.796914+0000","last_unstale":"2023-05-21T16:54:20.011773+0000","last_undegraded":"2023-05-21T16:54:20.011773+0000","last_fullsized":"2023-05-21T16:54:20.011773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:56.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010479+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:54:20.010479+0000","last_peered":"2023-05-21T16:54:20.010479+0000","last_clean":"2023-05-21T16:54:20.010479+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:54:20.010479+0000","last_undegraded":"2023-05-21T16:54:20.010479+0000","last_fullsized":"2023-05-21T16:54:20.010479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008889+0000","last_change":"2023-05-21T16:54:18.165428+0000","last_active":"2023-05-21T16:54:20.008889+0000","last_peered":"2023-05-21T16:54:20.008889+0000","last_clean":"2023-05-21T16:54:20.008889+0000","last_became_active":"2023-05-21T16:54:18.164994+0000","last_became_peered":"2023-05-21T16:54:18.164994+0000","last_unstale":"2023-05-21T16:54:20.008889+0000","last_undegraded":"2023-05-21T16:54:20.008889+0000","last_fullsized":"2023-05-21T16:54:20.008889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151685+0000","last_change":"2023-05-21T16:54:17.789570+0000","last_active":"2023-05-21T16:54:19.151685+0000","last_peered":"2023-05-21T16:54:19.151685+0000","last_clean":"2023-05-21T16:54:19.151685+0000","last_became_active":"2023-05-21T16:54:17.789267+0000","last_became_peered":"2023-05-21T16:54:17.789267+0000","last_unstale":"2023-05-21T16:54:19.151685+0000","last_undegraded":"2023-05-21T16:54:19.151685+0000","last_fullsized":"2023-05-21T16:54:19.151685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:26.101781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154723+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:54:19.154723+0000","last_peered":"2023-05-21T16:54:19.154723+0000","last_clean":"2023-05-21T16:54:19.154723+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:54:19.154723+0000","last_undegraded":"2023-05-21T16:54:19.154723+0000","last_fullsized":"2023-05-21T16:54:19.154723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:02.287898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230335+0000","last_change":"2023-05-21T16:54:18.171372+0000","last_active":"2023-05-21T16:54:19.230335+0000","last_peered":"2023-05-21T16:54:19.230335+0000","last_clean":"2023-05-21T16:54:19.230335+0000","last_became_active":"2023-05-21T16:54:18.171041+0000","last_became_peered":"2023-05-21T16:54:18.171041+0000","last_unstale":"2023-05-21T16:54:19.230335+0000","last_undegraded":"2023-05-21T16:54:19.230335+0000","last_fullsized":"2023-05-21T16:54:19.230335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230870+0000","last_change":"2023-05-21T16:54:18.171452+0000","last_active":"2023-05-21T16:54:19.230870+0000","last_peered":"2023-05-21T16:54:19.230870+0000","last_clean":"2023-05-21T16:54:19.230870+0000","last_became_active":"2023-05-21T16:54:18.170959+0000","last_became_peered":"2023-05-21T16:54:18.170959+0000","last_unstale":"2023-05-21T16:54:19.230870+0000","last_undegraded":"2023-05-21T16:54:19.230870+0000","last_fullsized":"2023-05-21T16:54:19.230870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231346+0000","last_change":"2023-05-21T16:54:17.791905+0000","last_active":"2023-05-21T16:54:19.231346+0000","last_peered":"2023-05-21T16:54:19.231346+0000","last_clean":"2023-05-21T16:54:19.231346+0000","last_became_active":"2023-05-21T16:54:17.791648+0000","last_became_peered":"2023-05-21T16:54:17.791648+0000","last_unstale":"2023-05-21T16:54:19.231346+0000","last_undegraded":"2023-05-21T16:54:19.231346+0000","last_fullsized":"2023-05-21T16:54:19.231346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:43.421675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008777+0000","last_change":"2023-05-21T16:54:18.173713+0000","last_active":"2023-05-21T16:54:20.008777+0000","last_peered":"2023-05-21T16:54:20.008777+0000","last_clean":"2023-05-21T16:54:20.008777+0000","last_became_active":"2023-05-21T16:54:18.173426+0000","last_became_peered":"2023-05-21T16:54:18.173426+0000","last_unstale":"2023-05-21T16:54:20.008777+0000","last_undegraded":"2023-05-21T16:54:20.008777+0000","last_fullsized":"2023-05-21T16:54:20.008777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153630+0000","last_change":"2023-05-21T16:54:17.792289+0000","last_active":"2023-05-21T16:54:19.153630+0000","last_peered":"2023-05-21T16:54:19.153630+0000","last_clean":"2023-05-21T16:54:19.153630+0000","last_became_active":"2023-05-21T16:54:17.791948+0000","last_became_peered":"2023-05-21T16:54:17.791948+0000","last_unstale":"2023-05-21T16:54:19.153630+0000","last_undegraded":"2023-05-21T16:54:19.153630+0000","last_fullsized":"2023-05-21T16:54:19.153630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:07:52.585290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955638+0000","last_change":"2023-05-21T16:54:17.793117+0000","last_active":"2023-05-21T16:54:19.955638+0000","last_peered":"2023-05-21T16:54:19.955638+0000","last_clean":"2023-05-21T16:54:19.955638+0000","last_became_active":"2023-05-21T16:54:17.792787+0000","last_became_peered":"2023-05-21T16:54:17.792787+0000","last_unstale":"2023-05-21T16:54:19.955638+0000","last_undegraded":"2023-05-21T16:54:19.955638+0000","last_fullsized":"2023-05-21T16:54:19.955638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:55.401719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009694+0000","last_change":"2023-05-21T16:54:18.170857+0000","last_active":"2023-05-21T16:54:20.009694+0000","last_peered":"2023-05-21T16:54:20.009694+0000","last_clean":"2023-05-21T16:54:20.009694+0000","last_became_active":"2023-05-21T16:54:18.170581+0000","last_became_peered":"2023-05-21T16:54:18.170581+0000","last_unstale":"2023-05-21T16:54:20.009694+0000","last_undegraded":"2023-05-21T16:54:20.009694+0000","last_fullsized":"2023-05-21T16:54:20.009694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151922+0000","last_change":"2023-05-21T16:54:17.786946+0000","last_active":"2023-05-21T16:54:19.151922+0000","last_peered":"2023-05-21T16:54:19.151922+0000","last_clean":"2023-05-21T16:54:19.151922+0000","last_became_active":"2023-05-21T16:54:17.786198+0000","last_became_peered":"2023-05-21T16:54:17.786198+0000","last_unstale":"2023-05-21T16:54:19.151922+0000","last_undegraded":"2023-05-21T16:54:19.151922+0000","last_fullsized":"2023-05-21T16:54:19.151922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:09.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008455+0000","last_change":"2023-05-21T16:54:18.169451+0000","last_active":"2023-05-21T16:54:20.008455+0000","last_peered":"2023-05-21T16:54:20.008455+0000","last_clean":"2023-05-21T16:54:20.008455+0000","last_became_active":"2023-05-21T16:54:18.169174+0000","last_became_peered":"2023-05-21T16:54:18.169174+0000","last_unstale":"2023-05-21T16:54:20.008455+0000","last_undegraded":"2023-05-21T16:54:20.008455+0000","last_fullsized":"2023-05-21T16:54:20.008455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154470+0000","last_change":"2023-05-21T16:54:18.168251+0000","last_active":"2023-05-21T16:54:19.154470+0000","last_peered":"2023-05-21T16:54:19.154470+0000","last_clean":"2023-05-21T16:54:19.154470+0000","last_became_active":"2023-05-21T16:54:18.167942+0000","last_became_peered":"2023-05-21T16:54:18.167942+0000","last_unstale":"2023-05-21T16:54:19.154470+0000","last_undegraded":"2023-05-21T16:54:19.154470+0000","last_fullsized":"2023-05-21T16:54:19.154470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008745+0000","last_change":"2023-05-21T16:54:17.797264+0000","last_active":"2023-05-21T16:54:20.008745+0000","last_peered":"2023-05-21T16:54:20.008745+0000","last_clean":"2023-05-21T16:54:20.008745+0000","last_became_active":"2023-05-21T16:54:17.796966+0000","last_became_peered":"2023-05-21T16:54:17.796966+0000","last_unstale":"2023-05-21T16:54:20.008745+0000","last_undegraded":"2023-05-21T16:54:20.008745+0000","last_fullsized":"2023-05-21T16:54:20.008745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:06.416563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151506+0000","last_change":"2023-05-21T16:54:18.171476+0000","last_active":"2023-05-21T16:54:19.151506+0000","last_peered":"2023-05-21T16:54:19.151506+0000","last_clean":"2023-05-21T16:54:19.151506+0000","last_became_active":"2023-05-21T16:54:18.171200+0000","last_became_peered":"2023-05-21T16:54:18.171200+0000","last_unstale":"2023-05-21T16:54:19.151506+0000","last_undegraded":"2023-05-21T16:54:19.151506+0000","last_fullsized":"2023-05-21T16:54:19.151506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008926+0000","last_change":"2023-05-21T16:54:17.791998+0000","last_active":"2023-05-21T16:54:20.008926+0000","last_peered":"2023-05-21T16:54:20.008926+0000","last_clean":"2023-05-21T16:54:20.008926+0000","last_became_active":"2023-05-21T16:54:17.791713+0000","last_became_peered":"2023-05-21T16:54:17.791713+0000","last_unstale":"2023-05-21T16:54:20.008926+0000","last_undegraded":"2023-05-21T16:54:20.008926+0000","last_fullsized":"2023-05-21T16:54:20.008926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011837+0000","last_change":"2023-05-21T16:54:18.169485+0000","last_active":"2023-05-21T16:54:20.011837+0000","last_peered":"2023-05-21T16:54:20.011837+0000","last_clean":"2023-05-21T16:54:20.011837+0000","last_became_active":"2023-05-21T16:54:18.169213+0000","last_became_peered":"2023-05-21T16:54:18.169213+0000","last_unstale":"2023-05-21T16:54:20.011837+0000","last_undegraded":"2023-05-21T16:54:20.011837+0000","last_fullsized":"2023-05-21T16:54:20.011837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230735+0000","last_change":"2023-05-21T16:54:17.789625+0000","last_active":"2023-05-21T16:54:19.230735+0000","last_peered":"2023-05-21T16:54:19.230735+0000","last_clean":"2023-05-21T16:54:19.230735+0000","last_became_active":"2023-05-21T16:54:17.789405+0000","last_became_peered":"2023-05-21T16:54:17.789405+0000","last_unstale":"2023-05-21T16:54:19.230735+0000","last_undegraded":"2023-05-21T16:54:19.230735+0000","last_fullsized":"2023-05-21T16:54:19.230735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:25.892052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.508051+0000","last_change":"2023-05-21T16:54:18.177566+0000","last_active":"2023-05-21T16:54:19.508051+0000","last_peered":"2023-05-21T16:54:19.508051+0000","last_clean":"2023-05-21T16:54:19.508051+0000","last_became_active":"2023-05-21T16:54:18.177265+0000","last_became_peered":"2023-05-21T16:54:18.177265+0000","last_unstale":"2023-05-21T16:54:19.508051+0000","last_undegraded":"2023-05-21T16:54:19.508051+0000","last_fullsized":"2023-05-21T16:54:19.508051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151553+0000","last_change":"2023-05-21T16:54:17.789123+0000","last_active":"2023-05-21T16:54:19.151553+0000","last_peered":"2023-05-21T16:54:19.151553+0000","last_clean":"2023-05-21T16:54:19.151553+0000","last_became_active":"2023-05-21T16:54:17.788842+0000","last_became_peered":"2023-05-21T16:54:17.788842+0000","last_unstale":"2023-05-21T16:54:19.151553+0000","last_undegraded":"2023-05-21T16:54:19.151553+0000","last_fullsized":"2023-05-21T16:54:19.151553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:26.181658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230869+0000","last_change":"2023-05-21T16:54:18.179233+0000","last_active":"2023-05-21T16:54:19.230869+0000","last_peered":"2023-05-21T16:54:19.230869+0000","last_clean":"2023-05-21T16:54:19.230869+0000","last_became_active":"2023-05-21T16:54:18.178643+0000","last_became_peered":"2023-05-21T16:54:18.178643+0000","last_unstale":"2023-05-21T16:54:19.230869+0000","last_undegraded":"2023-05-21T16:54:19.230869+0000","last_fullsized":"2023-05-21T16:54:19.230869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955235+0000","last_change":"2023-05-21T16:54:17.786129+0000","last_active":"2023-05-21T16:54:19.955235+0000","last_peered":"2023-05-21T16:54:19.955235+0000","last_clean":"2023-05-21T16:54:19.955235+0000","last_became_active":"2023-05-21T16:54:17.785487+0000","last_became_peered":"2023-05-21T16:54:17.785487+0000","last_unstale":"2023-05-21T16:54:19.955235+0000","last_undegraded":"2023-05-21T16:54:19.955235+0000","last_fullsized":"2023-05-21T16:54:19.955235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230365+0000","last_change":"2023-05-21T16:54:18.175866+0000","last_active":"2023-05-21T16:54:19.230365+0000","last_peered":"2023-05-21T16:54:19.230365+0000","last_clean":"2023-05-21T16:54:19.230365+0000","last_became_active":"2023-05-21T16:54:18.175140+0000","last_became_peered":"2023-05-21T16:54:18.175140+0000","last_unstale":"2023-05-21T16:54:19.230365+0000","last_undegraded":"2023-05-21T16:54:19.230365+0000","last_fullsized":"2023-05-21T16:54:19.230365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956206+0000","last_change":"2023-05-21T16:54:17.786929+0000","last_active":"2023-05-21T16:54:19.956206+0000","last_peered":"2023-05-21T16:54:19.956206+0000","last_clean":"2023-05-21T16:54:19.956206+0000","last_became_active":"2023-05-21T16:54:17.786470+0000","last_became_peered":"2023-05-21T16:54:17.786470+0000","last_unstale":"2023-05-21T16:54:19.956206+0000","last_undegraded":"2023-05-21T16:54:19.956206+0000","last_fullsized":"2023-05-21T16:54:19.956206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:42.194752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010107+0000","last_change":"2023-05-21T16:54:18.173334+0000","last_active":"2023-05-21T16:54:20.010107+0000","last_peered":"2023-05-21T16:54:20.010107+0000","last_clean":"2023-05-21T16:54:20.010107+0000","last_became_active":"2023-05-21T16:54:18.173027+0000","last_became_peered":"2023-05-21T16:54:18.173027+0000","last_unstale":"2023-05-21T16:54:20.010107+0000","last_undegraded":"2023-05-21T16:54:20.010107+0000","last_fullsized":"2023-05-21T16:54:20.010107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010797+0000","last_change":"2023-05-21T16:54:17.788520+0000","last_active":"2023-05-21T16:54:20.010797+0000","last_peered":"2023-05-21T16:54:20.010797+0000","last_clean":"2023-05-21T16:54:20.010797+0000","last_became_active":"2023-05-21T16:54:17.788210+0000","last_became_peered":"2023-05-21T16:54:17.788210+0000","last_unstale":"2023-05-21T16:54:20.010797+0000","last_undegraded":"2023-05-21T16:54:20.010797+0000","last_fullsized":"2023-05-21T16:54:20.010797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229927+0000","last_change":"2023-05-21T16:54:18.175394+0000","last_active":"2023-05-21T16:54:19.229927+0000","last_peered":"2023-05-21T16:54:19.229927+0000","last_clean":"2023-05-21T16:54:19.229927+0000","last_became_active":"2023-05-21T16:54:18.174764+0000","last_became_peered":"2023-05-21T16:54:18.174764+0000","last_unstale":"2023-05-21T16:54:19.229927+0000","last_undegraded":"2023-05-21T16:54:19.229927+0000","last_fullsized":"2023-05-21T16:54:19.229927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151863+0000","last_change":"2023-05-21T16:54:17.786133+0000","last_active":"2023-05-21T16:54:19.151863+0000","last_peered":"2023-05-21T16:54:19.151863+0000","last_clean":"2023-05-21T16:54:19.151863+0000","last_became_active":"2023-05-21T16:54:17.785810+0000","last_became_peered":"2023-05-21T16:54:17.785810+0000","last_unstale":"2023-05-21T16:54:19.151863+0000","last_undegraded":"2023-05-21T16:54:19.151863+0000","last_fullsized":"2023-05-21T16:54:19.151863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:34.911070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12164,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359676,"statfs":{"total":96636764160,"available":96624308224,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12096,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359744,"statfs":{"total":96636764160,"available":96624377856,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12148,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359692,"statfs":{"total":96636764160,"available":96624324608,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13256,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358584,"statfs":{"total":96636764160,"available":96623190016,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:54:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-21T16:54:22.164 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-21T16:54:22.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-21T16:54:22.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-21T16:54:22.166 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-21T16:54:22.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 Processor -- start 2023-05-21T16:54:22.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 -- start start 2023-05-21T16:54:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb92006c760 0x7fb92015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 0x7fb92006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92006b9d0 con 0x7fb920069f80 2023-05-21T16:54:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92006b450 con 0x7fb92006c760 2023-05-21T16:54:22.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9252f4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb920159a90 con 0x7fb92015dbb0 2023-05-21T16:54:22.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb924af3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb920069f80 0x7fb92006a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57284/0 (socket says 172.21.15.46:57284) 2023-05-21T16:54:22.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb924af3700 1 -- 172.21.15.46:0/1294819249 learned_addr learned my addr 172.21.15.46:0/1294819249 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:22.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1294819249 >> v2:172.21.15.142:3300/0 conn(0x7fb92006c760 0x7fb92015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb9177fe700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 0x7fb92006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536889482 0 0) 0x7fb92006b9d0 con 0x7fb920069f80 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.277+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb90c0035d0 con 0x7fb920069f80 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753440440 0 0) 0x7fb90c0035d0 con 0x7fb920069f80 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 msgr2=0x7fb92006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 0x7fb92006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 >> v2:172.21.15.142:3300/0 conn(0x7fb92006c760 msgr2=0x7fb92015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 --2- 172.21.15.46:0/1294819249 >> v2:172.21.15.142:3300/0 conn(0x7fb92006c760 0x7fb92015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92006d070 con 0x7fb920069f80 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7fb9180019f0 con 0x7fb920069f80 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 >> v1:172.21.15.46:6789/0 conn(0x7fb920069f80 legacy=0x7fb92006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb90c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 0x7fb90c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb90c004db0 0x7fb90c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92006b450 con 0x7fb90c003a20 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb920159a90 con 0x7fb90c004db0 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c00dc40 con 0x7fb92015dbb0 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb90c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9177fe700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 0x7fb90c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb924af3700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb90c004db0 0x7fb90c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 -- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 msgr2=0x7fb90c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92015dbb0 0x7fb90c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 -- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb90c004db0 msgr2=0x7fb90c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb90c004db0 0x7fb90c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 -- 172.21.15.46:0/1294819249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0035d0 con 0x7fb90c003a20 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb90c003e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb910009b70 tx=0x7fb90c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a519fb40052fb55 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000e6c0 con 0x7fb90c003a20 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000e820 con 0x7fb90c003a20 2023-05-21T16:54:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb91f7fe700 1 -- 172.21.15.46:0/1294819249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000eb90 con 0x7fb90c003a20 2023-05-21T16:54:22.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9252f4700 1 -- 172.21.15.46:0/1294819249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 msgr2=0x7fb90c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1294819249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb90c003e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb910009b70 tx=0x7fb90c0058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb924af3700 1 -- 172.21.15.46:0/1294819249 reap_dead start 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9252f4700 1 -- 172.21.15.46:0/1294819249 shutdown_connections 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9252f4700 1 -- 172.21.15.46:0/1294819249 >> 172.21.15.46:0/1294819249 conn(0x7fb9200cf720 msgr2=0x7fb9200cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9252f4700 1 -- 172.21.15.46:0/1294819249 shutdown_connections 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.281+0000 7fb9252f4700 1 -- 172.21.15.46:0/1294819249 wait complete. 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 Processor -- start 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 -- start start 2023-05-21T16:54:22.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb9200ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920156650 0x7fb9200b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92014ed10 0x7fb92014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92014f6c0 con 0x7fb90c003a20 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200acde0 con 0x7fb920156650 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200ac1d0 con 0x7fb92014ed10 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb9200ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb9200ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58784/0 (socket says 172.21.15.46:58784) 2023-05-21T16:54:22.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 -- 172.21.15.46:0/1373375798 learned_addr learned my addr 172.21.15.46:0/1373375798 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9177fe700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920156650 0x7fb9200b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb924af3700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92014ed10 0x7fb92014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 -- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92014ed10 msgr2=0x7fb92014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92014ed10 0x7fb92014f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 -- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920156650 msgr2=0x7fb9200b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920156650 0x7fb9200b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 -- 172.21.15.46:0/1373375798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920159d50 con 0x7fb90c003a20 2023-05-21T16:54:22.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91ffff700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb9200ab8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb910009a90 tx=0x7fb9100047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000e6c0 con 0x7fb90c003a20 2023-05-21T16:54:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb910013e00 con 0x7fb90c003a20 2023-05-21T16:54:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92006b6f0 con 0x7fb90c003a20 2023-05-21T16:54:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.285+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910004290 con 0x7fb90c003a20 2023-05-21T16:54:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.289+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92015a030 con 0x7fb90c003a20 2023-05-21T16:54:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.289+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9100043f0 con 0x7fb90c003a20 2023-05-21T16:54:22.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.289+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9200733b0 con 0x7fb90c003a20 2023-05-21T16:54:22.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.289+0000 7fb91d7fa700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb900066320 0x7fb9000687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.289+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9100850b0 con 0x7fb90c003a20 2023-05-21T16:54:22.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.293+0000 7fb9177fe700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb900066320 0x7fb9000687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.293+0000 7fb9177fe700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb900066320 0x7fb9000687d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb92006a720 tx=0x7fb908009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.297+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb9100526e0 con 0x7fb90c003a20 2023-05-21T16:54:22.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.493+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb92006b230 con 0x7fb90c003a20 2023-05-21T16:54:22.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.497+0000 7fb91d7fa700 1 -- 172.21.15.46:0/1373375798 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164242 (secure 0 0 0) 0x7fb910055d00 con 0x7fb90c003a20 2023-05-21T16:54:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:22.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb900066320 msgr2=0x7fb9000687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb900066320 0x7fb9000687d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb92006a720 tx=0x7fb908009240 comp rx=0 tx=0).stop 2023-05-21T16:54:22.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 msgr2=0x7fb9200ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb9200ab8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb910009a90 tx=0x7fb9100047e0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 shutdown_connections 2023-05-21T16:54:22.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb900066320 0x7fb9000687d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb92014ed10 0x7fb92014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920156650 0x7fb9200b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 --2- 172.21.15.46:0/1373375798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb90c003a20 0x7fb9200ab8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 >> 172.21.15.46:0/1373375798 conn(0x7fb9200cf720 msgr2=0x7fb9200ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:22.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 shutdown_connections 2023-05-21T16:54:22.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.501+0000 7fb9252f4700 1 -- 172.21.15.46:0/1373375798 wait complete. 2023-05-21T16:54:22.519 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1217485649},{"type":"v1","addr":"172.21.15.46:6833","nonce":1217485649}]},"active_addr":"172.21.15.46:6833/1217485649","active_change":"2023-05-21T16:53:58.766500+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2921283126}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2028314291}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2667782786}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1737079901}]}]} 2023-05-21T16:54:22.523 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-21T16:54:22.524 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-21T16:54:22.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 Processor -- start 2023-05-21T16:54:22.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 -- start start 2023-05-21T16:54:22.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49940cc540 0x7f49940cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f499406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940cced0 con 0x7f49941591a0 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49940cee30 con 0x7f49940cc540 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.637+0000 7f4999e66700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940ce260 con 0x7f499406c040 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4998e64700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f49941591a0 0x7f49940ae770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57298/0 (socket says 172.21.15.46:57298) 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4998e64700 1 -- 172.21.15.46:0/4224839067 learned_addr learned my addr 172.21.15.46:0/4224839067 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4993fff700 1 --2- 172.21.15.46:0/4224839067 >> v2:172.21.15.46:3300/0 conn(0x7f49940cc540 0x7f49940cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999665700 1 --2- 172.21.15.46:0/4224839067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f499406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f49937fe700 1 -- 172.21.15.46:0/4224839067 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113952927 0 0) 0x7f498c001490 con 0x7f49941591a0 2023-05-21T16:54:22.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f49937fe700 1 -- 172.21.15.46:0/4224839067 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49740035d0 con 0x7f49941591a0 2023-05-21T16:54:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4993fff700 1 -- 172.21.15.46:0/4224839067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 msgr2=0x7f499406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4993fff700 1 --2- 172.21.15.46:0/4224839067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f499406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4993fff700 1 -- 172.21.15.46:0/4224839067 >> v1:172.21.15.46:6789/0 conn(0x7f49941591a0 legacy=0x7f49940ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4993fff700 1 -- 172.21.15.46:0/4224839067 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940ce500 con 0x7f49940cc540 2023-05-21T16:54:22.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4993fff700 1 --2- 172.21.15.46:0/4224839067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f49940cc990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f497c009850 tx=0x7f497c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe57e75a0107292 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f49937fe700 1 -- 172.21.15.46:0/4224839067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011830 con 0x7f49940cc540 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f49937fe700 1 -- 172.21.15.46:0/4224839067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c011990 con 0x7f49940cc540 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f49937fe700 1 -- 172.21.15.46:0/4224839067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011d40 con 0x7f49940cc540 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 -- 172.21.15.46:0/4224839067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 msgr2=0x7f49940cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 --2- 172.21.15.46:0/4224839067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f49940cc990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f497c009850 tx=0x7f497c009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 -- 172.21.15.46:0/4224839067 shutdown_connections 2023-05-21T16:54:22.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 --2- 172.21.15.46:0/4224839067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f499406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 --2- 172.21.15.46:0/4224839067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f49940cc990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 -- 172.21.15.46:0/4224839067 >> 172.21.15.46:0/4224839067 conn(0x7f499406d8f0 msgr2=0x7f499406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:22.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 -- 172.21.15.46:0/4224839067 shutdown_connections 2023-05-21T16:54:22.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.641+0000 7f4999e66700 1 -- 172.21.15.46:0/4224839067 wait complete. 2023-05-21T16:54:22.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 Processor -- start 2023-05-21T16:54:22.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 -- start start 2023-05-21T16:54:22.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f49940b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f499414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49941591a0 0x7f49940c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499414e190 con 0x7f49940cc540 2023-05-21T16:54:22.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499414d8f0 con 0x7f49941591a0 2023-05-21T16:54:22.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999e66700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499414dbd0 con 0x7f499406c040 2023-05-21T16:54:22.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4993fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f499414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4993fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f499414c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58802/0 (socket says 172.21.15.46:58802) 2023-05-21T16:54:22.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4993fff700 1 -- 172.21.15.46:0/807790791 learned_addr learned my addr 172.21.15.46:0/807790791 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:22.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4998e64700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f49940b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.645+0000 7f4999665700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49941591a0 0x7f49940c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4993fff700 1 -- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 msgr2=0x7f49940b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4993fff700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f49940b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4993fff700 1 -- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49941591a0 msgr2=0x7f49940c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4993fff700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49941591a0 0x7f49940c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4993fff700 1 -- 172.21.15.46:0/807790791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0094b0 con 0x7f49940cc540 2023-05-21T16:54:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4993fff700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f499414c600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f497c0090b0 tx=0x7f497c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c004380 con 0x7f49940cc540 2023-05-21T16:54:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c01f070 con 0x7f49940cc540 2023-05-21T16:54:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49940ceac0 con 0x7f49940cc540 2023-05-21T16:54:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0036c0 con 0x7f49940cc540 2023-05-21T16:54:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940ce7e0 con 0x7f49940cc540 2023-05-21T16:54:22.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499415dce0 con 0x7f49940cc540 2023-05-21T16:54:22.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.649+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f497c021030 con 0x7f49940cc540 2023-05-21T16:54:22.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.653+0000 7f49917fa700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49780662f0 0x7f49780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.653+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f497c084e30 con 0x7f49940cc540 2023-05-21T16:54:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.653+0000 7f4998e64700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49780662f0 0x7f49780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.653+0000 7f4998e64700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49780662f0 0x7f49780687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f498c0015f0 tx=0x7f498c001aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.661+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f497c052460 con 0x7f49940cc540 2023-05-21T16:54:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.829+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4994067ac0 con 0x7f49940cc540 2023-05-21T16:54:22.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f49917fa700 1 -- 172.21.15.46:0/807790791 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f497c006ce0 con 0x7f49940cc540 2023-05-21T16:54:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:22.837 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:22.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49780662f0 msgr2=0x7f49780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49780662f0 0x7f49780687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f498c0015f0 tx=0x7f498c001aa0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 msgr2=0x7f499414c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f499414c600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f497c0090b0 tx=0x7f497c004770 comp rx=0 tx=0).stop 2023-05-21T16:54:22.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 shutdown_connections 2023-05-21T16:54:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49780662f0 0x7f49780687a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49941591a0 0x7f49940c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940cc540 0x7f499414c600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 --2- 172.21.15.46:0/807790791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f499406c040 0x7f49940b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 >> 172.21.15.46:0/807790791 conn(0x7f499406d8f0 msgr2=0x7f49940b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:22.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 shutdown_connections 2023-05-21T16:54:22.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.833+0000 7f4999e66700 1 -- 172.21.15.46:0/807790791 wait complete. 2023-05-21T16:54:22.851 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-21T16:54:22.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 Processor -- start 2023-05-21T16:54:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 -- start start 2023-05-21T16:54:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808069f80 0x7fd80806a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd808070c50 0x7fd808071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080ade30 con 0x7fd808160be0 2023-05-21T16:54:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8080715b0 con 0x7fd808070c50 2023-05-21T16:54:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d93d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080cd210 con 0x7fd808069f80 2023-05-21T16:54:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80c93b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd808160be0 0x7fd8081651c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57304/0 (socket says 172.21.15.46:57304) 2023-05-21T16:54:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80c93b700 1 -- 172.21.15.46:0/398517946 learned_addr learned my addr 172.21.15.46:0/398517946 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd807fff700 1 --2- 172.21.15.46:0/398517946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808069f80 0x7fd80806a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd80d13c700 1 --2- 172.21.15.46:0/398517946 >> v2:172.21.15.142:3300/0 conn(0x7fd808070c50 0x7fd808071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd8077fe700 1 -- 172.21.15.46:0/398517946 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232271920 0 0) 0x7fd8080ade30 con 0x7fd808160be0 2023-05-21T16:54:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd8077fe700 1 -- 172.21.15.46:0/398517946 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f40035d0 con 0x7fd808160be0 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd807fff700 1 -- 172.21.15.46:0/398517946 >> v2:172.21.15.142:3300/0 conn(0x7fd808070c50 msgr2=0x7fd808071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd807fff700 1 --2- 172.21.15.46:0/398517946 >> v2:172.21.15.142:3300/0 conn(0x7fd808070c50 0x7fd808071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd807fff700 1 -- 172.21.15.46:0/398517946 >> v1:172.21.15.46:6789/0 conn(0x7fd808160be0 legacy=0x7fd8081651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd807fff700 1 -- 172.21.15.46:0/398517946 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080cc970 con 0x7fd808069f80 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd807fff700 1 --2- 172.21.15.46:0/398517946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808069f80 0x7fd80806a3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd800009d90 tx=0x7fd80000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d2c4ec7db3b504 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd8077fe700 1 -- 172.21.15.46:0/398517946 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000e070 con 0x7fd808069f80 2023-05-21T16:54:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd8077fe700 1 -- 172.21.15.46:0/398517946 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000bb20 con 0x7fd808069f80 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.957+0000 7fd8077fe700 1 -- 172.21.15.46:0/398517946 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800012430 con 0x7fd808069f80 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- 172.21.15.46:0/398517946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808069f80 msgr2=0x7fd80806a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 --2- 172.21.15.46:0/398517946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808069f80 0x7fd80806a3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd800009d90 tx=0x7fd80000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- 172.21.15.46:0/398517946 shutdown_connections 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 --2- 172.21.15.46:0/398517946 >> v2:172.21.15.142:3300/0 conn(0x7fd808070c50 0x7fd808071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 --2- 172.21.15.46:0/398517946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808069f80 0x7fd80806a3f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- 172.21.15.46:0/398517946 >> 172.21.15.46:0/398517946 conn(0x7fd8080cf720 msgr2=0x7fd8080cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- 172.21.15.46:0/398517946 shutdown_connections 2023-05-21T16:54:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- 172.21.15.46:0/398517946 wait complete. 2023-05-21T16:54:22.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 Processor -- start 2023-05-21T16:54:22.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- start start 2023-05-21T16:54:22.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd808069f80 0x7fd8081619c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 0x7fd80815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808160be0 0x7fd8080c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808161f00 con 0x7fd808070c50 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808165700 con 0x7fd808069f80 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd80d93d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080b1200 con 0x7fd808160be0 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 0x7fd80815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 0x7fd80815af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58808/0 (socket says 172.21.15.46:58808) 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.961+0000 7fd807fff700 1 -- 172.21.15.46:0/2501740430 learned_addr learned my addr 172.21.15.46:0/2501740430 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd80c93b700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd808069f80 0x7fd8081619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd80d13c700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808160be0 0x7fd8080c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd807fff700 1 -- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808160be0 msgr2=0x7fd8080c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd807fff700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808160be0 0x7fd8080c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd807fff700 1 -- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd808069f80 msgr2=0x7fd8081619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd807fff700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd808069f80 0x7fd8081619c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd807fff700 1 -- 172.21.15.46:0/2501740430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009a70 con 0x7fd808070c50 2023-05-21T16:54:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd80d13c700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808160be0 0x7fd8080c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd807fff700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 0x7fd80815af40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd800014040 tx=0x7fd800004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800012430 con 0x7fd808070c50 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800020070 con 0x7fd808070c50 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080ccf30 con 0x7fd808070c50 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800004280 con 0x7fd808070c50 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8080ccc50 con 0x7fd808070c50 2023-05-21T16:54:22.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd808070730 con 0x7fd808070c50 2023-05-21T16:54:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.965+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8000043e0 con 0x7fd808070c50 2023-05-21T16:54:22.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.969+0000 7fd8057fa700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7e80662f0 0x7fd7e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.969+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd800022070 con 0x7fd808070c50 2023-05-21T16:54:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.969+0000 7fd80c93b700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7e80662f0 0x7fd7e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:22.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.969+0000 7fd80c93b700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7e80662f0 0x7fd7e80687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0007fd0 tx=0x7fd7f0007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:22.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:22.973+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd800053160 con 0x7fd808070c50 2023-05-21T16:54:23.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.141+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8080733b0 con 0x7fd808070c50 2023-05-21T16:54:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.141+0000 7fd8057fa700 1 -- 172.21.15.46:0/2501740430 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd800056780 con 0x7fd808070c50 2023-05-21T16:54:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:23.148 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7e80662f0 msgr2=0x7fd7e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7e80662f0 0x7fd7e80687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0007fd0 tx=0x7fd7f0007de0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 msgr2=0x7fd80815af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 0x7fd80815af40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd800014040 tx=0x7fd800004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 shutdown_connections 2023-05-21T16:54:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7e80662f0 0x7fd7e80687a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd808160be0 0x7fd8080c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd808070c50 0x7fd80815af40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 --2- 172.21.15.46:0/2501740430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd808069f80 0x7fd8081619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 >> 172.21.15.46:0/2501740430 conn(0x7fd8080cf720 msgr2=0x7fd8080b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 shutdown_connections 2023-05-21T16:54:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.145+0000 7fd80d93d700 1 -- 172.21.15.46:0/2501740430 wait complete. 2023-05-21T16:54:23.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-21T16:54:23.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-21T16:54:23.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-21T16:54:23.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-21T16:54:23.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-21T16:54:23.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-21T16:54:23.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-21T16:54:23.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-21T16:54:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49cec16700 1 Processor -- start 2023-05-21T16:54:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f6e23fff700 1 Processor -- start 2023-05-21T16:54:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f6e23fff700 1 -- start start 2023-05-21T16:54:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 Processor -- start 2023-05-21T16:54:23.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 -- start start 2023-05-21T16:54:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49cec16700 1 -- start start 2023-05-21T16:54:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f3da28a0700 1 Processor -- start 2023-05-21T16:54:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f3da28a0700 1 -- start start 2023-05-21T16:54:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49cec16700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49cec16700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c80b8ea0 con 0x7f49c80b4910 2023-05-21T16:54:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49cec16700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c80d09d0 con 0x7f49c80b5ce0 2023-05-21T16:54:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49cec16700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80d0cb0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f6861685700 1 Processor -- start 2023-05-21T16:54:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f6861685700 1 -- start start 2023-05-21T16:54:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49ce415700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f49c80b4910 0x7f49c80d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57318/0 (socket says 172.21.15.46:57318) 2023-05-21T16:54:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f49ce415700 1 -- 172.21.15.46:0/486288829 learned_addr learned my addr 172.21.15.46:0/486288829 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ec0158d90 0x7f0ec015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ec00ccec0 0x7f0ec0070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec00ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec015a280 con 0x7f0ec00ccec0 2023-05-21T16:54:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec0070f30 con 0x7f0ec0158d90 2023-05-21T16:54:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.313+0000 7f0ec58a0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec0159df0 con 0x7f0ec0070ad0 2023-05-21T16:54:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ebffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ec00ccec0 0x7f0ec0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ebffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ec00ccec0 0x7f0ec0070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58820/0 (socket says 172.21.15.46:58820) 2023-05-21T16:54:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ebffff700 1 -- 172.21.15.46:0/153068896 learned_addr learned my addr 172.21.15.46:0/153068896 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cdc14700 1 --2- 172.21.15.46:0/486288829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 --2- 172.21.15.46:0/153068896 >> v2:172.21.15.142:3300/0 conn(0x7f0ec0158d90 0x7f0ec015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec509f700 1 --2- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec00ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e2406df80 0x7f6e240cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2406d3e0 con 0x7f6e240cd4e0 2023-05-21T16:54:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2406cdd0 con 0x7f6e24158b60 2023-05-21T16:54:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e240ce560 con 0x7f6e2406df80 2023-05-21T16:54:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e237fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e2406df80 0x7f6e240cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e22ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6e24158b60 0x7f6e24069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:49384/0 (socket says 172.21.15.46:49384) 2023-05-21T16:54:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e22ffd700 1 -- 172.21.15.46:0/834829310 learned_addr learned my addr 172.21.15.46:0/834829310 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da28a0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da28a0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d9c06ee30 0x7f3d9c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e237fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e2406df80 0x7f6e240cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58836/0 (socket says 172.21.15.46:58836) 2023-05-21T16:54:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da28a0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d9c0cc5d0 0x7f3d9c06ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da28a0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c0ccb40 con 0x7f3d9c06ee30 2023-05-21T16:54:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da28a0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c0cce20 con 0x7f3d9c0cc5d0 2023-05-21T16:54:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da28a0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0cd100 con 0x7f3d9c06ea60 2023-05-21T16:54:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cdc14700 1 -- 172.21.15.46:0/486288829 >> v1:172.21.15.142:6789/0 conn(0x7f49c80b5ce0 legacy=0x7f49c806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cdc14700 1 -- 172.21.15.46:0/486288829 >> v1:172.21.15.46:6789/0 conn(0x7f49c80b4910 legacy=0x7f49c80d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cdc14700 1 -- 172.21.15.46:0/486288829 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80cd4f0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 -- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 msgr2=0x7f0ec00ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 --2- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec00ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 -- 172.21.15.46:0/153068896 >> v2:172.21.15.46:3300/0 conn(0x7f0ec00ccec0 msgr2=0x7f0ec0070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 --2- 172.21.15.46:0/153068896 >> v2:172.21.15.46:3300/0 conn(0x7f0ec00ccec0 0x7f0ec0070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 -- 172.21.15.46:0/153068896 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00cd730 con 0x7f0ec0158d90 2023-05-21T16:54:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe8995a2700 1 Processor -- start 2023-05-21T16:54:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6861685700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f685c160ec0 0x7f685c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6861685700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c0aecd0 0x7f685c0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec489e700 1 --2- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015d460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ec006f520 tx=0x7f0eb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88239d5293cf0889 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe8995a2700 1 -- start start 2023-05-21T16:54:23.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d9c06ee30 0x7f3d9c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d9c06ee30 0x7f3d9c06c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58842/0 (socket says 172.21.15.46:58842) 2023-05-21T16:54:23.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 -- 172.21.15.46:0/3470730931 learned_addr learned my addr 172.21.15.46:0/3470730931 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e237fe700 1 -- 172.21.15.46:0/834829310 >> v1:172.21.15.142:6789/0 conn(0x7f6e24158b60 legacy=0x7f6e24069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e237fe700 1 -- 172.21.15.46:0/834829310 >> v1:172.21.15.46:6789/0 conn(0x7f6e240cd4e0 legacy=0x7f6e2406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e237fe700 1 -- 172.21.15.46:0/834829310 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e240cdfa0 con 0x7f6e2406df80 2023-05-21T16:54:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cdc14700 1 --2- 172.21.15.46:0/486288829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c80cf310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009880 tx=0x7f49b8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8167e9ef94c17e03 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6861685700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c071af0 con 0x7f685c160af0 2023-05-21T16:54:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6861685700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c069f80 con 0x7f685c160ec0 2023-05-21T16:54:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6861685700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c161cc0 con 0x7f685c0aecd0 2023-05-21T16:54:23.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e237fe700 1 --2- 172.21.15.46:0/834829310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e240cd980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00bfa0 tx=0x7f6e1c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a7c43449e90b9b server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da209f700 1 --2- 172.21.15.46:0/3470730931 >> v2:172.21.15.142:3300/0 conn(0x7f3d9c0cc5d0 0x7f3d9c06ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 -- 172.21.15.46:0/3470730931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 msgr2=0x7f3d9c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685a7fc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f685c160ec0 0x7f685c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685affd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f685c160af0 0x7f685c0ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:49390/0 (socket says 172.21.15.46:49390) 2023-05-21T16:54:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685affd700 1 -- 172.21.15.46:0/3291809170 learned_addr learned my addr 172.21.15.46:0/3291809170 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ebf7fe700 1 -- 172.21.15.46:0/153068896 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800e070 con 0x7f0ec0158d90 2023-05-21T16:54:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da189e700 1 --2- 172.21.15.46:0/3470730931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 --2- 172.21.15.46:0/3470730931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 -- 172.21.15.46:0/3470730931 >> v2:172.21.15.142:3300/0 conn(0x7f3d9c0cc5d0 msgr2=0x7f3d9c06ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 --2- 172.21.15.46:0/3470730931 >> v2:172.21.15.142:3300/0 conn(0x7f3d9c0cc5d0 0x7f3d9c06ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 -- 172.21.15.46:0/3470730931 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0cd3e0 con 0x7f3d9c06ee30 2023-05-21T16:54:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e227fc700 1 -- 172.21.15.46:0/834829310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c010070 con 0x7f6e2406df80 2023-05-21T16:54:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49ccc12700 1 -- 172.21.15.46:0/486288829 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011830 con 0x7f49c80b8ad0 2023-05-21T16:54:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e227fc700 1 -- 172.21.15.46:0/834829310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c00dab0 con 0x7f6e2406df80 2023-05-21T16:54:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49ccc12700 1 -- 172.21.15.46:0/486288829 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8011990 con 0x7f49c80b8ad0 2023-05-21T16:54:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49ccc12700 1 -- 172.21.15.46:0/486288829 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011d20 con 0x7f49c80b8ad0 2023-05-21T16:54:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da209f700 1 --2- 172.21.15.46:0/3470730931 >> v2:172.21.15.142:3300/0 conn(0x7f3d9c0cc5d0 0x7f3d9c06ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685b7fe700 1 --2- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c0aecd0 0x7f685c0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685a7fc700 1 -- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c0aecd0 msgr2=0x7f685c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685a7fc700 1 --2- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c0aecd0 0x7f685c0715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685a7fc700 1 -- 172.21.15.46:0/3291809170 >> v1:172.21.15.142:6789/0 conn(0x7f685c160af0 legacy=0x7f685c0ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685a7fc700 1 -- 172.21.15.46:0/3291809170 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c071d20 con 0x7f685c160ec0 2023-05-21T16:54:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ebf7fe700 1 -- 172.21.15.46:0/153068896 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800f250 con 0x7f0ec0158d90 2023-05-21T16:54:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f685a7fc700 1 --2- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160ec0 0x7f685c0c20e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6850009850 tx=0x7f6850009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5034cf49b557e09d server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6859ffb700 1 -- 172.21.15.46:0/3291809170 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850011830 con 0x7f685c160ec0 2023-05-21T16:54:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6859ffb700 1 -- 172.21.15.46:0/3291809170 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850011990 con 0x7f685c160ec0 2023-05-21T16:54:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6859ffb700 1 -- 172.21.15.46:0/3291809170 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850011d20 con 0x7f685c160ec0 2023-05-21T16:54:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cec16700 1 -- 172.21.15.46:0/486288829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 msgr2=0x7f49c80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f49cec16700 1 --2- 172.21.15.46:0/486288829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c80cf310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009880 tx=0x7f49b8009b90 comp rx=0 tx=0).stop 2023-05-21T16:54:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ebf7fe700 1 -- 172.21.15.46:0/153068896 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800bd40 con 0x7f0ec0158d90 2023-05-21T16:54:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec58a0700 1 -- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 msgr2=0x7f0ec015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015d460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ec006f520 tx=0x7f0eb800b330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe8995a2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe8940caea0 0x7fe8940c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe8995a2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89415aea0 con 0x7fe894154de0 2023-05-21T16:54:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe8995a2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe894071790 con 0x7fe89406c760 2023-05-21T16:54:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe8995a2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89415ac20 con 0x7fe8940caea0 2023-05-21T16:54:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe893fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe894154de0 0x7fe89415b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57338/0 (socket says 172.21.15.46:57338) 2023-05-21T16:54:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe893fff700 1 -- 172.21.15.46:0/3420341664 learned_addr learned my addr 172.21.15.46:0/3420341664 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da109d700 1 --2- 172.21.15.46:0/3470730931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c06c970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0c9840 tx=0x7f3d98009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccba572888add91 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da089c700 1 -- 172.21.15.46:0/3470730931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800b8a0 con 0x7f3d9c06ee30 2023-05-21T16:54:23.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da089c700 1 -- 172.21.15.46:0/3470730931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9800ba00 con 0x7f3d9c06ee30 2023-05-21T16:54:23.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f3da089c700 1 -- 172.21.15.46:0/3470730931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800bd90 con 0x7f3d9c06ee30 2023-05-21T16:54:23.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e227fc700 1 -- 172.21.15.46:0/834829310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00de40 con 0x7f6e2406df80 2023-05-21T16:54:23.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- 172.21.15.46:0/834829310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 msgr2=0x7f6e240cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 --2- 172.21.15.46:0/834829310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e240cd980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00bfa0 tx=0x7f6e1c00d330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- 172.21.15.46:0/834829310 shutdown_connections 2023-05-21T16:54:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 --2- 172.21.15.46:0/834829310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e240cd980 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- 172.21.15.46:0/834829310 >> 172.21.15.46:0/834829310 conn(0x7f6e240cc1a0 msgr2=0x7f6e240b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- 172.21.15.46:0/834829310 shutdown_connections 2023-05-21T16:54:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe898da1700 1 --2- 172.21.15.46:0/3420341664 >> v2:172.21.15.46:3300/0 conn(0x7fe8940caea0 0x7fe8940c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe892ffd700 1 -- 172.21.15.46:0/3420341664 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270160320 0 0) 0x7fe89415aea0 con 0x7fe894154de0 2023-05-21T16:54:23.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7fe892ffd700 1 -- 172.21.15.46:0/3420341664 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c0035d0 con 0x7fe894154de0 2023-05-21T16:54:23.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 -- 172.21.15.46:0/486288829 shutdown_connections 2023-05-21T16:54:23.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 --2- 172.21.15.46:0/486288829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c80cf310 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 -- 172.21.15.46:0/486288829 >> 172.21.15.46:0/486288829 conn(0x7f49c80d3ae0 msgr2=0x7f49c80cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- 172.21.15.46:0/153068896 shutdown_connections 2023-05-21T16:54:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec00ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/153068896 >> v2:172.21.15.46:3300/0 conn(0x7f0ec00ccec0 0x7f0ec0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/153068896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015d460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- 172.21.15.46:0/153068896 >> 172.21.15.46:0/153068896 conn(0x7f0ec00cf720 msgr2=0x7f0ec00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 -- 172.21.15.46:0/486288829 shutdown_connections 2023-05-21T16:54:23.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 -- 172.21.15.46:0/486288829 wait complete. 2023-05-21T16:54:23.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 Processor -- start 2023-05-21T16:54:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe898da1700 1 -- 172.21.15.46:0/3420341664 >> v1:172.21.15.142:6789/0 conn(0x7fe89406c760 legacy=0x7fe89415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe898da1700 1 -- 172.21.15.46:0/3420341664 >> v1:172.21.15.46:6789/0 conn(0x7fe894154de0 legacy=0x7fe89415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe898da1700 1 -- 172.21.15.46:0/3420341664 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89406cdd0 con 0x7fe8940caea0 2023-05-21T16:54:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 -- 172.21.15.46:0/3470730931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c06ee30 msgr2=0x7f3d9c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 --2- 172.21.15.46:0/3470730931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c06c970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0c9840 tx=0x7f3d98009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.317+0000 7f6e23fff700 1 -- 172.21.15.46:0/834829310 wait complete. 2023-05-21T16:54:23.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 -- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160ec0 msgr2=0x7f685c0c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 --2- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160ec0 0x7f685c0c20e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6850009850 tx=0x7f6850009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:23.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 -- start start 2023-05-21T16:54:23.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe898da1700 1 --2- 172.21.15.46:0/3420341664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 0x7fe8940c9050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009d90 tx=0x7fe88c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72710d58ee86734 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- 172.21.15.46:0/153068896 shutdown_connections 2023-05-21T16:54:23.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- 172.21.15.46:0/153068896 wait complete. 2023-05-21T16:54:23.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe892ffd700 1 -- 172.21.15.46:0/3420341664 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00e070 con 0x7fe8940caea0 2023-05-21T16:54:23.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe892ffd700 1 -- 172.21.15.46:0/3420341664 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00bb20 con 0x7fe8940caea0 2023-05-21T16:54:23.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 -- 172.21.15.46:0/3470730931 shutdown_connections 2023-05-21T16:54:23.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 --2- 172.21.15.46:0/3470730931 >> v2:172.21.15.142:3300/0 conn(0x7f3d9c0cc5d0 0x7f3d9c06ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 --2- 172.21.15.46:0/3470730931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c06c970 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 --2- 172.21.15.46:0/3470730931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 -- 172.21.15.46:0/3470730931 >> 172.21.15.46:0/3470730931 conn(0x7f3d9c0cc1a0 msgr2=0x7f3d9c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 -- 172.21.15.46:0/3291809170 shutdown_connections 2023-05-21T16:54:23.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 --2- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c0aecd0 0x7f685c0715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 --2- 172.21.15.46:0/3291809170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160ec0 0x7f685c0c20e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 -- 172.21.15.46:0/3291809170 >> 172.21.15.46:0/3291809170 conn(0x7f685c0cec40 msgr2=0x7f685c0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe892ffd700 1 -- 172.21.15.46:0/3420341664 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012430 con 0x7fe8940caea0 2023-05-21T16:54:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 Processor -- start 2023-05-21T16:54:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 -- start start 2023-05-21T16:54:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05b406ea60 0x7f05b40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f05b406ee30 0x7f05b406c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40ccb40 con 0x7f05b406ea60 2023-05-21T16:54:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40cce20 con 0x7f05b406ee30 2023-05-21T16:54:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05babed700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40cd100 con 0x7f05b40cc5d0 2023-05-21T16:54:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 -- 172.21.15.46:0/3420341664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 msgr2=0x7fe8940c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 Processor -- start 2023-05-21T16:54:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 --2- 172.21.15.46:0/3420341664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 0x7fe8940c9050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009d90 tx=0x7fe88c00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 Processor -- start 2023-05-21T16:54:23.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05b406ea60 0x7f05b40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 -- 172.21.15.46:0/3470730931 shutdown_connections 2023-05-21T16:54:23.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05b406ea60 0x7f05b40c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58866/0 (socket says 172.21.15.46:58866) 2023-05-21T16:54:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 -- 172.21.15.46:0/2609722657 learned_addr learned my addr 172.21.15.46:0/2609722657 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f3da28a0700 1 -- 172.21.15.46:0/3470730931 wait complete. 2023-05-21T16:54:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 -- start start 2023-05-21T16:54:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 -- 172.21.15.46:0/3420341664 shutdown_connections 2023-05-21T16:54:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 --2- 172.21.15.46:0/3420341664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 0x7fe8940c9050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 -- 172.21.15.46:0/3420341664 >> 172.21.15.46:0/3420341664 conn(0x7fe8940cf720 msgr2=0x7fe8940cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- start start 2023-05-21T16:54:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b918a700 1 --2- 172.21.15.46:0/2609722657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b3fff700 1 --2- 172.21.15.46:0/2609722657 >> v2:172.21.15.142:3300/0 conn(0x7f05b406ee30 0x7f05b406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 -- 172.21.15.46:0/3420341664 shutdown_connections 2023-05-21T16:54:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7fe8995a2700 1 -- 172.21.15.46:0/3420341664 wait complete. 2023-05-21T16:54:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 -- 172.21.15.46:0/2609722657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 msgr2=0x7f05b406ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 --2- 172.21.15.46:0/2609722657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 -- 172.21.15.46:0/2609722657 >> v2:172.21.15.142:3300/0 conn(0x7f05b406ee30 msgr2=0x7f05b406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 --2- 172.21.15.46:0/2609722657 >> v2:172.21.15.142:3300/0 conn(0x7f05b406ee30 0x7f05b406c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 -- 172.21.15.46:0/2609722657 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40cd3e0 con 0x7f05b406ea60 2023-05-21T16:54:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e241e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e240cd4e0 0x7f6e24157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e24158b60 0x7f6e2415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240b2e30 con 0x7f6e2406df80 2023-05-21T16:54:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2415b340 con 0x7f6e240cd4e0 2023-05-21T16:54:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e23fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24157690 con 0x7f6e24158b60 2023-05-21T16:54:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f05b8989700 1 --2- 172.21.15.46:0/2609722657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ea60 0x7f05b40c9c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05b406c270 tx=0x7f05ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724852368afb64b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e241e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e241e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58868/0 (socket says 172.21.15.46:58868) 2023-05-21T16:54:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 -- 172.21.15.46:0/486996343 learned_addr learned my addr 172.21.15.46:0/486996343 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6861685700 1 -- 172.21.15.46:0/3291809170 shutdown_connections 2023-05-21T16:54:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c80b4910 0x7f49c815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec01f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ec00ccec0 0x7f0ec01f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e1bfff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e240cd4e0 0x7f6e24157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 -- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e24158b60 msgr2=0x7f6e2415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e24158b60 0x7f6e2415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 -- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e240cd4e0 msgr2=0x7f6e24157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e240cd4e0 0x7f6e24157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e22ffd700 1 -- 172.21.15.46:0/486996343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c00bc80 con 0x7f6e2406df80 2023-05-21T16:54:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec01f7b80 con 0x7f0ec00ccec0 2023-05-21T16:54:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec01f78f0 con 0x7f0ec0158d90 2023-05-21T16:54:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f0ec58a0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00b2220 con 0x7f0ec0070ad0 2023-05-21T16:54:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f6e1bfff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e240cd4e0 0x7f6e24157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cec16700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80b5ce0 0x7f49c815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cdc14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c80b4910 0x7f49c815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cdc14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c80b4910 0x7f49c815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58886/0 (socket says 172.21.15.46:58886) 2023-05-21T16:54:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.321+0000 7f49cdc14700 1 -- 172.21.15.46:0/3780295348 learned_addr learned my addr 172.21.15.46:0/3780295348 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec509f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec489e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec01f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ec00ccec0 0x7f0ec01f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec509f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:51150/0 (socket says 172.21.15.46:51150) 2023-05-21T16:54:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec509f700 1 -- 172.21.15.46:0/3224867941 learned_addr learned my addr 172.21.15.46:0/3224867941 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f49cd413700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80b5ce0 0x7f49c815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f05b37fe700 1 -- 172.21.15.46:0/2609722657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00e070 con 0x7f05b406ea60 2023-05-21T16:54:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f05b37fe700 1 -- 172.21.15.46:0/2609722657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00b910 con 0x7f05b406ea60 2023-05-21T16:54:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f05b37fe700 1 -- 172.21.15.46:0/2609722657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00bcc0 con 0x7f05b406ea60 2023-05-21T16:54:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6e22ffd700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e241e7610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00c930 tx=0x7f6e0c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 -- 172.21.15.46:0/3224867941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 msgr2=0x7f0ec01f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec0070ad0 0x7f0ec01f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 -- 172.21.15.46:0/3224867941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 msgr2=0x7f0ec015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec0158d90 0x7f0ec015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 Processor -- start 2023-05-21T16:54:23.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 -- start start 2023-05-21T16:54:23.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 -- 172.21.15.46:0/3224867941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb8009a70 con 0x7f0ec00ccec0 2023-05-21T16:54:23.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6861685700 1 -- 172.21.15.46:0/3291809170 wait complete. 2023-05-21T16:54:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebffff700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ec00ccec0 0x7f0ec01f3db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400e850 tx=0x7f0eb400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c0cc5d0 0x7f3d9c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0c4980 con 0x7f3d9c0cc5d0 2023-05-21T16:54:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0c3d70 con 0x7f3d9c06ee30 2023-05-21T16:54:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0c4050 con 0x7f3d9c06ea60 2023-05-21T16:54:23.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4013680 con 0x7f0ec00ccec0 2023-05-21T16:54:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb40137e0 con 0x7f0ec00ccec0 2023-05-21T16:54:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4013b70 con 0x7f0ec00ccec0 2023-05-21T16:54:23.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da189e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c1f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:51170/0 (socket says 172.21.15.46:51170) 2023-05-21T16:54:23.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 -- 172.21.15.46:0/126409677 learned_addr learned my addr 172.21.15.46:0/126409677 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 Processor -- start 2023-05-21T16:54:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 -- start start 2023-05-21T16:54:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe89406c760 0x7fe89414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 0x7fe89414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe894154de0 0x7fe89414c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940c5ad0 con 0x7fe8940caea0 2023-05-21T16:54:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89414c6c0 con 0x7fe89406c760 2023-05-21T16:54:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940ce0d0 con 0x7fe894154de0 2023-05-21T16:54:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c004cb0 con 0x7f6e2406df80 2023-05-21T16:54:23.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f05babed700 1 -- 172.21.15.46:0/2609722657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ea60 msgr2=0x7f05b40c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f05babed700 1 --2- 172.21.15.46:0/2609722657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ea60 0x7f05b40c9c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05b406c270 tx=0x7f05ac00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c004e10 con 0x7f6e2406df80 2023-05-21T16:54:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2406d070 con 0x7f6e2406df80 2023-05-21T16:54:23.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 -- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 msgr2=0x7f3d9c0c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d9c06ea60 0x7f3d9c0c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 -- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c0cc5d0 msgr2=0x7f3d9c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d9c0cc5d0 0x7f3d9c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 -- 172.21.15.46:0/126409677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98009570 con 0x7f3d9c06ee30 2023-05-21T16:54:23.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e240ce280 con 0x7f6e2406df80 2023-05-21T16:54:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec01597a0 con 0x7f0ec00ccec0 2023-05-21T16:54:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec01594c0 con 0x7f0ec00ccec0 2023-05-21T16:54:23.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00e860 con 0x7f6e2406df80 2023-05-21T16:54:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe89406c760 0x7fe89414f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe89406c760 0x7fe89414f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:51176/0 (socket says 172.21.15.46:51176) 2023-05-21T16:54:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 -- 172.21.15.46:0/1143761466 learned_addr learned my addr 172.21.15.46:0/1143761466 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe898da1700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe894154de0 0x7fe89414c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da109d700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c1f16d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d98013000 tx=0x7f3d98004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6861685700 1 Processor -- start 2023-05-21T16:54:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980038c0 con 0x7f3d9c06ee30 2023-05-21T16:54:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 -- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe894154de0 msgr2=0x7fe89414c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe894154de0 0x7fe89414c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 -- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 msgr2=0x7fe89414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8940caea0 0x7fe89414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 -- 172.21.15.46:0/1143761466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009a70 con 0x7fe89406c760 2023-05-21T16:54:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9801f070 con 0x7f3d9c06ee30 2023-05-21T16:54:23.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9c0ca160 con 0x7f3d9c06ee30 2023-05-21T16:54:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9c0cd6c0 con 0x7f3d9c06ee30 2023-05-21T16:54:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98003c80 con 0x7f3d9c06ee30 2023-05-21T16:54:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe893fff700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe89406c760 0x7fe89414f6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c4d0 tx=0x7fe88400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ec0159a80 con 0x7f0ec00ccec0 2023-05-21T16:54:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884005d90 con 0x7fe89406c760 2023-05-21T16:54:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8840070d0 con 0x7fe89406c760 2023-05-21T16:54:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884007480 con 0x7fe89406c760 2023-05-21T16:54:23.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89406d390 con 0x7fe89406c760 2023-05-21T16:54:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89406d0b0 con 0x7fe89406c760 2023-05-21T16:54:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49cec16700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80ca410 con 0x7f49c80b4910 2023-05-21T16:54:23.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c815ca90 con 0x7f49c80b5ce0 2023-05-21T16:54:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c815eed0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 -- 172.21.15.46:0/2609722657 shutdown_connections 2023-05-21T16:54:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 --2- 172.21.15.46:0/2609722657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 --2- 172.21.15.46:0/2609722657 >> v2:172.21.15.142:3300/0 conn(0x7f05b406ee30 0x7f05b406c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 --2- 172.21.15.46:0/2609722657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ea60 0x7f05b40c9c20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 -- 172.21.15.46:0/2609722657 >> 172.21.15.46:0/2609722657 conn(0x7f05b40cc1a0 msgr2=0x7f05b40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.325+0000 7f6861685700 1 -- start start 2023-05-21T16:54:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f685c0aecd0 0x7f685c159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160af0 0x7f685c0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c160ec0 0x7f685c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0c43a0 con 0x7f685c0aecd0 2023-05-21T16:54:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0c4680 con 0x7f685c160af0 2023-05-21T16:54:23.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0c4960 con 0x7f685c160ec0 2023-05-21T16:54:23.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e08000fc0 con 0x7f6e2406df80 2023-05-21T16:54:23.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 -- 172.21.15.46:0/2609722657 shutdown_connections 2023-05-21T16:54:23.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8940cb2a0 con 0x7fe89406c760 2023-05-21T16:54:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d84000fc0 con 0x7f3d9c06ee30 2023-05-21T16:54:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f685c0aecd0 0x7f685c159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f685c0aecd0 0x7f685c159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58908/0 (socket says 172.21.15.46:58908) 2023-05-21T16:54:23.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 -- 172.21.15.46:0/3130112747 learned_addr learned my addr 172.21.15.46:0/3130112747 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 -- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80b5ce0 msgr2=0x7f49c815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80b5ce0 0x7f49c815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 -- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c80b4910 msgr2=0x7f49c815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49c80b4910 0x7f49c815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80094b0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685b7fe700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c160ec0 0x7f685c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685a7fc700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160af0 0x7f685c0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 -- 172.21.15.46:0/2609722657 wait complete. 2023-05-21T16:54:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 -- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c160ec0 msgr2=0x7f685c15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685c160ec0 0x7f685c15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 -- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160af0 msgr2=0x7f685c0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160af0 0x7f685c0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 -- 172.21.15.46:0/3130112747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500094b0 con 0x7f685c0aecd0 2023-05-21T16:54:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685a7fc700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f685c160af0 0x7f685c0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f685affd700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f685c0aecd0 0x7f685c159530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f685400cba0 tx=0x7f685400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49ce415700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c814f280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c400 tx=0x7f49c400c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4005d90 con 0x7f49c80b8ad0 2023-05-21T16:54:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c80cda70 con 0x7f49c80b8ad0 2023-05-21T16:54:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c80cd790 con 0x7f49c80b8ad0 2023-05-21T16:54:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8840075e0 con 0x7fe89406c760 2023-05-21T16:54:23.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400ce10 con 0x7f49c80b8ad0 2023-05-21T16:54:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d9801a430 con 0x7f3d9c06ee30 2023-05-21T16:54:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3d927fc700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d800662f0 0x7f3d800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d98021070 con 0x7f3d9c06ee30 2023-05-21T16:54:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3da189e700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d800662f0 0x7f3d800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3d927fc700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f3d8006eaa0 0x7f3d80070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 --> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d80071560 con 0x7f3d8006eaa0 2023-05-21T16:54:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3da189e700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d800662f0 0x7f3d800687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00aa60 tx=0x7f3d8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e0c00e9c0 con 0x7f6e2406df80 2023-05-21T16:54:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 Processor -- start 2023-05-21T16:54:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 -- start start 2023-05-21T16:54:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbe40c9a60 0x7ffbe40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffbe416d230 0x7ffbe416d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe416dbb0 con 0x7ffbe406eb50 2023-05-21T16:54:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe4169bb0 con 0x7ffbe416d230 2023-05-21T16:54:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe406d080 con 0x7ffbe40c9a60 2023-05-21T16:54:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f05babed700 1 Processor -- start 2023-05-21T16:54:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d98052d50 con 0x7f3d9c06ee30 2023-05-21T16:54:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f3da209f700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f3d8006eaa0 0x7f3d80070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e20ff9700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6e04066340 0x7f6e040687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe890ff9700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe8800662f0 0x7fe8800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8840839e0 con 0x7fe89406c760 2023-05-21T16:54:23.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe890ff9700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7fe88006eba0 0x7fe880070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 --> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe880071660 con 0x7fe88006eba0 2023-05-21T16:54:23.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe884083d90 con 0x7fe89406c760 2023-05-21T16:54:23.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7fe8937fe700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe8800662f0 0x7fe8800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c40072d0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0eb4013cd0 con 0x7f0ec00ccec0 2023-05-21T16:54:23.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e0c084240 con 0x7f6e2406df80 2023-05-21T16:54:23.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e20ff9700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f6e0406ebf0 0x7f6e04071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 --> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e040716b0 con 0x7f6e0406ebf0 2023-05-21T16:54:23.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e0c0846e0 con 0x7f6e2406df80 2023-05-21T16:54:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 -- start start 2023-05-21T16:54:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e1bfff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6e04066340 0x7f6e040687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0eac066340 0x7f0eac0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7fe898da1700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7fe88006eba0 0x7fe880070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0eb4083e70 con 0x7f0ec00ccec0 2023-05-21T16:54:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e237fe700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f6e0406ebf0 0x7f6e04071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f0eac06ebf0 0x7f0eac071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 --> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0eac0716b0 con 0x7f0eac06ebf0 2023-05-21T16:54:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eb4084310 con 0x7f0ec00ccec0 2023-05-21T16:54:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f3da209f700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f3d8006eaa0 0x7f3d80070eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe1d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbe40c9a60 0x7ffbe40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe1d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffbe40c9a60 0x7ffbe40c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:51198/0 (socket says 172.21.15.46:51198) 2023-05-21T16:54:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7ffbe1d9b700 1 -- 172.21.15.46:0/4017143297 learned_addr learned my addr 172.21.15.46:0/4017143297 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe1d9b700 1 -- 172.21.15.46:0/4017143297 >> v2:172.21.15.46:3300/0 conn(0x7ffbe416d230 msgr2=0x7ffbe416d670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-21T16:54:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe1d9b700 1 --2- 172.21.15.46:0/4017143297 >> v2:172.21.15.46:3300/0 conn(0x7ffbe416d230 0x7ffbe416d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe1d9b700 1 -- 172.21.15.46:0/4017143297 >> v1:172.21.15.46:6789/0 conn(0x7ffbe406eb50 legacy=0x7ffbe406c970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-21T16:54:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe1d9b700 1 -- 172.21.15.46:0/4017143297 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40cc680 con 0x7ffbe40c9a60 2023-05-21T16:54:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe1d9b700 1 --2- 172.21.15.46:0/4017143297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe40c9a60 0x7ffbe40c9ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4070140 tx=0x7ffbd400ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d98fcf7ffac3eaa7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400a9e0 con 0x7f685c0aecd0 2023-05-21T16:54:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685400ab40 con 0x7f685c0aecd0 2023-05-21T16:54:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854012400 con 0x7f685c0aecd0 2023-05-21T16:54:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ec489e700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0eac066340 0x7f0eac0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c161390 con 0x7f685c0aecd0 2023-05-21T16:54:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.329+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c162150 con 0x7f685c0aecd0 2023-05-21T16:54:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f685c161670 con 0x7f685c0aecd0 2023-05-21T16:54:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ec509f700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f0eac06ebf0 0x7f0eac071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e1bfff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6e04066340 0x7f6e040687f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e240b0e30 tx=0x7f6e14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49b0000fc0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7fe898da1700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7fe88006eba0 0x7fe880070fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f6e237fe700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f6e0406ebf0 0x7f6e04071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f685401b3b0 con 0x7f685c0aecd0 2023-05-21T16:54:23.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ec509f700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f0eac06ebf0 0x7f0eac071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ec489e700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0eac066340 0x7f0eac0687f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b370 tx=0x7f0eb8015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7fe8937fe700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe8800662f0 0x7fe8800687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe888000f60 tx=0x7fe888007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f68437fe700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6848066340 0x7f68480687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05b406ea60 0x7f05b4202b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ee30 0x7f05b41fe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6854083600 con 0x7f685c0aecd0 2023-05-21T16:54:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f685a7fc700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6848066340 0x7f68480687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f68437fe700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f684806ebf0 0x7f6848071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe159a700 1 -- 172.21.15.46:0/4017143297 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4019a60 con 0x7ffbe40c9a60 2023-05-21T16:54:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe159a700 1 -- 172.21.15.46:0/4017143297 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4019bc0 con 0x7ffbe40c9a60 2023-05-21T16:54:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe159a700 1 -- 172.21.15.46:0/4017143297 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4004030 con 0x7ffbe40c9a60 2023-05-21T16:54:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 --> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68480716b0 con 0x7f684806ebf0 2023-05-21T16:54:23.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6854085d10 con 0x7f685c0aecd0 2023-05-21T16:54:23.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ee30 0x7f05b41fe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ee30 0x7f05b41fe1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58910/0 (socket says 172.21.15.46:58910) 2023-05-21T16:54:23.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 -- 172.21.15.46:0/3850279119 learned_addr learned my addr 172.21.15.46:0/3850279119 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40abfa0 con 0x7f05b406ee30 2023-05-21T16:54:23.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415cee0 con 0x7f05b406ea60 2023-05-21T16:54:23.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05babed700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40b2ef0 con 0x7f05b40cc5d0 2023-05-21T16:54:23.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f685b7fe700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f684806ebf0 0x7f6848071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b8989700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05b406ea60 0x7f05b4202b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== osd.5 v2:172.21.15.142:6824/1063646432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d80071560 con 0x7f3d8006eaa0 2023-05-21T16:54:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== osd.4 v2:172.21.15.142:6808/2664279934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe880071660 con 0x7fe88006eba0 2023-05-21T16:54:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== osd.3 v2:172.21.15.46:6824/270588901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0eac0716b0 con 0x7f0eac06ebf0 2023-05-21T16:54:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 -- 172.21.15.46:0/4017143297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe40c9a60 msgr2=0x7ffbe40c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4017143297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe40c9a60 0x7ffbe40c9ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4070140 tx=0x7ffbd400ac90 comp rx=0 tx=0).stop 2023-05-21T16:54:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 -- 172.21.15.46:0/4017143297 shutdown_connections 2023-05-21T16:54:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4017143297 >> v2:172.21.15.46:3300/0 conn(0x7ffbe416d230 0x7ffbe416d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4017143297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe40c9a60 0x7ffbe40c9ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 -- 172.21.15.46:0/4017143297 >> 172.21.15.46:0/4017143297 conn(0x7ffbe40cc1a0 msgr2=0x7ffbe40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f685b7fe700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f684806ebf0 0x7f6848071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7ffbe359e700 1 -- 172.21.15.46:0/4017143297 shutdown_connections 2023-05-21T16:54:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== osd.6 v2:172.21.15.142:6812/2773532653 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6e040716b0 con 0x7f6e0406ebf0 2023-05-21T16:54:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49c4007430 con 0x7f49c80b8ad0 2023-05-21T16:54:23.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f685a7fc700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6848066340 0x7f68480687f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6850000c00 tx=0x7f6850008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49ac066340 0x7f49ac0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49c40834d0 con 0x7f49c80b8ad0 2023-05-21T16:54:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49cdc14700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49ac066340 0x7f49ac0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7f49ac06ea80 0x7f49ac070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== osd.0 v2:172.21.15.46:6816/2513150374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f68480716b0 con 0x7f684806ebf0 2023-05-21T16:54:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49ac071540 con 0x7f49ac06ea80 2023-05-21T16:54:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49c4083970 con 0x7f49c80b8ad0 2023-05-21T16:54:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49cd413700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7f49ac06ea80 0x7f49ac070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49cd413700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7f49ac06ea80 0x7f49ac070e90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== osd.1 v2:172.21.15.46:6808/3939198338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f49ac071540 con 0x7f49ac06ea80 2023-05-21T16:54:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b918a700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 -- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 msgr2=0x7f05b406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 -- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05b406ea60 msgr2=0x7f05b4202b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05b406ea60 0x7f05b4202b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009b30 con 0x7f05b406ee30 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b918a700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f05b40cc5d0 0x7f05b406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.333+0000 7f05b3fff700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ee30 0x7f05b41fe1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05a800e940 tx=0x7f05a800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800ee90 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800c850 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800cbe0 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05babed700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b40ca160 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05babed700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b40cd6c0 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05a800cd40 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05b40ca2f0 con 0x7f05b406ee30 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05b17fa700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f05a0066340 0x7f05a00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.337+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05a8083c80 con 0x7f05b406ee30 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b8989700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f05a0066340 0x7f05a00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b17fa700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f05a006ebf0 0x7f05a0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05a00716b0 con 0x7f05a006ebf0 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05a8086390 con 0x7f05b406ee30 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b918a700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f05a006ebf0 0x7f05a0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b918a700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f05a006ebf0 0x7f05a0071000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b8989700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f05a0066340 0x7f05a00687f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00b370 tx=0x7f05ac009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.341+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== osd.2 v2:172.21.15.46:6800/4251490015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f05a00716b0 con 0x7f05a006ebf0 2023-05-21T16:54:23.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 -- 172.21.15.46:0/4017143297 wait complete. 2023-05-21T16:54:23.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7f49cdc14700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49ac066340 0x7f49ac0687f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49b80097d0 tx=0x7f49b8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 Processor -- start 2023-05-21T16:54:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 -- start start 2023-05-21T16:54:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe406eb50 0x7ffbe4165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbe40c9a60 0x7ffbe4202690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbe416d230 0x7ffbe40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4202200 con 0x7ffbe416d230 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b4770 con 0x7ffbe406eb50 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b41b0 con 0x7ffbe40c9a60 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbe416d230 0x7ffbe40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbe416d230 0x7ffbe40b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58918/0 (socket says 172.21.15.46:58918) 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe2d9d700 1 -- 172.21.15.46:0/4078550824 learned_addr learned my addr 172.21.15.46:0/4078550824 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe1d9b700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbe40c9a60 0x7ffbe4202690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.349+0000 7ffbe259c700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe406eb50 0x7ffbe4165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.353+0000 7ffbe2d9d700 1 -- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbe40c9a60 msgr2=0x7ffbe4202690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.353+0000 7ffbe2d9d700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffbe40c9a60 0x7ffbe4202690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.353+0000 7ffbe2d9d700 1 -- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe406eb50 msgr2=0x7ffbe4165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.353+0000 7ffbe2d9d700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe406eb50 0x7ffbe4165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.353+0000 7ffbe2d9d700 1 -- 172.21.15.46:0/4078550824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd400a610 con 0x7ffbe416d230 2023-05-21T16:54:23.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.353+0000 7ffbe2d9d700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbe416d230 0x7ffbe40b3860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b970 tx=0x7ffbdc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 --> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d84002d60 con 0x7f3d8006eaa0 2023-05-21T16:54:23.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00d860 con 0x7ffbe416d230 2023-05-21T16:54:23.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00d9e0 con 0x7ffbe416d230 2023-05-21T16:54:23.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40ccc40 con 0x7ffbe416d230 2023-05-21T16:54:23.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40cc960 con 0x7ffbe416d230 2023-05-21T16:54:23.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00ddd0 con 0x7ffbe416d230 2023-05-21T16:54:23.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3d927fc700 1 -- 172.21.15.46:0/126409677 <== osd.5 v2:172.21.15.142:6824/1063646432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d84002d60 con 0x7f3d8006eaa0 2023-05-21T16:54:23.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 --> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8940ce5c0 con 0x7fe88006eba0 2023-05-21T16:54:23.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbdc00e430 con 0x7ffbe416d230 2023-05-21T16:54:23.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f3d8006eaa0 msgr2=0x7f3d80070eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f3d8006eaa0 0x7f3d80070eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7fe890ff9700 1 -- 172.21.15.46:0/1143761466 <== osd.4 v2:172.21.15.142:6808/2664279934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe8940ce5c0 con 0x7fe88006eba0 2023-05-21T16:54:23.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbd2ffd700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffbcc0664d0 0x7ffbcc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d800662f0 msgr2=0x7f3d800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d800662f0 0x7f3d800687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00aa60 tx=0x7f3d8c008040 comp rx=0 tx=0).stop 2023-05-21T16:54:23.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c06ee30 msgr2=0x7f3d9c1f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 --2- 172.21.15.46:0/126409677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c06ee30 0x7f3d9c1f16d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d98013000 tx=0x7f3d98004770 comp rx=0 tx=0).stop 2023-05-21T16:54:23.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da209f700 1 -- 172.21.15.46:0/126409677 reap_dead start 2023-05-21T16:54:23.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffbdc083e80 con 0x7ffbe416d230 2023-05-21T16:54:23.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7ffbe259c700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffbcc0664d0 0x7ffbcc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 shutdown_connections 2023-05-21T16:54:23.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 >> 172.21.15.46:0/126409677 conn(0x7f3d9c0cc1a0 msgr2=0x7f3d9c0ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 shutdown_connections 2023-05-21T16:54:23.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.357+0000 7f3da28a0700 1 -- 172.21.15.46:0/126409677 wait complete. 2023-05-21T16:54:23.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.361+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7ffbc80015e0 0x7ffbc8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.361+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 --> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffbc8006be0 con 0x7ffbc80015e0 2023-05-21T16:54:23.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.361+0000 7ffbe259c700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffbcc0664d0 0x7ffbcc068980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80099f0 tx=0x7ffbd80090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.361+0000 7ffbe1d9b700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7ffbc80015e0 0x7ffbc8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.361+0000 7ffbe1d9b700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7ffbc80015e0 0x7ffbc8003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== osd.7 v2:172.21.15.142:6800/3864156149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffbc8006be0 con 0x7ffbc80015e0 2023-05-21T16:54:23.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 --> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e08002d60 con 0x7f6e0406ebf0 2023-05-21T16:54:23.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 --> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f685c074200 con 0x7f684806ebf0 2023-05-21T16:54:23.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7f68437fe700 1 -- 172.21.15.46:0/3130112747 <== osd.0 v2:172.21.15.46:6816/2513150374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f685c074200 con 0x7f684806ebf0 2023-05-21T16:54:23.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7f6e20ff9700 1 -- 172.21.15.46:0/486996343 <== osd.6 v2:172.21.15.142:6812/2773532653 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e08002d60 con 0x7f6e0406ebf0 2023-05-21T16:54:23.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f6e0406ebf0 msgr2=0x7f6e04071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f6e0406ebf0 0x7f6e04071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f684806ebf0 msgr2=0x7f6848071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f684806ebf0 0x7f6848071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6e04066340 msgr2=0x7f6e040687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6e04066340 0x7f6e040687f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e240b0e30 tx=0x7f6e14009040 comp rx=0 tx=0).stop 2023-05-21T16:54:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 msgr2=0x7f6e241e7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 --2- 172.21.15.46:0/486996343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2406df80 0x7f6e241e7610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00c930 tx=0x7f6e0c00ca10 comp rx=0 tx=0).stop 2023-05-21T16:54:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6848066340 msgr2=0x7f68480687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6848066340 0x7f68480687f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6850000c00 tx=0x7f6850008030 comp rx=0 tx=0).stop 2023-05-21T16:54:23.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f685c0aecd0 msgr2=0x7f685c159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 --2- 172.21.15.46:0/3130112747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f685c0aecd0 0x7f685c159530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f685400cba0 tx=0x7f685400cc80 comp rx=0 tx=0).stop 2023-05-21T16:54:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f685b7fe700 1 -- 172.21.15.46:0/3130112747 reap_dead start 2023-05-21T16:54:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e237fe700 1 -- 172.21.15.46:0/486996343 reap_dead start 2023-05-21T16:54:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 shutdown_connections 2023-05-21T16:54:23.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 >> 172.21.15.46:0/486996343 conn(0x7f6e240cc1a0 msgr2=0x7f6e240aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 shutdown_connections 2023-05-21T16:54:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 >> 172.21.15.46:0/3130112747 conn(0x7f685c0cec40 msgr2=0x7f685c06adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 shutdown_connections 2023-05-21T16:54:23.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6e23fff700 1 -- 172.21.15.46:0/486996343 wait complete. 2023-05-21T16:54:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 shutdown_connections 2023-05-21T16:54:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7f6861685700 1 -- 172.21.15.46:0/3130112747 wait complete. 2023-05-21T16:54:23.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7fe88006eba0 msgr2=0x7fe880070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7fe8995a2700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7fe88006eba0 0x7fe880070fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe8800662f0 msgr2=0x7fe8800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7fe8995a2700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe8800662f0 0x7fe8800687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe888000f60 tx=0x7fe888007a60 comp rx=0 tx=0).stop 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe89406c760 msgr2=0x7fe89414f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.365+0000 7fe8995a2700 1 --2- 172.21.15.46:0/1143761466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe89406c760 0x7fe89414f6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c4d0 tx=0x7fe88400c7e0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7fe898da1700 1 -- 172.21.15.46:0/1143761466 reap_dead start 2023-05-21T16:54:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 shutdown_connections 2023-05-21T16:54:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 >> 172.21.15.46:0/1143761466 conn(0x7fe8940cf720 msgr2=0x7fe8940b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 shutdown_connections 2023-05-21T16:54:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.369+0000 7fe8995a2700 1 -- 172.21.15.46:0/1143761466 wait complete. 2023-05-21T16:54:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 --> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ec00733b0 con 0x7f0eac06ebf0 2023-05-21T16:54:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ebd7fa700 1 -- 172.21.15.46:0/3224867941 <== osd.3 v2:172.21.15.46:6824/270588901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ec00733b0 con 0x7f0eac06ebf0 2023-05-21T16:54:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 --> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05b40733b0 con 0x7f05a006ebf0 2023-05-21T16:54:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 --> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49b0002d60 con 0x7f49ac06ea80 2023-05-21T16:54:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f05b17fa700 1 -- 172.21.15.46:0/3850279119 <== osd.2 v2:172.21.15.46:6800/4251490015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05b40733b0 con 0x7f05a006ebf0 2023-05-21T16:54:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f0eac06ebf0 msgr2=0x7f0eac071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f0eac06ebf0 0x7f0eac071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0eac066340 msgr2=0x7f0eac0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0eac066340 0x7f0eac0687f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b370 tx=0x7f0eb8015000 comp rx=0 tx=0).stop 2023-05-21T16:54:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ec00ccec0 msgr2=0x7f0ec01f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 --2- 172.21.15.46:0/3224867941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ec00ccec0 0x7f0ec01f3db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400e850 tx=0x7f0eb400eb60 comp rx=0 tx=0).stop 2023-05-21T16:54:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec509f700 1 -- 172.21.15.46:0/3224867941 reap_dead start 2023-05-21T16:54:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 shutdown_connections 2023-05-21T16:54:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 >> 172.21.15.46:0/3224867941 conn(0x7f0ec00cf720 msgr2=0x7f0ec0155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.460 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-05-21T16:54:23.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-21T16:54:23.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 shutdown_connections 2023-05-21T16:54:23.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.373+0000 7f0ec58a0700 1 -- 172.21.15.46:0/3224867941 wait complete. 2023-05-21T16:54:23.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.377+0000 7f49be7fc700 1 -- 172.21.15.46:0/3780295348 <== osd.1 v2:172.21.15.46:6808/3939198338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49b0002d60 con 0x7f49ac06ea80 2023-05-21T16:54:23.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f05a006ebf0 msgr2=0x7f05a0071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f05a006ebf0 0x7f05a0071000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f05a0066340 msgr2=0x7f05a00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f05a0066340 0x7f05a00687f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00b370 tx=0x7f05ac009000 comp rx=0 tx=0).stop 2023-05-21T16:54:23.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ee30 msgr2=0x7f05b41fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 --2- 172.21.15.46:0/3850279119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05b406ee30 0x7f05b41fe1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05a800e940 tx=0x7f05a800ec50 comp rx=0 tx=0).stop 2023-05-21T16:54:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f05b918a700 1 -- 172.21.15.46:0/3850279119 reap_dead start 2023-05-21T16:54:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 shutdown_connections 2023-05-21T16:54:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 >> 172.21.15.46:0/3850279119 conn(0x7f05b40cc1a0 msgr2=0x7f05b415b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 shutdown_connections 2023-05-21T16:54:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.381+0000 7f059affd700 1 -- 172.21.15.46:0/3850279119 wait complete. 2023-05-21T16:54:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7f49ac06ea80 msgr2=0x7f49ac070e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7f49ac06ea80 0x7f49ac070e90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49ac066340 msgr2=0x7f49ac0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f49ac066340 0x7f49ac0687f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49b80097d0 tx=0x7f49b8008030 comp rx=0 tx=0).stop 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 msgr2=0x7f49c814f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 --2- 172.21.15.46:0/3780295348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80b8ad0 0x7f49c814f280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c400 tx=0x7f49c400c710 comp rx=0 tx=0).stop 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49ce415700 1 -- 172.21.15.46:0/3780295348 reap_dead start 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 shutdown_connections 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 >> 172.21.15.46:0/3780295348 conn(0x7f49c80d3ae0 msgr2=0x7f49c815b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 shutdown_connections 2023-05-21T16:54:23.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.385+0000 7f49cec16700 1 -- 172.21.15.46:0/3780295348 wait complete. 2023-05-21T16:54:23.467 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:23.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-21T16:54:23.468 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:23.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-21T16:54:23.470 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-05-21T16:54:23.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-21T16:54:23.471 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-05-21T16:54:23.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-21T16:54:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.389+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 --> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffbc8005c60 con 0x7ffbc80015e0 2023-05-21T16:54:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbd2ffd700 1 -- 172.21.15.46:0/4078550824 <== osd.7 v2:172.21.15.142:6800/3864156149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffbc8005c60 con 0x7ffbc80015e0 2023-05-21T16:54:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7ffbc80015e0 msgr2=0x7ffbc8003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7ffbc80015e0 0x7ffbc8003a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffbcc0664d0 msgr2=0x7ffbcc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffbcc0664d0 0x7ffbcc068980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80099f0 tx=0x7ffbd80090e0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbe416d230 msgr2=0x7ffbe40b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 --2- 172.21.15.46:0/4078550824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbe416d230 0x7ffbe40b3860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b970 tx=0x7ffbdc00bc80 comp rx=0 tx=0).stop 2023-05-21T16:54:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe2d9d700 1 -- 172.21.15.46:0/4078550824 reap_dead start 2023-05-21T16:54:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 shutdown_connections 2023-05-21T16:54:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 >> 172.21.15.46:0/4078550824 conn(0x7ffbe40cc1a0 msgr2=0x7ffbe40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 shutdown_connections 2023-05-21T16:54:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.393+0000 7ffbe359e700 1 -- 172.21.15.46:0/4078550824 wait complete. 2023-05-21T16:54:23.475 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:23.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-21T16:54:23.476 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-05-21T16:54:23.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-21T16:54:23.477 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:23.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-21T16:54:23.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.665+0000 7ff4c8831700 1 Processor -- start 2023-05-21T16:54:23.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.665+0000 7f24cf59e700 1 Processor -- start 2023-05-21T16:54:23.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.665+0000 7f24cf59e700 1 -- start start 2023-05-21T16:54:23.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.665+0000 7ff4c8831700 1 -- start start 2023-05-21T16:54:23.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.665+0000 7f5113181700 1 Processor -- start 2023-05-21T16:54:23.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.665+0000 7f5113181700 1 -- start start 2023-05-21T16:54:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea2d5b2700 1 Processor -- start 2023-05-21T16:54:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea2d5b2700 1 -- start start 2023-05-21T16:54:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 Processor -- start 2023-05-21T16:54:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 -- start start 2023-05-21T16:54:23.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60ef68700 1 Processor -- start 2023-05-21T16:54:23.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b9cea7700 1 Processor -- start 2023-05-21T16:54:23.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cf59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24d0164bf0 0x7f24d00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cf59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d006b900 con 0x7f24d00ce260 2023-05-21T16:54:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cf59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d006b620 con 0x7f24d0164fc0 2023-05-21T16:54:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cf59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d006c990 con 0x7f24d0164bf0 2023-05-21T16:54:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea2d5b2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fea280cc6f0 0x7fea280cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea2d5b2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280ccb40 con 0x7fea280ade60 2023-05-21T16:54:23.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea2d5b2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280ccdb0 con 0x7fea280ce390 2023-05-21T16:54:23.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea2d5b2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea280cd090 con 0x7fea280cc6f0 2023-05-21T16:54:23.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea27fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fea280ade60 0x7fea280c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57350/0 (socket says 172.21.15.46:57350) 2023-05-21T16:54:23.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea27fff700 1 -- 172.21.15.46:0/3583395343 learned_addr learned my addr 172.21.15.46:0/3583395343 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80b40c5230 0x7f80b406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b4071840 con 0x7f80b4069f80 2023-05-21T16:54:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b415ac50 con 0x7f80b40c5230 2023-05-21T16:54:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80bbbe0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4071cd0 con 0x7f80b40706c0 2023-05-21T16:54:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c8831700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 0x7ff4c40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c8831700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4c406d080 0x7ff4c41604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c8831700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40ccb40 con 0x7ff4c406ee30 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c8831700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40cce20 con 0x7ff4c406d080 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c8831700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40cd100 con 0x7ff4c406ea60 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 0x7ff4c40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4c406d080 0x7ff4c41604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 0x7ff4c40c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:56380/0 (socket says 172.21.15.46:56380) 2023-05-21T16:54:23.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 -- 172.21.15.46:0/4180271505 learned_addr learned my addr 172.21.15.46:0/4180271505 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 -- 172.21.15.46:0/4180271505 >> v2:172.21.15.142:3300/0 conn(0x7ff4c406d080 msgr2=0x7ff4c41604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/4180271505 >> v2:172.21.15.142:3300/0 conn(0x7ff4c406d080 0x7ff4c41604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80ba17d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f80b4069f80 0x7f80b415e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57364/0 (socket says 172.21.15.46:57364) 2023-05-21T16:54:23.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80ba17d700 1 -- 172.21.15.46:0/2861311509 learned_addr learned my addr 172.21.15.46:0/2861311509 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 -- 172.21.15.46:0/4180271505 >> v1:172.21.15.142:6789/0 conn(0x7ff4c406ee30 legacy=0x7ff4c406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 -- 172.21.15.46:0/4180271505 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40cd3e0 con 0x7ff4c406ea60 2023-05-21T16:54:23.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b9cea7700 1 -- start start 2023-05-21T16:54:23.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b9cea7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1b980b3660 0x7f1b980b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b9cea7700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b98159160 con 0x7f1b980ccec0 2023-05-21T16:54:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b9cea7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b980cf0a0 con 0x7f1b98071bb0 2023-05-21T16:54:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b9cea7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9806ef10 con 0x7f1b980b3660 2023-05-21T16:54:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b97fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1b980ccec0 0x7f1b980cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57386/0 (socket says 172.21.15.46:57386) 2023-05-21T16:54:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b97fff700 1 -- 172.21.15.46:0/2584555157 learned_addr learned my addr 172.21.15.46:0/2584555157 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24ced9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f24d00ce260 0x7f24d0069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57376/0 (socket says 172.21.15.46:57376) 2023-05-21T16:54:23.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24ced9d700 1 -- 172.21.15.46:0/3886434717 learned_addr learned my addr 172.21.15.46:0/3886434717 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b997c700 1 --2- 172.21.15.46:0/2861311509 >> v2:172.21.15.142:3300/0 conn(0x7f80b40c5230 0x7f80b406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/4180271505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 0x7ff4c40c9c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009e50 tx=0x7ff4bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666ecda24f430824 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60ef68700 1 -- start start 2023-05-21T16:54:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60ef68700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe60806a420 0x7fe6080c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60ef68700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080ade30 con 0x7fe608069f80 2023-05-21T16:54:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60ef68700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080cd210 con 0x7fe608160be0 2023-05-21T16:54:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60ef68700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080cc970 con 0x7fe60806a420 2023-05-21T16:54:23.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/2584555157 >> v2:172.21.15.142:3300/0 conn(0x7f1b980b3660 0x7f1b980b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea26ffd700 1 -- 172.21.15.46:0/3583395343 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26164680 0 0) 0x7fea280ccb40 con 0x7fea280ade60 2023-05-21T16:54:23.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b897a700 1 -- 172.21.15.46:0/2861311509 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814972971 0 0) 0x7f80b4071840 con 0x7f80b4069f80 2023-05-21T16:54:23.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b897a700 1 -- 172.21.15.46:0/2861311509 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a00035d0 con 0x7f80b4069f80 2023-05-21T16:54:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24ce59c700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24d0164bf0 0x7f24d00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949433712 0 0) 0x7f24d006b900 con 0x7f24d00ce260 2023-05-21T16:54:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b80035d0 con 0x7f24d00ce260 2023-05-21T16:54:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68627737 0 0) 0x7f1b98159160 con 0x7f1b980ccec0 2023-05-21T16:54:23.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b800035d0 con 0x7f1b980ccec0 2023-05-21T16:54:23.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea277fe700 1 --2- 172.21.15.46:0/3583395343 >> v2:172.21.15.46:3300/0 conn(0x7fea280cc6f0 0x7fea280cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c27fc700 1 -- 172.21.15.46:0/4180271505 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00e070 con 0x7ff4c406ea60 2023-05-21T16:54:23.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b917b700 1 --2- 172.21.15.46:0/2861311509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60e767700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe60806a420 0x7fe6080c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60d765700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe608069f80 0x7fe608070c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57402/0 (socket says 172.21.15.46:57402) 2023-05-21T16:54:23.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fe60d765700 1 -- 172.21.15.46:0/3959553651 learned_addr learned my addr 172.21.15.46:0/3959553651 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c27fc700 1 -- 172.21.15.46:0/4180271505 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00b910 con 0x7ff4c406ea60 2023-05-21T16:54:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7ff4c27fc700 1 -- 172.21.15.46:0/4180271505 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00bcc0 con 0x7ff4c406ea60 2023-05-21T16:54:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2163206074 0 0) 0x7f1b800035d0 con 0x7f1b980ccec0 2023-05-21T16:54:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 >> v2:172.21.15.142:3300/0 conn(0x7f1b980b3660 msgr2=0x7f1b980b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 --2- 172.21.15.46:0/2584555157 >> v2:172.21.15.142:3300/0 conn(0x7f1b980b3660 0x7f1b980b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 >> v1:172.21.15.142:6789/0 conn(0x7f1b98071bb0 legacy=0x7f1b980cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980ae9b0 con 0x7f1b980ccec0 2023-05-21T16:54:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f1b900019f0 con 0x7f1b980ccec0 2023-05-21T16:54:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fe60e767700 1 -- 172.21.15.46:0/3959553651 >> v1:172.21.15.142:6789/0 conn(0x7fe608160be0 legacy=0x7fe6081651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fe60e767700 1 -- 172.21.15.46:0/3959553651 >> v1:172.21.15.46:6789/0 conn(0x7fe608069f80 legacy=0x7fe608070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fe60e767700 1 -- 172.21.15.46:0/3959553651 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080ccc50 con 0x7fe60806a420 2023-05-21T16:54:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809965850 0 0) 0x7f24b80035d0 con 0x7f24d00ce260 2023-05-21T16:54:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24d0164bf0 msgr2=0x7f24d00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24d0164bf0 0x7f24d00c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 >> v1:172.21.15.142:6789/0 conn(0x7f24d0164fc0 legacy=0x7f24d0160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00cc770 con 0x7f24d00ce260 2023-05-21T16:54:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f24c80019f0 con 0x7f24d00ce260 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 >> v1:172.21.15.46:6789/0 conn(0x7f24d00ce260 legacy=0x7f24d0069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b8003a50 0x7f24b8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8004870 0x7f24b8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b8005220 0x7f24b800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d006c990 con 0x7f24b8003a50 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b800c0d0 con 0x7f24b8005220 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b800c290 con 0x7f24b8004870 2023-05-21T16:54:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b8005220 0x7f24b800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea26ffd700 1 -- 172.21.15.46:0/3583395343 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea100035d0 con 0x7fea280ade60 2023-05-21T16:54:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea277fe700 1 -- 172.21.15.46:0/3583395343 >> v1:172.21.15.142:6789/0 conn(0x7fea280ce390 legacy=0x7fea281604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7fea277fe700 1 -- 172.21.15.46:0/3583395343 >> v1:172.21.15.46:6789/0 conn(0x7fea280ade60 legacy=0x7fea280c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea277fe700 1 -- 172.21.15.46:0/3583395343 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280cd370 con 0x7fea280cc6f0 2023-05-21T16:54:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea277fe700 1 --2- 172.21.15.46:0/3583395343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280cde50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea180097d0 tx=0x7fea18009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31dc6e883684438 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f5113181700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f510c0adf30 0x7f510c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f5113181700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c0c9d00 0x7f510c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f5113181700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f510c16d800 0x7f510c16dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f5113181700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c089dc0 con 0x7f510c16d800 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f5113181700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0ae660 con 0x7f510c0adf30 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f5113181700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c06dc60 con 0x7f510c0c9d00 2023-05-21T16:54:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f510c16d800 0x7f510c16dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511217f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f510c0adf30 0x7f510c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511197e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c0c9d00 0x7f510c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511217f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f510c0adf30 0x7f510c0c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:51270/0 (socket says 172.21.15.46:51270) 2023-05-21T16:54:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511217f700 1 -- 172.21.15.46:0/523670568 learned_addr learned my addr 172.21.15.46:0/523670568 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f510c16d800 0x7f510c16dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58930/0 (socket says 172.21.15.46:58930) 2023-05-21T16:54:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b917b700 1 -- 172.21.15.46:0/2861311509 >> v2:172.21.15.142:3300/0 conn(0x7f80b40c5230 msgr2=0x7f80b406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b917b700 1 --2- 172.21.15.46:0/2861311509 >> v2:172.21.15.142:3300/0 conn(0x7f80b40c5230 0x7f80b406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b917b700 1 -- 172.21.15.46:0/2861311509 >> v1:172.21.15.46:6789/0 conn(0x7f80b4069f80 legacy=0x7f80b415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b917b700 1 -- 172.21.15.46:0/2861311509 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4070c30 con 0x7f80b40706c0 2023-05-21T16:54:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.669+0000 7f80b997c700 1 --2- 172.21.15.46:0/2861311509 >> v2:172.21.15.142:3300/0 conn(0x7f80b40c5230 0x7f80b406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f80b917b700 1 --2- 172.21.15.46:0/2861311509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b406d080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009850 tx=0x7f80b0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29384871b757b2e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 -- 172.21.15.46:0/4180271505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 msgr2=0x7ff4c40c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 --2- 172.21.15.46:0/4180271505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 0x7ff4c40c9c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009e50 tx=0x7ff4bc00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 >> v1:172.21.15.46:6789/0 conn(0x7f1b980ccec0 legacy=0x7f1b980cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fe60e767700 1 --2- 172.21.15.46:0/3959553651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe60806a420 0x7fe6080c18a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe600009df0 tx=0x7fe60000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f1ee728cf44355 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b80003a20 0x7f1b80003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b80004870 0x7f1b80004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80005220 0x7f1b8000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9806ef10 con 0x7f1b80005220 2023-05-21T16:54:23.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8000c080 con 0x7f1b80003a20 2023-05-21T16:54:23.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8000c240 con 0x7f1b80004870 2023-05-21T16:54:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ce59c700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b8003a50 0x7f24b8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 -- 172.21.15.46:0/4180271505 shutdown_connections 2023-05-21T16:54:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 --2- 172.21.15.46:0/4180271505 >> v2:172.21.15.142:3300/0 conn(0x7ff4c406d080 0x7ff4c41604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 --2- 172.21.15.46:0/4180271505 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406ea60 0x7ff4c40c9c20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 -- 172.21.15.46:0/4180271505 >> 172.21.15.46:0/4180271505 conn(0x7ff4c40cc1a0 msgr2=0x7ff4c40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 -- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8004870 msgr2=0x7f24b8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8004870 0x7f24b8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 -- 172.21.15.46:0/3886434717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b8003a50 msgr2=0x7f24b8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b8003a50 0x7f24b8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 -- 172.21.15.46:0/523670568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c0c9d00 msgr2=0x7f510c06a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 --2- 172.21.15.46:0/523670568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c0c9d00 0x7f510c06a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 -- 172.21.15.46:0/523670568 >> v2:172.21.15.142:3300/0 conn(0x7f510c0adf30 msgr2=0x7f510c0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 --2- 172.21.15.46:0/523670568 >> v2:172.21.15.142:3300/0 conn(0x7f510c0adf30 0x7f510c0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 -- 172.21.15.46:0/523670568 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0ca8a0 con 0x7f510c16d800 2023-05-21T16:54:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b80004870 0x7f1b80004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511197e700 1 --2- 172.21.15.46:0/523670568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c0c9d00 0x7f510c06a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 -- 172.21.15.46:0/4180271505 shutdown_connections 2023-05-21T16:54:23.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b977fe700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b80003a20 0x7f1b80003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fe60cf64700 1 -- 172.21.15.46:0/3959553651 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000e070 con 0x7fe60806a420 2023-05-21T16:54:23.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 -- 172.21.15.46:0/3886434717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80035d0 con 0x7f24b8005220 2023-05-21T16:54:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea26ffd700 1 -- 172.21.15.46:0/3583395343 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18004230 con 0x7fea280cc6f0 2023-05-21T16:54:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b97fff700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80005220 0x7f1b8000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea26ffd700 1 -- 172.21.15.46:0/3583395343 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18004390 con 0x7fea280cc6f0 2023-05-21T16:54:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea26ffd700 1 -- 172.21.15.46:0/3583395343 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180036c0 con 0x7fea280cc6f0 2023-05-21T16:54:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b8005220 0x7f24b800ba30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f24c800a7b0 tx=0x7f24b80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f5f644c020c49 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5112980700 1 --2- 172.21.15.46:0/523670568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c16d800 0x7f510c16dc80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f510c0ce8e0 tx=0x7f510400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d19c9499b756ce5 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 -- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b80003a20 msgr2=0x7f1b80003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b80003a20 0x7f1b80003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 -- 172.21.15.46:0/2584555157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80005220 msgr2=0x7f1b8000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80005220 0x7f1b8000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 -- 172.21.15.46:0/2584555157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800035d0 con 0x7f1b80004870 2023-05-21T16:54:23.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 Processor -- start 2023-05-21T16:54:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80072d0 con 0x7f24b8005220 2023-05-21T16:54:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511117d700 1 -- 172.21.15.46:0/523670568 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400e070 con 0x7f510c16d800 2023-05-21T16:54:23.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8007430 con 0x7f24b8005220 2023-05-21T16:54:23.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24cd59a700 1 -- 172.21.15.46:0/3886434717 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80077e0 con 0x7f24b8005220 2023-05-21T16:54:23.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511117d700 1 -- 172.21.15.46:0/523670568 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400bb20 con 0x7f510c16d800 2023-05-21T16:54:23.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f511117d700 1 -- 172.21.15.46:0/523670568 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104012430 con 0x7f510c16d800 2023-05-21T16:54:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b97fff700 1 -- 172.21.15.46:0/2584555157 reap_dead start 2023-05-21T16:54:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b80004870 0x7f1b80004ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00be70 tx=0x7f1b800058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d320cf21517d6d3d server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3583395343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 msgr2=0x7fea280cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 --2- 172.21.15.46:0/3583395343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280cde50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea180097d0 tx=0x7fea18009ae0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c012040 con 0x7f1b80004870 2023-05-21T16:54:23.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00ddc0 con 0x7f1b80004870 2023-05-21T16:54:23.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f1b967fc700 1 -- 172.21.15.46:0/2584555157 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0185f0 con 0x7f1b80004870 2023-05-21T16:54:23.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3583395343 shutdown_connections 2023-05-21T16:54:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 --2- 172.21.15.46:0/3583395343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280cde50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3583395343 >> 172.21.15.46:0/3583395343 conn(0x7fea280cc1a0 msgr2=0x7fea280b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3583395343 shutdown_connections 2023-05-21T16:54:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3583395343 wait complete. 2023-05-21T16:54:23.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24cf59e700 1 -- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b8005220 msgr2=0x7f24b800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24cf59e700 1 --2- 172.21.15.46:0/3886434717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24b8005220 0x7f24b800ba30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f24c800a7b0 tx=0x7f24b80058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f24ced9d700 1 -- 172.21.15.46:0/3886434717 reap_dead start 2023-05-21T16:54:23.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f80b897a700 1 -- 172.21.15.46:0/2861311509 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011830 con 0x7f80b40706c0 2023-05-21T16:54:23.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f80b897a700 1 -- 172.21.15.46:0/2861311509 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0011990 con 0x7f80b40706c0 2023-05-21T16:54:23.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f80b897a700 1 -- 172.21.15.46:0/2861311509 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011d20 con 0x7f80b40706c0 2023-05-21T16:54:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5113181700 1 -- 172.21.15.46:0/523670568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c16d800 msgr2=0x7f510c16dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f5113181700 1 --2- 172.21.15.46:0/523670568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c16d800 0x7f510c16dc80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f510c0ce8e0 tx=0x7f510400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 -- 172.21.15.46:0/4180271505 wait complete. 2023-05-21T16:54:23.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 Processor -- start 2023-05-21T16:54:23.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7ff4c8831700 1 -- start start 2023-05-21T16:54:23.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- 172.21.15.46:0/3886434717 shutdown_connections 2023-05-21T16:54:23.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- 172.21.15.46:0/3886434717 >> 172.21.15.46:0/3886434717 conn(0x7f24d00cc1a0 msgr2=0x7f24d00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 -- 172.21.15.46:0/2861311509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 msgr2=0x7f80b406d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/2861311509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b406d080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009850 tx=0x7f80b0009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 -- 172.21.15.46:0/523670568 shutdown_connections 2023-05-21T16:54:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 --2- 172.21.15.46:0/523670568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c16d800 0x7f510c16dc80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 --2- 172.21.15.46:0/523670568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c0c9d00 0x7f510c06a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 --2- 172.21.15.46:0/523670568 >> v2:172.21.15.142:3300/0 conn(0x7f510c0adf30 0x7f510c0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 -- 172.21.15.46:0/523670568 >> 172.21.15.46:0/523670568 conn(0x7f510c0cf610 msgr2=0x7f510c0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 -- start start 2023-05-21T16:54:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2afc160be0 0x7f2afc1651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc06a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc0ade30 con 0x7f2afc070c50 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0cd210 con 0x7f2afc160be0 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b01258700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cc970 con 0x7f2afc069f80 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b00a57700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2afc070c50 0x7f2afc0c18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57408/0 (socket says 172.21.15.46:57408) 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2b00a57700 1 -- 172.21.15.46:0/3141394142 learned_addr learned my addr 172.21.15.46:0/3141394142 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2afb7fe700 1 --2- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc06a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7f2afbfff700 1 --2- 172.21.15.46:0/3141394142 >> v2:172.21.15.142:3300/0 conn(0x7f2afc160be0 0x7f2afc1651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afbfff700 1 -- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 msgr2=0x7f2afc06a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afbfff700 1 --2- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc06a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afbfff700 1 -- 172.21.15.46:0/3141394142 >> v1:172.21.15.46:6789/0 conn(0x7f2afc070c50 legacy=0x7f2afc0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afbfff700 1 -- 172.21.15.46:0/3141394142 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0ccc50 con 0x7f2afc160be0 2023-05-21T16:54:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406d080 0x7ff4c40c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c406ea60 0x7ff4c40acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 0x7ff4c40ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c415f570 con 0x7ff4c406ee30 2023-05-21T16:54:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c4ba0 con 0x7ff4c406ea60 2023-05-21T16:54:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c3f90 con 0x7ff4c406d080 2023-05-21T16:54:23.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f1b9cea7700 1 -- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b80004870 msgr2=0x7f1b80004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b80004870 0x7f1b80004ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00be70 tx=0x7f1b800058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.673+0000 7fe60cf64700 1 -- 172.21.15.46:0/3959553651 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000bb90 con 0x7fe60806a420 2023-05-21T16:54:23.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 -- 172.21.15.46:0/523670568 shutdown_connections 2023-05-21T16:54:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 Processor -- start 2023-05-21T16:54:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 -- start start 2023-05-21T16:54:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afbfff700 1 --2- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc160be0 0x7f2afc1651c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009850 tx=0x7f2aec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a3356b8f85d9a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 0x7ff4c40ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 -- 172.21.15.46:0/2861311509 shutdown_connections 2023-05-21T16:54:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/2861311509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b406d080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/2861311509 >> v2:172.21.15.142:3300/0 conn(0x7f80b40c5230 0x7f80b406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 -- 172.21.15.46:0/2861311509 >> 172.21.15.46:0/2861311509 conn(0x7f80b40cec40 msgr2=0x7f80b40cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 0x7ff4c40ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58968/0 (socket says 172.21.15.46:58968) 2023-05-21T16:54:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 -- 172.21.15.46:0/2858252610 learned_addr learned my addr 172.21.15.46:0/2858252610 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c2ffd700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c406ea60 0x7ff4c40acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406d080 0x7ff4c40c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- 172.21.15.46:0/3886434717 shutdown_connections 2023-05-21T16:54:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f1b9cea7700 1 -- 172.21.15.46:0/2584555157 shutdown_connections 2023-05-21T16:54:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/2584555157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b80004870 0x7f1b80004ce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f1b9cea7700 1 -- 172.21.15.46:0/2584555157 >> 172.21.15.46:0/2584555157 conn(0x7f1b980cca00 msgr2=0x7f1b980cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 -- 172.21.15.46:0/2861311509 shutdown_connections 2023-05-21T16:54:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 -- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406d080 msgr2=0x7ff4c40c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406d080 0x7ff4c40c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 -- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c406ea60 msgr2=0x7ff4c40acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c406ea60 0x7ff4c40acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 -- 172.21.15.46:0/2858252610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009b30 con 0x7ff4c406ee30 2023-05-21T16:54:23.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fe60cf64700 1 -- 172.21.15.46:0/3959553651 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600012430 con 0x7fe60806a420 2023-05-21T16:54:23.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- 172.21.15.46:0/3886434717 wait complete. 2023-05-21T16:54:23.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 -- 172.21.15.46:0/2861311509 wait complete. 2023-05-21T16:54:23.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c3fff700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 0x7ff4c40ad3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800e7b0 tx=0x7ff4b800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8009560 con 0x7ff4c406ee30 2023-05-21T16:54:23.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 -- 172.21.15.46:0/2858252610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40ca160 con 0x7ff4c406ee30 2023-05-21T16:54:23.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8013680 con 0x7ff4c406ee30 2023-05-21T16:54:23.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8013a10 con 0x7ff4c406ee30 2023-05-21T16:54:23.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4c8831700 1 -- 172.21.15.46:0/2858252610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c40cd6c0 con 0x7ff4c406ee30 2023-05-21T16:54:23.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fe60ef68700 1 -- 172.21.15.46:0/3959553651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe60806a420 msgr2=0x7fe6080c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fe60ef68700 1 --2- 172.21.15.46:0/3959553651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe60806a420 0x7fe6080c18a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe600009df0 tx=0x7fe60000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:23.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fe60ef68700 1 -- 172.21.15.46:0/3959553651 shutdown_connections 2023-05-21T16:54:23.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fe60ef68700 1 --2- 172.21.15.46:0/3959553651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe60806a420 0x7fe6080c18a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fe60ef68700 1 -- 172.21.15.46:0/3959553651 >> 172.21.15.46:0/3959553651 conn(0x7fe6080cf720 msgr2=0x7fe6080cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 Processor -- start 2023-05-21T16:54:23.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- start start 2023-05-21T16:54:23.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea280ade60 0x7fea280b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea280ce390 0x7fea2806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea28151a10 con 0x7fea280cc6f0 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280b4510 con 0x7fea280ade60 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2d5b2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2806e1e0 con 0x7fea280ce390 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea280ce390 0x7fea2806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea27fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea280ade60 0x7fea280b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58976/0 (socket says 172.21.15.46:58976) 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea277fe700 1 -- 172.21.15.46:0/3601921313 learned_addr learned my addr 172.21.15.46:0/3601921313 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 -- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea280ade60 msgr2=0x7fea280b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea280ade60 0x7fea280b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 -- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 msgr2=0x7fea280b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 -- 172.21.15.46:0/3601921313 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180094b0 con 0x7fea280ce390 2023-05-21T16:54:23.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea277fe700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:23.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afaffd700 1 -- 172.21.15.46:0/3141394142 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec004230 con 0x7f2afc160be0 2023-05-21T16:54:23.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afaffd700 1 -- 172.21.15.46:0/3141394142 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec004390 con 0x7f2afc160be0 2023-05-21T16:54:23.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f2afaffd700 1 -- 172.21.15.46:0/3141394142 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0036c0 con 0x7f2afc160be0 2023-05-21T16:54:23.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 -- 172.21.15.46:0/523670568 wait complete. 2023-05-21T16:54:23.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 Processor -- start 2023-05-21T16:54:23.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 Processor -- start 2023-05-21T16:54:23.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f80bbbe0700 1 -- start start 2023-05-21T16:54:23.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8005220 0x7f24d0162f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24d00c6800 0x7f24d0163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24d01f58c0 0x7f24d00b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0164020 con 0x7f24d00c6800 2023-05-21T16:54:23.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00c5ad0 con 0x7f24d01f58c0 2023-05-21T16:54:23.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f24cf59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0163570 con 0x7f24b8005220 2023-05-21T16:54:23.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7fea2cdb1700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea280ce390 0x7fea2806cbc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea280ce7b0 tx=0x7fea1c00c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 -- 172.21.15.46:0/2584555157 shutdown_connections 2023-05-21T16:54:23.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24cdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24d00c6800 0x7f24d0163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24cdd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24d00c6800 0x7f24d0163ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58986/0 (socket says 172.21.15.46:58986) 2023-05-21T16:54:23.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24cdd9b700 1 -- 172.21.15.46:0/942879812 learned_addr learned my addr 172.21.15.46:0/942879812 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f2b01258700 1 -- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc160be0 msgr2=0x7f2afc1651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f2b01258700 1 --2- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc160be0 0x7f2afc1651c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009850 tx=0x7f2aec009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:23.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 0x7f80b40c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b40b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c5230 0x7f80b40adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40b1cb0 con 0x7f80b40c5230 2023-05-21T16:54:23.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40b4bc0 con 0x7f80b4069f80 2023-05-21T16:54:23.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c6d50 con 0x7f80b40706c0 2023-05-21T16:54:23.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24d01f58c0 0x7f24d00b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 -- 172.21.15.46:0/2584555157 wait complete. 2023-05-21T16:54:23.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0054e0 con 0x7fea280ce390 2023-05-21T16:54:23.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7f5113181700 1 -- start start 2023-05-21T16:54:23.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5113181700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 0x7f510c1650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5113181700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c0c9d00 0x7f510c163210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5113181700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c16d800 0x7f510c082340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5113181700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c086870 con 0x7f510c0adf30 2023-05-21T16:54:23.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5113181700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c163cb0 con 0x7f510c0c9d00 2023-05-21T16:54:23.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5113181700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c163f90 con 0x7f510c16d800 2023-05-21T16:54:23.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.677+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4b8013b70 con 0x7ff4c406ee30 2023-05-21T16:54:23.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7ff4abfff700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4b00662f0 0x7ff4b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c00ce50 con 0x7fea280ce390 2023-05-21T16:54:23.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3601921313 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea280cd930 con 0x7fea280ce390 2023-05-21T16:54:23.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0038c0 con 0x7fea280ce390 2023-05-21T16:54:23.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f2b01258700 1 -- 172.21.15.46:0/3141394142 shutdown_connections 2023-05-21T16:54:23.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f2b01258700 1 --2- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc06a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f2b01258700 1 --2- 172.21.15.46:0/3141394142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc160be0 0x7f2afc1651c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 0x7f510c1650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 0x7f510c1650f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59006/0 (socket says 172.21.15.46:59006) 2023-05-21T16:54:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f5112980700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c16d800 0x7f510c082340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 -- 172.21.15.46:0/1030082296 learned_addr learned my addr 172.21.15.46:0/1030082296 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511197e700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c0c9d00 0x7f510c163210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4b8083ba0 con 0x7ff4c406ee30 2023-05-21T16:54:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3601921313 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea280cd650 con 0x7fea280ce390 2023-05-21T16:54:23.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4b00662f0 0x7ff4b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 -- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c16d800 msgr2=0x7f510c082340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c16d800 0x7f510c082340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 -- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c0c9d00 msgr2=0x7f510c163210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c0c9d00 0x7f510c163210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 -- 172.21.15.46:0/1030082296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0094b0 con 0x7f510c0adf30 2023-05-21T16:54:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ce59c700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8005220 0x7f24d0162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 -- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8005220 msgr2=0x7f24d0162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8005220 0x7f24d0162f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 -- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24d00c6800 msgr2=0x7f24d0163ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24d00c6800 0x7f24d0163ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 -- 172.21.15.46:0/942879812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00ccd30 con 0x7f24d01f58c0 2023-05-21T16:54:23.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24ced9d700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24d01f58c0 0x7f24d00b3800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24c800a780 tx=0x7f24c8001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f511217f700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 0x7f510c1650f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f510800e8b0 tx=0x7f510800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80077b0 con 0x7f24d01f58c0 2023-05-21T16:54:23.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 Processor -- start 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 -- start start 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80004870 0x7f1b980c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 0x7f1b9815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b981580f0 0x7f1b980ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98158c40 con 0x7f1b80004870 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980c7d10 con 0x7f1b981580f0 2023-05-21T16:54:23.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f1b9cea7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980c7fa0 con 0x7f1b980c78a0 2023-05-21T16:54:23.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7ff4c37fe700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4b00662f0 0x7ff4b00687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00b370 tx=0x7ff4bc009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7ff4c8831700 1 -- 172.21.15.46:0/2858252610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c40ca2f0 con 0x7ff4c406ee30 2023-05-21T16:54:23.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fe60ef68700 1 -- 172.21.15.46:0/3959553651 shutdown_connections 2023-05-21T16:54:23.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00cca50 con 0x7f24d01f58c0 2023-05-21T16:54:23.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d0160f40 con 0x7f24d01f58c0 2023-05-21T16:54:23.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8007910 con 0x7f24d01f58c0 2023-05-21T16:54:23.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8012400 con 0x7f24d01f58c0 2023-05-21T16:54:23.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b4005310 con 0x7f24d01f58c0 2023-05-21T16:54:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3601921313 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea280ae230 con 0x7fea280ce390 2023-05-21T16:54:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea1c003a20 con 0x7fea280ce390 2023-05-21T16:54:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea24ff9700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fea14066340 0x7fea140687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea1c082f70 con 0x7fea280ce390 2023-05-21T16:54:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7fea27fff700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fea14066340 0x7fea140687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7fea27fff700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fea14066340 0x7fea140687f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea200012e0 tx=0x7fea20001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f2b01258700 1 -- 172.21.15.46:0/3141394142 >> 172.21.15.46:0/3141394142 conn(0x7f2afc0cf720 msgr2=0x7f2afc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 0x7f80b40c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80ba17d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c5230 0x7f80b40adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 0x7f80b40c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:51338/0 (socket says 172.21.15.46:51338) 2023-05-21T16:54:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 -- 172.21.15.46:0/1221094767 learned_addr learned my addr 172.21.15.46:0/1221094767 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 -- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 msgr2=0x7f80b40b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b40b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 -- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c5230 msgr2=0x7f80b40adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c5230 0x7f80b40adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 -- 172.21.15.46:0/1221094767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac009a70 con 0x7f80b4069f80 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80b997c700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 0x7f80b40c6690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ca50 tx=0x7f80ac00cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00b9b0 con 0x7f80b4069f80 2023-05-21T16:54:23.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00bb10 con 0x7f80b4069f80 2023-05-21T16:54:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b00094b0 con 0x7f80b4069f80 2023-05-21T16:54:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00bea0 con 0x7f80b4069f80 2023-05-21T16:54:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.681+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b40711f0 con 0x7f80b4069f80 2023-05-21T16:54:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 -- 172.21.15.46:0/3141394142 shutdown_connections 2023-05-21T16:54:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c005310 con 0x7f80b4069f80 2023-05-21T16:54:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108013680 con 0x7f510c0adf30 2023-05-21T16:54:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51080137e0 con 0x7f510c0adf30 2023-05-21T16:54:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5104009a70 con 0x7f510c0adf30 2023-05-21T16:54:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108013b50 con 0x7f510c0adf30 2023-05-21T16:54:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c0ca5c0 con 0x7f510c0adf30 2023-05-21T16:54:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80ac01e430 con 0x7f80b4069f80 2023-05-21T16:54:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 -- 172.21.15.46:0/3141394142 wait complete. 2023-05-21T16:54:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f80aa7fc700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f80980662f0 0x7f80980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 0x7f1b9815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 0x7f1b9815a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:56524/0 (socket says 172.21.15.46:56524) 2023-05-21T16:54:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 -- 172.21.15.46:0/1769872587 learned_addr learned my addr 172.21.15.46:0/1769872587 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 -- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b981580f0 msgr2=0x7f1b980ca800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-21T16:54:23.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b981580f0 0x7f1b980ca800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 -- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80004870 msgr2=0x7f1b980c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80004870 0x7f1b980c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 -- 172.21.15.46:0/1769872587 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9806e430 con 0x7f1b980c78a0 2023-05-21T16:54:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f1b96ffd700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 0x7f1b9815a510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c018c60 tx=0x7f1b8c006f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24c801a070 con 0x7f24d01f58c0 2023-05-21T16:54:23.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f24beffd700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f24b00662f0 0x7f24b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24c80859a0 con 0x7f24d01f58c0 2023-05-21T16:54:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c0ca2e0 con 0x7f510c0adf30 2023-05-21T16:54:23.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80ac016e40 con 0x7f80b4069f80 2023-05-21T16:54:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f24ce59c700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f24b00662f0 0x7f24b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f80b917b700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f80980662f0 0x7f80980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f24ce59c700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f24b00662f0 0x7f24b00687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24d006c030 tx=0x7f24c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f80b917b700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f80980662f0 0x7f80980687a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80b40c88c0 tx=0x7f80b0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 Processor -- start 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 -- start start 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc070c50 0x7f2afc14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 0x7f2afc0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc15e3e0 con 0x7f2afc160be0 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0af4d0 con 0x7f2afc070c50 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b01258700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0af7b0 con 0x7f2afc069f80 2023-05-21T16:54:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b00a57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 0x7f2afc0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b00a57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 0x7f2afc0c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59030/0 (socket says 172.21.15.46:59030) 2023-05-21T16:54:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2b00a57700 1 -- 172.21.15.46:0/2687461410 learned_addr learned my addr 172.21.15.46:0/2687461410 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2afbfff700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.685+0000 7f2afb7fe700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc070c50 0x7f2afc14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 -- 172.21.15.46:0/3959553651 wait complete. 2023-05-21T16:54:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b00a57700 1 -- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 msgr2=0x7f2afc1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b00a57700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b00a57700 1 -- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc070c50 msgr2=0x7f2afc14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b00a57700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc070c50 0x7f2afc14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b00a57700 1 -- 172.21.15.46:0/2687461410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0094b0 con 0x7f2afc160be0 2023-05-21T16:54:23.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2afb7fe700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc070c50 0x7f2afc14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:23.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b00a57700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 0x7f2afc0c48f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2af4002000 tx=0x7f2af400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff4b8054a30 con 0x7ff4c406ee30 2023-05-21T16:54:23.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400ad40 con 0x7f2afc160be0 2023-05-21T16:54:23.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c012070 con 0x7f1b980c78a0 2023-05-21T16:54:23.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00dbc0 con 0x7f1b980c78a0 2023-05-21T16:54:23.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c004020 con 0x7f1b980c78a0 2023-05-21T16:54:23.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 Processor -- start 2023-05-21T16:54:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 -- start start 2023-05-21T16:54:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5108013cb0 con 0x7f510c0adf30 2023-05-21T16:54:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b980cedc0 con 0x7f1b980c78a0 2023-05-21T16:54:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9806e710 con 0x7f1b980c78a0 2023-05-21T16:54:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fea1c0b36f0 con 0x7fea280ce390 2023-05-21T16:54:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40070d0 con 0x7f2afc160be0 2023-05-21T16:54:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400aea0 con 0x7f2afc160be0 2023-05-21T16:54:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc070730 con 0x7f2afc160be0 2023-05-21T16:54:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc0ccf30 con 0x7f2afc160be0 2023-05-21T16:54:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f5102ffd700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50f006eb80 0x7f50f0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608069f80 0x7fe6080c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe60806a420 0x7fe60815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 0x7fe6080c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5108084140 con 0x7f510c0adf30 2023-05-21T16:54:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60815e870 con 0x7fe60806a420 2023-05-21T16:54:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080c0240 con 0x7fe608069f80 2023-05-21T16:54:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60ef68700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081f6ad0 con 0x7fe608160be0 2023-05-21T16:54:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f511197e700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50f006eb80 0x7f50f0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 0x7fe6080c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60df66700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608069f80 0x7fe6080c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 0x7fe6080c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:56528/0 (socket says 172.21.15.46:56528) 2023-05-21T16:54:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 -- 172.21.15.46:0/1886124835 learned_addr learned my addr 172.21.15.46:0/1886124835 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7f511197e700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50f006eb80 0x7f50f0071030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f510c088eb0 tx=0x7f50fc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 -- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608069f80 msgr2=0x7fe6080c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608069f80 0x7fe6080c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 -- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe60806a420 msgr2=0x7fe60815e330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-21T16:54:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe60806a420 0x7fe60815e330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.689+0000 7fe60e767700 1 -- 172.21.15.46:0/1886124835 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009a70 con 0x7fe608160be0 2023-05-21T16:54:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7fe60e767700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 0x7fe6080c37d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe60806e960 tx=0x7fe600004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b8c01f070 con 0x7f1b980c78a0 2023-05-21T16:54:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc165700 con 0x7f2afc160be0 2023-05-21T16:54:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f1b7ffff700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1b84066320 0x7f1b840687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f1b977fe700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1b84066320 0x7f1b840687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b8c085380 con 0x7f1b980c78a0 2023-05-21T16:54:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f1b977fe700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1b84066320 0x7f1b840687d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b88007b50 tx=0x7f1b88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f24c8052f30 con 0x7f24d01f58c0 2023-05-21T16:54:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.693+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5108051730 con 0x7f510c0adf30 2023-05-21T16:54:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b98067ac0 con 0x7f1b980c78a0 2023-05-21T16:54:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2af4007480 con 0x7f2afc160be0 2023-05-21T16:54:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f2af8ff9700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2ae80662f0 0x7f2ae80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f80ac05d920 con 0x7f80b4069f80 2023-05-21T16:54:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2af4083b40 con 0x7f2afc160be0 2023-05-21T16:54:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f2afbfff700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2ae80662f0 0x7f2ae80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.697+0000 7f2afbfff700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2ae80662f0 0x7f2ae80687a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009850 tx=0x7f2aec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600012e50 con 0x7fe608160be0 2023-05-21T16:54:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe600020070 con 0x7fe608160be0 2023-05-21T16:54:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000276e0 con 0x7fe608160be0 2023-05-21T16:54:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe60ef68700 1 -- 172.21.15.46:0/1886124835 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe608070730 con 0x7fe608160be0 2023-05-21T16:54:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe60ef68700 1 -- 172.21.15.46:0/1886124835 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6080ccf30 con 0x7fe608160be0 2023-05-21T16:54:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2af40510a0 con 0x7f2afc160be0 2023-05-21T16:54:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe60ef68700 1 -- 172.21.15.46:0/1886124835 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6080ae1a0 con 0x7fe608160be0 2023-05-21T16:54:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe60001c400 con 0x7fe608160be0 2023-05-21T16:54:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe5fe7fc700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5ec066370 0x7fe5ec068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe600022070 con 0x7fe608160be0 2023-05-21T16:54:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.701+0000 7fe60df66700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5ec066370 0x7fe5ec068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.705+0000 7fe60df66700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5ec066370 0x7fe5ec068820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe604007fd0 tx=0x7fe604009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.709+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe6000537d0 con 0x7fe608160be0 2023-05-21T16:54:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:23.713+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1b8c0529b0 con 0x7f1b980c78a0 2023-05-21T16:54:24.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.005+0000 7fea2d5b2700 1 -- 172.21.15.46:0/3601921313 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fea280c2840 con 0x7fea280ce390 2023-05-21T16:54:24.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.005+0000 7fea24ff9700 1 -- 172.21.15.46:0/3601921313 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea1c017090 con 0x7fea280ce390 2023-05-21T16:54:24.013 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-05-21T16:54:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.009+0000 7ff4c8831700 1 -- 172.21.15.46:0/2858252610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4c4200240 con 0x7ff4c406ee30 2023-05-21T16:54:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.009+0000 7ff4abfff700 1 -- 172.21.15.46:0/2858252610 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4b8021090 con 0x7ff4c406ee30 2023-05-21T16:54:24.014 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 -- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fea14066340 msgr2=0x7fea140687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fea14066340 0x7fea140687f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea200012e0 tx=0x7fea20001a10 comp rx=0 tx=0).stop 2023-05-21T16:54:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 -- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea280ce390 msgr2=0x7fea2806cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea280ce390 0x7fea2806cbc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea280ce7b0 tx=0x7fea1c00c750 comp rx=0 tx=0).stop 2023-05-21T16:54:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 -- 172.21.15.46:0/3601921313 shutdown_connections 2023-05-21T16:54:24.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fea14066340 0x7fea140687f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea280ce390 0x7fea2806cbc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea280cc6f0 0x7fea280b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 --2- 172.21.15.46:0/3601921313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea280ade60 0x7fea280b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 -- 172.21.15.46:0/3601921313 >> 172.21.15.46:0/3601921313 conn(0x7fea280cc1a0 msgr2=0x7fea280714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 -- 172.21.15.46:0/3601921313 shutdown_connections 2023-05-21T16:54:24.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7fea0e7fc700 1 -- 172.21.15.46:0/3601921313 wait complete. 2023-05-21T16:54:24.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f510c06d740 con 0x7f510c0adf30 2023-05-21T16:54:24.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.013+0000 7f5102ffd700 1 -- 172.21.15.46:0/1030082296 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5108054d50 con 0x7f510c0adf30 2023-05-21T16:54:24.019 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:24.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50f006eb80 msgr2=0x7f50f0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50f006eb80 0x7f50f0071030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f510c088eb0 tx=0x7f50fc009240 comp rx=0 tx=0).stop 2023-05-21T16:54:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 msgr2=0x7f510c1650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 0x7f510c1650f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f510800e8b0 tx=0x7f510800ebc0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f24b40055c0 con 0x7f24d01f58c0 2023-05-21T16:54:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 shutdown_connections 2023-05-21T16:54:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50f006eb80 0x7f50f0071030 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f510c16d800 0x7f510c082340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c0c9d00 0x7f510c163210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 --2- 172.21.15.46:0/1030082296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f510c0adf30 0x7f510c1650f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 >> 172.21.15.46:0/1030082296 conn(0x7f510c0cf610 msgr2=0x7f510c0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 shutdown_connections 2023-05-21T16:54:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f5113181700 1 -- 172.21.15.46:0/1030082296 wait complete. 2023-05-21T16:54:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.017+0000 7f24beffd700 1 -- 172.21.15.46:0/942879812 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24c8018070 con 0x7f24d01f58c0 2023-05-21T16:54:24.024 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f24b00662f0 msgr2=0x7f24b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f24b00662f0 0x7f24b00687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24d006c030 tx=0x7f24c4008040 comp rx=0 tx=0).stop 2023-05-21T16:54:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24d01f58c0 msgr2=0x7f24d00b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24d01f58c0 0x7f24d00b3800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f24c800a780 tx=0x7f24c8001cb0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 shutdown_connections 2023-05-21T16:54:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f24b00662f0 0x7f24b00687a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24d01f58c0 0x7f24d00b3800 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24d00c6800 0x7f24d0163ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 --2- 172.21.15.46:0/942879812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24b8005220 0x7f24d0162f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 >> 172.21.15.46:0/942879812 conn(0x7f24d00cc1a0 msgr2=0x7f24d0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 shutdown_connections 2023-05-21T16:54:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.021+0000 7f24cf59e700 1 -- 172.21.15.46:0/942879812 wait complete. 2023-05-21T16:54:24.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b98073cb0 con 0x7f1b980c78a0 2023-05-21T16:54:24.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 -- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4b00662f0 msgr2=0x7ff4b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4b00662f0 0x7ff4b00687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00b370 tx=0x7ff4bc009000 comp rx=0 tx=0).stop 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 -- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 msgr2=0x7ff4c40ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 0x7ff4c40ad3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800e7b0 tx=0x7ff4b800eac0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 -- 172.21.15.46:0/2858252610 shutdown_connections 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4b00662f0 0x7ff4b00687a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4c406ee30 0x7ff4c40ad3e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c406ea60 0x7ff4c40acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 --2- 172.21.15.46:0/2858252610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4c406d080 0x7ff4c40c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 -- 172.21.15.46:0/2858252610 >> 172.21.15.46:0/2858252610 conn(0x7ff4c40cc1a0 msgr2=0x7ff4c40ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7f1b7ffff700 1 -- 172.21.15.46:0/1769872587 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b8c025020 con 0x7f1b980c78a0 2023-05-21T16:54:24.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-05-21T16:54:24.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 -- 172.21.15.46:0/2858252610 shutdown_connections 2023-05-21T16:54:24.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.025+0000 7ff4a9ffb700 1 -- 172.21.15.46:0/2858252610 wait complete. 2023-05-21T16:54:24.034 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2023-05-21T16:54:24.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2afc0733b0 con 0x7f2afc160be0 2023-05-21T16:54:24.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f2af8ff9700 1 -- 172.21.15.46:0/2687461410 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2af4018090 con 0x7f2afc160be0 2023-05-21T16:54:24.035 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-05-21T16:54:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1b84066320 msgr2=0x7f1b840687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1b84066320 0x7f1b840687d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b88007b50 tx=0x7f1b88009040 comp rx=0 tx=0).stop 2023-05-21T16:54:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 msgr2=0x7f1b9815a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 0x7f1b9815a510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c018c60 tx=0x7f1b8c006f90 comp rx=0 tx=0).stop 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 shutdown_connections 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1b84066320 0x7f1b840687d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b981580f0 0x7f1b980ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b980c78a0 0x7f1b9815a510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 --2- 172.21.15.46:0/1769872587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80004870 0x7f1b980c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 >> 172.21.15.46:0/1769872587 conn(0x7f1b980cca00 msgr2=0x7f1b98069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 shutdown_connections 2023-05-21T16:54:24.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f1b9cea7700 1 -- 172.21.15.46:0/1769872587 wait complete. 2023-05-21T16:54:24.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.029+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f809c005890 con 0x7f80b4069f80 2023-05-21T16:54:24.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80aa7fc700 1 -- 172.21.15.46:0/1221094767 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80ac023090 con 0x7f80b4069f80 2023-05-21T16:54:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2ae80662f0 msgr2=0x7f2ae80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2ae80662f0 0x7f2ae80687a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009850 tx=0x7f2aec008030 comp rx=0 tx=0).stop 2023-05-21T16:54:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 msgr2=0x7f2afc0c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 0x7f2afc0c48f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2af4002000 tx=0x7f2af400a340 comp rx=0 tx=0).stop 2023-05-21T16:54:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 shutdown_connections 2023-05-21T16:54:24.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2ae80662f0 0x7f2ae80687a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc160be0 0x7f2afc0c48f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2afc070c50 0x7f2afc14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 --2- 172.21.15.46:0/2687461410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2afc069f80 0x7f2afc1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 >> 172.21.15.46:0/2687461410 conn(0x7f2afc0cf720 msgr2=0x7f2afc0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 shutdown_connections 2023-05-21T16:54:24.039 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-05-21T16:54:24.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f2b01258700 1 -- 172.21.15.46:0/2687461410 wait complete. 2023-05-21T16:54:24.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f80980662f0 msgr2=0x7f80980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f80980662f0 0x7f80980687a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80b40c88c0 tx=0x7f80b0010000 comp rx=0 tx=0).stop 2023-05-21T16:54:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 msgr2=0x7f80b40c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 0x7f80b40c6690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00ca50 tx=0x7f80ac00cd60 comp rx=0 tx=0).stop 2023-05-21T16:54:24.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-05-21T16:54:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 shutdown_connections 2023-05-21T16:54:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f80980662f0 0x7f80980687a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c5230 0x7f80b40adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b40706c0 0x7f80b40b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 --2- 172.21.15.46:0/1221094767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b4069f80 0x7f80b40c6690 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.033+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 >> 172.21.15.46:0/1221094767 conn(0x7f80b40cec40 msgr2=0x7f80b40c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.037+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 shutdown_connections 2023-05-21T16:54:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.037+0000 7f80bbbe0700 1 -- 172.21.15.46:0/1221094767 wait complete. 2023-05-21T16:54:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.037+0000 7fe60ef68700 1 -- 172.21.15.46:0/1886124835 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe608073410 con 0x7fe608160be0 2023-05-21T16:54:24.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.037+0000 7fe5fe7fc700 1 -- 172.21.15.46:0/1886124835 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe600056df0 con 0x7fe608160be0 2023-05-21T16:54:24.044 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-05-21T16:54:24.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-05-21T16:54:24.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 -- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5ec066370 msgr2=0x7fe5ec068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5ec066370 0x7fe5ec068820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe604007fd0 tx=0x7fe604009040 comp rx=0 tx=0).stop 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 -- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 msgr2=0x7fe6080c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 0x7fe6080c37d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe60806e960 tx=0x7fe600004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 -- 172.21.15.46:0/1886124835 shutdown_connections 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5ec066370 0x7fe5ec068820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe608160be0 0x7fe6080c37d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe60806a420 0x7fe60815e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 --2- 172.21.15.46:0/1886124835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608069f80 0x7fe6080c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 -- 172.21.15.46:0/1886124835 >> 172.21.15.46:0/1886124835 conn(0x7fe6080cf720 msgr2=0x7fe60806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 -- 172.21.15.46:0/1886124835 shutdown_connections 2023-05-21T16:54:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:24.041+0000 7fe5ebfff700 1 -- 172.21.15.46:0/1886124835 wait complete. 2023-05-21T16:54:24.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-05-21T16:54:24.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-05-21T16:54:24.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-05-21T16:54:24.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-05-21T16:54:24.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-05-21T16:54:25.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-21T16:54:25.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-21T16:54:25.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-21T16:54:25.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-21T16:54:25.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-21T16:54:25.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-21T16:54:25.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-21T16:54:25.057 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-21T16:54:25.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.181+0000 7f8d2c010700 1 Processor -- start 2023-05-21T16:54:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.181+0000 7f8d2c010700 1 -- start start 2023-05-21T16:54:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2c010700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d240ce260 0x7f8d24160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2c010700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d24164fc0 0x7f8d24160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2c010700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2406b900 con 0x7f8d24164bf0 2023-05-21T16:54:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2c010700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2406c990 con 0x7f8d24164fc0 2023-05-21T16:54:25.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2c010700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d241612b0 con 0x7f8d240ce260 2023-05-21T16:54:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d24164fc0 0x7f8d24160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d24164fc0 0x7f8d24160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34648/0 (socket says 172.21.15.46:34648) 2023-05-21T16:54:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/551652468 learned_addr learned my addr 172.21.15.46:0/551652468 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d295ab700 1 --2- 172.21.15.46:0/551652468 >> v2:172.21.15.142:3300/0 conn(0x7f8d240ce260 0x7f8d24160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/551652468 >> v2:172.21.15.142:3300/0 conn(0x7f8d240ce260 msgr2=0x7f8d24160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 --2- 172.21.15.46:0/551652468 >> v2:172.21.15.142:3300/0 conn(0x7f8d240ce260 0x7f8d24160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/551652468 >> v1:172.21.15.142:6789/0 conn(0x7f8d24164bf0 legacy=0x7f8d240c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/551652468 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2406b620 con 0x7f8d24164fc0 2023-05-21T16:54:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d2a5ad700 1 --2- 172.21.15.46:0/551652468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d24164fc0 0x7f8d24160d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d2406c270 tx=0x7f8d20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8657164d65982e99 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d28daa700 1 -- 172.21.15.46:0/551652468 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20004230 con 0x7f8d24164fc0 2023-05-21T16:54:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.185+0000 7f8d28daa700 1 -- 172.21.15.46:0/551652468 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20004390 con 0x7f8d24164fc0 2023-05-21T16:54:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 -- 172.21.15.46:0/551652468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d24164fc0 msgr2=0x7f8d24160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 --2- 172.21.15.46:0/551652468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d24164fc0 0x7f8d24160d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d2406c270 tx=0x7f8d20009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 -- 172.21.15.46:0/551652468 shutdown_connections 2023-05-21T16:54:25.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 --2- 172.21.15.46:0/551652468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d24164fc0 0x7f8d24160d70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 --2- 172.21.15.46:0/551652468 >> v2:172.21.15.142:3300/0 conn(0x7f8d240ce260 0x7f8d24160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 -- 172.21.15.46:0/551652468 >> 172.21.15.46:0/551652468 conn(0x7f8d240cc1a0 msgr2=0x7f8d240b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 -- 172.21.15.46:0/551652468 shutdown_connections 2023-05-21T16:54:25.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 -- 172.21.15.46:0/551652468 wait complete. 2023-05-21T16:54:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 Processor -- start 2023-05-21T16:54:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 -- start start 2023-05-21T16:54:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d240ce260 0x7f8d24148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.189+0000 7f8d2c010700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24164bf0 0x7f8d2414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2c010700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2414f0d0 0x7f8d24162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2c010700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24148ab0 con 0x7f8d2414f0d0 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2c010700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2414f550 con 0x7f8d24164bf0 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2c010700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24147b10 con 0x7f8d240ce260 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d29dac700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d240ce260 0x7f8d24148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d295ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24164bf0 0x7f8d2414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d29dac700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d240ce260 0x7f8d24148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37492/0 (socket says 172.21.15.46:37492) 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2414f0d0 0x7f8d24162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d29dac700 1 -- 172.21.15.46:0/2147389312 learned_addr learned my addr 172.21.15.46:0/2147389312 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/2147389312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d240ce260 msgr2=0x7f8d24148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d240ce260 0x7f8d24148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/2147389312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24164bf0 msgr2=0x7f8d2414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24164bf0 0x7f8d2414eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 -- 172.21.15.46:0/2147389312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009570 con 0x7f8d2414f0d0 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2a5ad700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2414f0d0 0x7f8d24162bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d20015000 tx=0x7f8d20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011630 con 0x7f8d2414f0d0 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d200117b0 con 0x7f8d2414f0d0 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011b60 con 0x7f8d2414f0d0 2023-05-21T16:54:25.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d240cca50 con 0x7f8d2414f0d0 2023-05-21T16:54:25.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.193+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d240cc770 con 0x7f8d2414f0d0 2023-05-21T16:54:25.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.197+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d20021070 con 0x7f8d2414f0d0 2023-05-21T16:54:25.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.197+0000 7f8d1a7fc700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d080662f0 0x7f8d080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.197+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d200854d0 con 0x7f8d2414f0d0 2023-05-21T16:54:25.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.197+0000 7f8d29dac700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d080662f0 0x7f8d080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.197+0000 7f8d0ffff700 1 -- 172.21.15.46:0/2147389312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d240ccd30 con 0x7f8d2414f0d0 2023-05-21T16:54:25.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.197+0000 7f8d29dac700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d080662f0 0x7f8d080687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d14001970 tx=0x7f8d14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.205+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8d200529e0 con 0x7f8d2414f0d0 2023-05-21T16:54:25.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 Processor -- start 2023-05-21T16:54:25.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 -- start start 2023-05-21T16:54:25.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7f550e947700 1 Processor -- start 2023-05-21T16:54:25.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7f550e947700 1 -- start start 2023-05-21T16:54:25.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7feedc9d4700 1 Processor -- start 2023-05-21T16:54:25.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7feedc9d4700 1 -- start start 2023-05-21T16:54:25.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3180cd4e0 0x7fe3180cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe31806d870 0x7fe31806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31806e210 con 0x7fe318158b60 2023-05-21T16:54:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3180ce560 con 0x7fe31806d870 2023-05-21T16:54:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31dd9c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe318158f30 con 0x7fe3180cd4e0 2023-05-21T16:54:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.225+0000 7fe31cd9a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe318158b60 0x7fe318069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33054/0 (socket says 172.21.15.46:33054) 2023-05-21T16:54:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31cd9a700 1 -- 172.21.15.46:0/2278789456 learned_addr learned my addr 172.21.15.46:0/2278789456 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:25.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe317fff700 1 --2- 172.21.15.46:0/2278789456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3180cd4e0 0x7fe3180cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f550806ee30 0x7f550806c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55080cc5d0 0x7f550806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55080ca330 con 0x7f550806ea60 2023-05-21T16:54:25.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080ccb40 con 0x7f55080cc5d0 2023-05-21T16:54:25.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080cce20 con 0x7f550806ee30 2023-05-21T16:54:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31d59b700 1 --2- 172.21.15.46:0/2278789456 >> v2:172.21.15.46:3300/0 conn(0x7fe31806d870 0x7fe31806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55080cc5d0 0x7f550806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55080cc5d0 0x7f550806ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34678/0 (socket says 172.21.15.46:34678) 2023-05-21T16:54:25.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 -- 172.21.15.46:0/2280863739 learned_addr learned my addr 172.21.15.46:0/2280863739 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31d59b700 1 -- 172.21.15.46:0/2278789456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3180cd4e0 msgr2=0x7fe3180cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31d59b700 1 --2- 172.21.15.46:0/2278789456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3180cd4e0 0x7fe3180cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31d59b700 1 -- 172.21.15.46:0/2278789456 >> v1:172.21.15.46:6789/0 conn(0x7fe318158b60 legacy=0x7fe318069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31d59b700 1 -- 172.21.15.46:0/2278789456 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31806d3e0 con 0x7fe31806d870 2023-05-21T16:54:25.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feedc9d4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feed80709d0 0x7feed80d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feedc9d4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feedc9d4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed80b3ac0 con 0x7feed815c9b0 2023-05-21T16:54:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feedc9d4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed80cf620 con 0x7feed80709d0 2023-05-21T16:54:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feedc9d4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed80cc4f0 con 0x7feed80ccaa0 2023-05-21T16:54:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 -- 172.21.15.46:0/2280863739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f550806ee30 msgr2=0x7f550806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 --2- 172.21.15.46:0/2280863739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f550806ee30 0x7f550806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 -- 172.21.15.46:0/2280863739 >> v1:172.21.15.46:6789/0 conn(0x7f550806ea60 legacy=0x7f55080c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 -- 172.21.15.46:0/2280863739 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080cd100 con 0x7f55080cc5d0 2023-05-21T16:54:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feed815c9b0 0x7feed80702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33080/0 (socket says 172.21.15.46:33080) 2023-05-21T16:54:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed77fe700 1 -- 172.21.15.46:0/3220832299 learned_addr learned my addr 172.21.15.46:0/3220832299 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:25.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed7fff700 1 --2- 172.21.15.46:0/3220832299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31d59b700 1 --2- 172.21.15.46:0/2278789456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe31806d870 0x7fe31806dcd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe310009b40 tx=0x7fe31000d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c437ca2d4498d1c4 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e146700 1 --2- 172.21.15.46:0/2280863739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55080cc5d0 0x7f550806ceb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5500009e50 tx=0x7f550000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4cf2621a48f234 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe3177fe700 1 -- 172.21.15.46:0/2278789456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31000dd90 con 0x7fe31806d870 2023-05-21T16:54:25.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe3177fe700 1 -- 172.21.15.46:0/2278789456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310010470 con 0x7fe31806d870 2023-05-21T16:54:25.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe3177fe700 1 -- 172.21.15.46:0/2278789456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100107e0 con 0x7fe31806d870 2023-05-21T16:54:25.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed67fc700 1 -- 172.21.15.46:0/3220832299 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799512506 0 0) 0x7feed80b3ac0 con 0x7feed815c9b0 2023-05-21T16:54:25.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed7fff700 1 -- 172.21.15.46:0/3220832299 >> v2:172.21.15.142:3300/0 conn(0x7feed80709d0 msgr2=0x7feed80d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed6ffd700 1 --2- 172.21.15.46:0/3220832299 >> v2:172.21.15.142:3300/0 conn(0x7feed80709d0 0x7feed80d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550c943700 1 -- 172.21.15.46:0/2280863739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000e070 con 0x7f55080cc5d0 2023-05-21T16:54:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed7fff700 1 --2- 172.21.15.46:0/3220832299 >> v2:172.21.15.142:3300/0 conn(0x7feed80709d0 0x7feed80d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed7fff700 1 -- 172.21.15.46:0/3220832299 >> v1:172.21.15.46:6789/0 conn(0x7feed815c9b0 legacy=0x7feed80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed7fff700 1 -- 172.21.15.46:0/3220832299 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80cf890 con 0x7feed80ccaa0 2023-05-21T16:54:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550c943700 1 -- 172.21.15.46:0/2280863739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000b9c0 con 0x7f55080cc5d0 2023-05-21T16:54:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550c943700 1 -- 172.21.15.46:0/2280863739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000bd70 con 0x7f55080cc5d0 2023-05-21T16:54:25.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed7fff700 1 --2- 172.21.15.46:0/3220832299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80b3f50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feec8009850 tx=0x7feec8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db139c805cc46fda server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed67fc700 1 -- 172.21.15.46:0/3220832299 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011830 con 0x7feed80ccaa0 2023-05-21T16:54:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31dd9c700 1 -- 172.21.15.46:0/2278789456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe31806d870 msgr2=0x7fe31806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/2278789456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe31806d870 0x7fe31806dcd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe310009b40 tx=0x7fe31000d2f0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed67fc700 1 -- 172.21.15.46:0/3220832299 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8011990 con 0x7feed80ccaa0 2023-05-21T16:54:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7feed67fc700 1 -- 172.21.15.46:0/3220832299 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011d20 con 0x7feed80ccaa0 2023-05-21T16:54:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- 172.21.15.46:0/2280863739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55080cc5d0 msgr2=0x7f550806ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 --2- 172.21.15.46:0/2280863739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55080cc5d0 0x7f550806ceb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5500009e50 tx=0x7f550000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:25.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31dd9c700 1 -- 172.21.15.46:0/2278789456 shutdown_connections 2023-05-21T16:54:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/2278789456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe31806d870 0x7fe31806dcd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/2278789456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3180cd4e0 0x7fe3180cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7fe31dd9c700 1 -- 172.21.15.46:0/2278789456 >> 172.21.15.46:0/2278789456 conn(0x7fe3180cc1a0 msgr2=0x7fe3180b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- 172.21.15.46:0/2280863739 shutdown_connections 2023-05-21T16:54:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 --2- 172.21.15.46:0/2280863739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55080cc5d0 0x7f550806ceb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 --2- 172.21.15.46:0/2280863739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f550806ee30 0x7f550806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- 172.21.15.46:0/2280863739 >> 172.21.15.46:0/2280863739 conn(0x7f55080cc1a0 msgr2=0x7f55080b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.229+0000 7f550e947700 1 -- 172.21.15.46:0/2280863739 shutdown_connections 2023-05-21T16:54:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 -- 172.21.15.46:0/2280863739 wait complete. 2023-05-21T16:54:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 -- 172.21.15.46:0/3220832299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 msgr2=0x7feed80b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3220832299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80b3f50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feec8009850 tx=0x7feec8009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 -- 172.21.15.46:0/2278789456 shutdown_connections 2023-05-21T16:54:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 -- 172.21.15.46:0/3220832299 shutdown_connections 2023-05-21T16:54:25.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3220832299 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80b3f50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3220832299 >> v2:172.21.15.142:3300/0 conn(0x7feed80709d0 0x7feed80d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 -- 172.21.15.46:0/3220832299 >> 172.21.15.46:0/3220832299 conn(0x7feed80cd6f0 msgr2=0x7feed80cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 -- 172.21.15.46:0/2278789456 wait complete. 2023-05-21T16:54:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 Processor -- start 2023-05-21T16:54:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 -- start start 2023-05-21T16:54:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 Processor -- start 2023-05-21T16:54:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 -- start start 2023-05-21T16:54:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 -- 172.21.15.46:0/3220832299 shutdown_connections 2023-05-21T16:54:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 Processor -- start 2023-05-21T16:54:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 -- start start 2023-05-21T16:54:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 Processor -- start 2023-05-21T16:54:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7268158d90 0x7f726815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a4156eb0 0x7fa0a415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0a40b1cd0 0x7fa0a40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40cd840 con 0x7fa0a415a2e0 2023-05-21T16:54:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a4157280 con 0x7fa0a40b1cd0 2023-05-21T16:54:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa8be700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415d430 con 0x7fa0a4156eb0 2023-05-21T16:54:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 -- 172.21.15.46:0/3220832299 wait complete. 2023-05-21T16:54:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 -- start start 2023-05-21T16:54:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7268070ca0 0x7f72680ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7268159df0 con 0x7f72680ccec0 2023-05-21T16:54:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726815a280 con 0x7f7268070ca0 2023-05-21T16:54:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72680cd730 con 0x7f7268158d90 2023-05-21T16:54:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f550806ea60 0x7f550815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7268158d90 0x7f726815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550806ee30 0x7f550815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 0x7f55080b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550814ea70 con 0x7f550806ee30 2023-05-21T16:54:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550815f9e0 con 0x7f550806ea60 2023-05-21T16:54:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e947700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55081f5d60 con 0x7f55080cc5d0 2023-05-21T16:54:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7268158d90 0x7f726815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:60772/0 (socket says 172.21.15.46:60772) 2023-05-21T16:54:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 -- 172.21.15.46:0/490662029 learned_addr learned my addr 172.21.15.46:0/490662029 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f351ddce700 1 Processor -- start 2023-05-21T16:54:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f351ddce700 1 -- start start 2023-05-21T16:54:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa0bd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0a40b1cd0 0x7fa0a40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0a90bb700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa0a415a2e0 0x7fa0a40b15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:58024/0 (socket says 172.21.15.46:58024) 2023-05-21T16:54:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f7266d9d700 1 --2- 172.21.15.46:0/490662029 >> v2:172.21.15.46:3300/0 conn(0x7f7268070ca0 0x7f72680ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 Processor -- start 2023-05-21T16:54:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0a90bb700 1 -- 172.21.15.46:0/4162899096 learned_addr learned my addr 172.21.15.46:0/4162899096 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7feedc9d4700 1 -- start start 2023-05-21T16:54:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 -- 172.21.15.46:0/490662029 >> v2:172.21.15.46:3300/0 conn(0x7f7268070ca0 msgr2=0x7f72680ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 --2- 172.21.15.46:0/490662029 >> v2:172.21.15.46:3300/0 conn(0x7f7268070ca0 0x7f72680ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 -- 172.21.15.46:0/490662029 >> v1:172.21.15.142:6789/0 conn(0x7f72680ccec0 legacy=0x7f7268070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f726659c700 1 -- 172.21.15.46:0/490662029 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72681594c0 con 0x7f7268158d90 2023-05-21T16:54:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0a88ba700 1 -- 172.21.15.46:0/4162899096 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022294342 0 0) 0x7fa0a40cd840 con 0x7fa0a415a2e0 2023-05-21T16:54:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0a88ba700 1 -- 172.21.15.46:0/4162899096 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0900035d0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a4156eb0 msgr2=0x7fa0a415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa0bd700 1 --2- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a4156eb0 0x7fa0a415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/4162899096 >> v1:172.21.15.142:6789/0 conn(0x7fa0a415a2e0 legacy=0x7fa0a40b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/4162899096 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a415d710 con 0x7fa0a40b1cd0 2023-05-21T16:54:25.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 0x7fe3180ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3180cd4e0 0x7fe318155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe318158b60 0x7fe3180b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180c2860 con 0x7fe3180cd4e0 2023-05-21T16:54:25.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180c7620 con 0x7fe318158b60 2023-05-21T16:54:25.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31dd9c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3181ee000 con 0x7fe31806d870 2023-05-21T16:54:25.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fa0aa0bd700 1 --2- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40b1cd0 0x7fa0a40cdcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009d90 tx=0x7fa09c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc8c9cffb507863 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31cd9a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 0x7fe3180ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7fe31d59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe318158b60 0x7fe3180b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 0x7fe3180ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37562/0 (socket says 172.21.15.46:37562) 2023-05-21T16:54:25.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 -- 172.21.15.46:0/1774438346 learned_addr learned my addr 172.21.15.46:0/1774438346 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f726659c700 1 --2- 172.21.15.46:0/490662029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7268158d90 0x7f726815d460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f726806f520 tx=0x7f725c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c982930710fe7436 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351ddce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 0x7f351815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 0x7f55080b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 0x7f55080b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37554/0 (socket says 172.21.15.46:37554) 2023-05-21T16:54:25.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 -- 172.21.15.46:0/3986655747 learned_addr learned my addr 172.21.15.46:0/3986655747 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351ddce700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518161380 con 0x7f3518153b10 2023-05-21T16:54:25.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550d945700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f550806ea60 0x7f550815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 -- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f550806ea60 msgr2=0x7f550815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f550806ea60 0x7f550815f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 -- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550806ee30 msgr2=0x7f550815aef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-21T16:54:25.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550806ee30 0x7f550815aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.233+0000 7f550e146700 1 -- 172.21.15.46:0/3986655747 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500009b30 con 0x7f55080cc5d0 2023-05-21T16:54:25.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f550e146700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 0x7f55080b05c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f550806c4d0 tx=0x7f5500004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 0x7feed80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed815c9b0 0x7feed81f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed81fef90 con 0x7feed815c9b0 2023-05-21T16:54:25.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80cc2e0 con 0x7feed80709d0 2023-05-21T16:54:25.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed806c110 con 0x7feed80ccaa0 2023-05-21T16:54:25.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500004040 con 0x7f55080cc5d0 2023-05-21T16:54:25.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351ddce700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351815d440 con 0x7f3518160400 2023-05-21T16:54:25.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351ddce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180cd2b0 con 0x7f35180ccce0 2023-05-21T16:54:25.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55080cd6c0 con 0x7f55080cc5d0 2023-05-21T16:54:25.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55000041a0 con 0x7f55080cc5d0 2023-05-21T16:54:25.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500004510 con 0x7f55080cc5d0 2023-05-21T16:54:25.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55080cd3e0 con 0x7f55080cc5d0 2023-05-21T16:54:25.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 0x7feed80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 0x7feed80c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:60810/0 (socket says 172.21.15.46:60810) 2023-05-21T16:54:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 -- 172.21.15.46:0/3100086115 learned_addr learned my addr 172.21.15.46:0/3100086115 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe317fff700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3180cd4e0 0x7fe318155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 0x7f351815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 0x7f351815ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37574/0 (socket says 172.21.15.46:37574) 2023-05-21T16:54:25.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 -- 172.21.15.46:0/1020610419 learned_addr learned my addr 172.21.15.46:0/1020610419 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0a88ba700 1 -- 172.21.15.46:0/4162899096 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00e070 con 0x7fa0a40b1cd0 2023-05-21T16:54:25.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 -- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe318158b60 msgr2=0x7fe3180b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe318158b60 0x7fe3180b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 -- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3180cd4e0 msgr2=0x7fe318155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3180cd4e0 0x7fe318155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 -- 172.21.15.46:0/1774438346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009770 con 0x7fe31806d870 2023-05-21T16:54:25.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 -- 172.21.15.46:0/1020610419 >> v1:172.21.15.142:6789/0 conn(0x7f3518160400 legacy=0x7f35180cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f726559a700 1 -- 172.21.15.46:0/490662029 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c011830 con 0x7f7268158d90 2023-05-21T16:54:25.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 -- 172.21.15.46:0/1020610419 >> v1:172.21.15.46:6789/0 conn(0x7f3518153b10 legacy=0x7f3518069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 -- 172.21.15.46:0/1020610419 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351815d720 con 0x7f35180ccce0 2023-05-21T16:54:25.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31cd9a700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 0x7fe3180ad0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe308001eb0 tx=0x7fe30800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 -- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 msgr2=0x7feed80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 -- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed815c9b0 msgr2=0x7feed81f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed815c9b0 0x7feed81f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 -- 172.21.15.46:0/3100086115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80094b0 con 0x7feed80709d0 2023-05-21T16:54:25.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351d5cd700 1 --2- 172.21.15.46:0/1020610419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 0x7f351815ce10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3510009e80 tx=0x7f351000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b50bdfde690058b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308005d90 con 0x7fe31806d870 2023-05-21T16:54:25.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3180cdfa0 con 0x7fe31806d870 2023-05-21T16:54:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f35177fe700 1 -- 172.21.15.46:0/1020610419 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000e070 con 0x7f35180ccce0 2023-05-21T16:54:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f35177fe700 1 -- 172.21.15.46:0/1020610419 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351000b9c0 con 0x7f35180ccce0 2023-05-21T16:54:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f35177fe700 1 -- 172.21.15.46:0/1020610419 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000bd70 con 0x7f35180ccce0 2023-05-21T16:54:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f726559a700 1 -- 172.21.15.46:0/490662029 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c011990 con 0x7f7268158d90 2023-05-21T16:54:25.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f726559a700 1 -- 172.21.15.46:0/490662029 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c011d20 con 0x7f7268158d90 2023-05-21T16:54:25.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f726759e700 1 -- 172.21.15.46:0/490662029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7268158d90 msgr2=0x7f726815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f726759e700 1 --2- 172.21.15.46:0/490662029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7268158d90 0x7f726815d460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f726806f520 tx=0x7f725c009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3080070d0 con 0x7fe31806d870 2023-05-21T16:54:25.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31806cdd0 con 0x7fe31806d870 2023-05-21T16:54:25.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feed77fe700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 0x7feed80c6c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feed0001f80 tx=0x7feed000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308001230 con 0x7fe31806d870 2023-05-21T16:54:25.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000ad80 con 0x7feed80709d0 2023-05-21T16:54:25.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed00070d0 con 0x7feed80709d0 2023-05-21T16:54:25.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed80cd440 con 0x7feed80709d0 2023-05-21T16:54:25.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0007480 con 0x7feed80709d0 2023-05-21T16:54:25.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed815cd80 con 0x7feed80709d0 2023-05-21T16:54:25.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5500029070 con 0x7f55080cc5d0 2023-05-21T16:54:25.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351ddce700 1 -- 172.21.15.46:0/1020610419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 msgr2=0x7f351815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f351ddce700 1 --2- 172.21.15.46:0/1020610419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 0x7f351815ce10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3510009e80 tx=0x7f351000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:25.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0a88ba700 1 -- 172.21.15.46:0/4162899096 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00bb20 con 0x7fa0a40b1cd0 2023-05-21T16:54:25.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0a88ba700 1 -- 172.21.15.46:0/4162899096 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00be90 con 0x7fa0a40b1cd0 2023-05-21T16:54:25.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0aa8be700 1 -- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40b1cd0 msgr2=0x7fa0a40cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40b1cd0 0x7fa0a40cdcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009d90 tx=0x7fa09c00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:25.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0aa8be700 1 -- 172.21.15.46:0/4162899096 shutdown_connections 2023-05-21T16:54:25.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40b1cd0 0x7fa0a40cdcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/4162899096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a4156eb0 0x7fa0a415ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fa0aa8be700 1 -- 172.21.15.46:0/4162899096 >> 172.21.15.46:0/4162899096 conn(0x7fa0a406d7a0 msgr2=0x7fa0a406db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3180ce280 con 0x7fe31806d870 2023-05-21T16:54:25.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.237+0000 7f54fe7fc700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f54ec0662f0 0x7f54ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f550008dfb0 con 0x7f55080cc5d0 2023-05-21T16:54:25.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f550d945700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f54ec0662f0 0x7f54ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 -- 172.21.15.46:0/4162899096 shutdown_connections 2023-05-21T16:54:25.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 -- 172.21.15.46:0/4162899096 wait complete. 2023-05-21T16:54:25.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- 172.21.15.46:0/490662029 shutdown_connections 2023-05-21T16:54:25.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 --2- 172.21.15.46:0/490662029 >> v2:172.21.15.46:3300/0 conn(0x7f7268070ca0 0x7f72680ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 --2- 172.21.15.46:0/490662029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7268158d90 0x7f726815d460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- 172.21.15.46:0/490662029 >> 172.21.15.46:0/490662029 conn(0x7f72680cf720 msgr2=0x7f72680cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 -- 172.21.15.46:0/1020610419 shutdown_connections 2023-05-21T16:54:25.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 --2- 172.21.15.46:0/1020610419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35180ccce0 0x7f351815ce10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 -- 172.21.15.46:0/1020610419 >> 172.21.15.46:0/1020610419 conn(0x7f35180cf720 msgr2=0x7f35180cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe308007440 con 0x7fe31806d870 2023-05-21T16:54:25.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- 172.21.15.46:0/490662029 shutdown_connections 2023-05-21T16:54:25.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- 172.21.15.46:0/490662029 wait complete. 2023-05-21T16:54:25.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f550d945700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f54ec0662f0 0x7f54ec0687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54f8000f60 tx=0x7f54f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fe3157fa700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe3040662f0 0x7fe3040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fe317fff700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe3040662f0 0x7fe3040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe308082d90 con 0x7fe31806d870 2023-05-21T16:54:25.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 -- 172.21.15.46:0/1020610419 shutdown_connections 2023-05-21T16:54:25.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fe317fff700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe3040662f0 0x7fe3040687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3180c9b60 tx=0x7fe30c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 Processor -- start 2023-05-21T16:54:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 -- start start 2023-05-21T16:54:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feed00075e0 con 0x7feed80709d0 2023-05-21T16:54:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 -- 172.21.15.46:0/1020610419 wait complete. 2023-05-21T16:54:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 Processor -- start 2023-05-21T16:54:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- start start 2023-05-21T16:54:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7feebffff700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feec40662f0 0x7feec40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feed0083ca0 con 0x7feed80709d0 2023-05-21T16:54:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40b1cd0 0x7fa0a4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a4156eb0 0x7fa0a40b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 0x7fa0a4145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40b0f80 con 0x7fa0a415a2e0 2023-05-21T16:54:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4159090 con 0x7fa0a4156eb0 2023-05-21T16:54:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa8be700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4158480 con 0x7fa0a40b1cd0 2023-05-21T16:54:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 0x7fa0a4145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 0x7fa0a4145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34698/0 (socket says 172.21.15.46:34698) 2023-05-21T16:54:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/1307403950 learned_addr learned my addr 172.21.15.46:0/1307403950 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 0x7f72680c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72680ccec0 0x7f72680c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7268158d90 0x7f7268149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726814bc40 con 0x7f7268070ca0 2023-05-21T16:54:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680cb0b0 con 0x7f72680ccec0 2023-05-21T16:54:25.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72680cb390 con 0x7f7268158d90 2023-05-21T16:54:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0a98bc700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40b1cd0 0x7fa0a4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0a90bb700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a4156eb0 0x7fa0a40b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7feed6ffd700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feec40662f0 0x7feec40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 0x7f72680c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 0x7f72680c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34706/0 (socket says 172.21.15.46:34706) 2023-05-21T16:54:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 -- 172.21.15.46:0/3722420523 learned_addr learned my addr 172.21.15.46:0/3722420523 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f7265d9b700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72680ccec0 0x7f72680c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40b1cd0 msgr2=0x7fa0a4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40b1cd0 0x7fa0a4157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a4156eb0 msgr2=0x7fa0a40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a4156eb0 0x7fa0a40b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 Processor -- start 2023-05-21T16:54:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 -- 172.21.15.46:0/1307403950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009a70 con 0x7fa0a415a2e0 2023-05-21T16:54:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f351ddce700 1 -- start start 2023-05-21T16:54:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 -- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7268158d90 msgr2=0x7f7268149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f7266d9d700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7268158d90 0x7f7268149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7268158d90 0x7f7268149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 -- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72680ccec0 msgr2=0x7f72680c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72680ccec0 0x7f72680c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 -- 172.21.15.46:0/3722420523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c009570 con 0x7f7268070ca0 2023-05-21T16:54:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f7266d9d700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7268158d90 0x7f7268149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7feed6ffd700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feec40662f0 0x7feec40687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feed80703a0 tx=0x7feecc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7fa0aa0bd700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 0x7fa0a4145d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa09c013000 tx=0x7fa09c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.241+0000 7f726659c700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 0x7f72680c2650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f725c000c00 tx=0x7f725c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c004510 con 0x7f7268070ca0 2023-05-21T16:54:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55081604b0 con 0x7f55080cc5d0 2023-05-21T16:54:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7268159a80 con 0x7f7268070ca0 2023-05-21T16:54:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c01e070 con 0x7f7268070ca0 2023-05-21T16:54:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72681597a0 con 0x7f7268070ca0 2023-05-21T16:54:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c0038e0 con 0x7f7268070ca0 2023-05-21T16:54:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c007000 con 0x7fa0a415a2e0 2023-05-21T16:54:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c012630 con 0x7fa0a415a2e0 2023-05-21T16:54:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a415dcd0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 0x7f35181526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518153b10 0x7f35180b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3518160400 0x7f35180b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518152c00 con 0x7f3518153b10 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35180aea50 con 0x7f35180ccce0 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180aed30 con 0x7f3518160400 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 0x7f35181526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 0x7f35181526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:60840/0 (socket says 172.21.15.46:60840) 2023-05-21T16:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 -- 172.21.15.46:0/4236753789 learned_addr learned my addr 172.21.15.46:0/4236753789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a415d9f0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c005310 con 0x7f7268070ca0 2023-05-21T16:54:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 Processor -- start 2023-05-21T16:54:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 -- start start 2023-05-21T16:54:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3564071bb0 0x7f35640cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35640ccec0 0x7f35640cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3564159160 con 0x7f35640b3660 2023-05-21T16:54:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356406ef10 con 0x7f3564071bb0 2023-05-21T16:54:25.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3568a75700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640cf0a0 con 0x7f35640ccec0 2023-05-21T16:54:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3517fff700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518153b10 0x7f35180b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 -- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3518160400 msgr2=0x7f35180b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3518160400 0x7f35180b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 -- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518153b10 msgr2=0x7f35180b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a415a730 con 0x7fa0a415a2e0 2023-05-21T16:54:25.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518153b10 0x7f35180b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 -- 172.21.15.46:0/4236753789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510009b30 con 0x7f35180ccce0 2023-05-21T16:54:25.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f35637fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3564071bb0 0x7f35640cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f35637fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3564071bb0 0x7f35640cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34708/0 (socket says 172.21.15.46:34708) 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f35637fe700 1 -- 172.21.15.46:0/2182489108 learned_addr learned my addr 172.21.15.46:0/2182489108 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3563fff700 1 --2- 172.21.15.46:0/2182489108 >> v2:172.21.15.142:3300/0 conn(0x7f35640ccec0 0x7f35640cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3563fff700 1 -- 172.21.15.46:0/2182489108 >> v2:172.21.15.46:3300/0 conn(0x7f3564071bb0 msgr2=0x7f35640cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3563fff700 1 --2- 172.21.15.46:0/2182489108 >> v2:172.21.15.46:3300/0 conn(0x7f3564071bb0 0x7f35640cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3563fff700 1 -- 172.21.15.46:0/2182489108 >> v1:172.21.15.142:6789/0 conn(0x7f35640b3660 legacy=0x7f35640b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3563fff700 1 -- 172.21.15.46:0/2182489108 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35640ae9b0 con 0x7f35640ccec0 2023-05-21T16:54:25.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f725c003a40 con 0x7f7268070ca0 2023-05-21T16:54:25.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7256ffd700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f72480662f0 0x7f72480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f725c020070 con 0x7f7268070ca0 2023-05-21T16:54:25.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7265d9b700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f72480662f0 0x7f72480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0129e0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa09c012b80 con 0x7fa0a415a2e0 2023-05-21T16:54:25.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f3563fff700 1 --2- 172.21.15.46:0/2182489108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640ccec0 0x7f35640cd340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35640cbc90 tx=0x7f355400df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c1a32688773f4b server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f7265d9b700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f72480662f0 0x7f72480687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f726815c7e0 tx=0x7f7260009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7fa09a7fc700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa088066440 0x7fa0880688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351cdcc700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 0x7f35181526c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c530 tx=0x7f350c00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa09c0868d0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7fa0a98bc700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa088066440 0x7fa0880688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe308050180 con 0x7fe31806d870 2023-05-21T16:54:25.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0052d0 con 0x7f35180ccce0 2023-05-21T16:54:25.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c005430 con 0x7f35180ccce0 2023-05-21T16:54:25.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3518070630 con 0x7f35180ccce0 2023-05-21T16:54:25.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0055a0 con 0x7f35180ccce0 2023-05-21T16:54:25.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.245+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351815da00 con 0x7f35180ccce0 2023-05-21T16:54:25.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc005310 con 0x7f35180ccce0 2023-05-21T16:54:25.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f350c0038e0 con 0x7f35180ccce0 2023-05-21T16:54:25.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7fa0a98bc700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa088066440 0x7fa0880688f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009ac0 tx=0x7fa0a00091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7f35157fa700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f35080663e0 0x7f3508068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7f3517fff700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f35080663e0 0x7f3508068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f350c0830a0 con 0x7f35180ccce0 2023-05-21T16:54:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7f3517fff700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f35080663e0 0x7f3508068890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35180ad480 tx=0x7f3504009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.249+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa09c053ee0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.253+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed80cc7d0 con 0x7feed80709d0 2023-05-21T16:54:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.253+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f550005b3a0 con 0x7f55080cc5d0 2023-05-21T16:54:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.253+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f725c0b56f0 con 0x7f7268070ca0 2023-05-21T16:54:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f350c050500 con 0x7f35180ccce0 2023-05-21T16:54:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f35627fc700 1 -- 172.21.15.46:0/2182489108 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554012070 con 0x7f35640ccec0 2023-05-21T16:54:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f35627fc700 1 -- 172.21.15.46:0/2182489108 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355400d2e0 con 0x7f35640ccec0 2023-05-21T16:54:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f35627fc700 1 -- 172.21.15.46:0/2182489108 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400f8a0 con 0x7f35640ccec0 2023-05-21T16:54:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f3568a75700 1 -- 172.21.15.46:0/2182489108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640ccec0 msgr2=0x7f35640cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f3568a75700 1 --2- 172.21.15.46:0/2182489108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640ccec0 0x7f35640cd340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35640cbc90 tx=0x7f355400df50 comp rx=0 tx=0).stop 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f3568a75700 1 -- 172.21.15.46:0/2182489108 shutdown_connections 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f3568a75700 1 --2- 172.21.15.46:0/2182489108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640ccec0 0x7f35640cd340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f3568a75700 1 --2- 172.21.15.46:0/2182489108 >> v2:172.21.15.46:3300/0 conn(0x7f3564071bb0 0x7f35640cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.257+0000 7f3568a75700 1 -- 172.21.15.46:0/2182489108 >> 172.21.15.46:0/2182489108 conn(0x7f35640cca00 msgr2=0x7f35640cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 -- 172.21.15.46:0/2182489108 shutdown_connections 2023-05-21T16:54:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 -- 172.21.15.46:0/2182489108 wait complete. 2023-05-21T16:54:25.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feed0051120 con 0x7feed80709d0 2023-05-21T16:54:25.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 Processor -- start 2023-05-21T16:54:25.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 -- start start 2023-05-21T16:54:25.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640b3660 0x7f3564154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 0x7f35640c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.261+0000 7f3568a75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35640adc70 0x7f35640af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3568a75700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564154960 con 0x7f35640adc70 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3568a75700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c3200 con 0x7f35640b3660 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3568a75700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c34e0 con 0x7f35640ccec0 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 0x7f35640c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3563fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35640adc70 0x7f35640af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 0x7f35640c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37620/0 (socket says 172.21.15.46:37620) 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 -- 172.21.15.46:0/2943501525 learned_addr learned my addr 172.21.15.46:0/2943501525 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3563fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35640adc70 0x7f35640af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34736/0 (socket says 172.21.15.46:34736) 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f35637fe700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640b3660 0x7f3564154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 -- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640b3660 msgr2=0x7f3564154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640b3660 0x7f3564154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 -- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35640adc70 msgr2=0x7f35640af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35640adc70 0x7f35640af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 -- 172.21.15.46:0/2943501525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355400d950 con 0x7f35640ccec0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3562ffd700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 0x7f35640c42a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f355c00cc20 tx=0x7f355c00cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c003c20 con 0x7f35640ccec0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356406e430 con 0x7f35640ccec0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35640cedc0 con 0x7f35640ccec0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c003d80 con 0x7f35640ccec0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00ab90 con 0x7f35640ccec0 2023-05-21T16:54:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f355c00ad30 con 0x7f35640ccec0 2023-05-21T16:54:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.265+0000 7f354bfff700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f354c066490 0x7f354c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.269+0000 7f35637fe700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f354c066490 0x7f354c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.269+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f355c083d40 con 0x7f35640ccec0 2023-05-21T16:54:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.269+0000 7f35637fe700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f354c066490 0x7f354c068940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3558006fd0 tx=0x7f3558008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.273+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356406e710 con 0x7f35640ccec0 2023-05-21T16:54:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.281+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f355c0511c0 con 0x7f35640ccec0 2023-05-21T16:54:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.521+0000 7f8d0ffff700 1 -- 172.21.15.46:0/2147389312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8d240733b0 con 0x7f8d2414f0d0 2023-05-21T16:54:25.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.521+0000 7f8d1a7fc700 1 -- 172.21.15.46:0/2147389312 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d20029070 con 0x7f8d2414f0d0 2023-05-21T16:54:25.527 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-05-21T16:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.521+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d080662f0 msgr2=0x7f8d080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.521+0000 7f8d2c010700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d080662f0 0x7f8d080687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d14001970 tx=0x7f8d14009040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.521+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2414f0d0 msgr2=0x7f8d24162bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2414f0d0 0x7f8d24162bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d20015000 tx=0x7f8d20004770 comp rx=0 tx=0).stop 2023-05-21T16:54:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 shutdown_connections 2023-05-21T16:54:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d080662f0 0x7f8d080687a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d2414f0d0 0x7f8d24162bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d24164bf0 0x7f8d2414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 --2- 172.21.15.46:0/2147389312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d240ce260 0x7f8d24148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 >> 172.21.15.46:0/2147389312 conn(0x7f8d240cc1a0 msgr2=0x7f8d2406aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 shutdown_connections 2023-05-21T16:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.525+0000 7f8d2c010700 1 -- 172.21.15.46:0/2147389312 wait complete. 2023-05-21T16:54:25.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-05-21T16:54:25.543 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.553+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa0a40733b0 con 0x7fa0a415a2e0 2023-05-21T16:54:25.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.553+0000 7fa09a7fc700 1 -- 172.21.15.46:0/1307403950 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa09c057500 con 0x7fa0a415a2e0 2023-05-21T16:54:25.559 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.553+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f55080733b0 con 0x7f55080cc5d0 2023-05-21T16:54:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.553+0000 7f54fe7fc700 1 -- 172.21.15.46:0/3986655747 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5500031070 con 0x7f55080cc5d0 2023-05-21T16:54:25.560 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-05-21T16:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa088066440 msgr2=0x7fa0880688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa088066440 0x7fa0880688f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009ac0 tx=0x7fa0a00091c0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 msgr2=0x7fa0a4145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 0x7fa0a4145d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa09c013000 tx=0x7fa09c004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 shutdown_connections 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa088066440 0x7fa0880688f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0a415a2e0 0x7fa0a4145d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a4156eb0 0x7fa0a40b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 --2- 172.21.15.46:0/1307403950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40b1cd0 0x7fa0a4157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 >> 172.21.15.46:0/1307403950 conn(0x7fa0a406d7a0 msgr2=0x7fa0a406a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 shutdown_connections 2023-05-21T16:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7fa0aa8be700 1 -- 172.21.15.46:0/1307403950 wait complete. 2023-05-21T16:54:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f54ec0662f0 msgr2=0x7f54ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f54ec0662f0 0x7f54ec0687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54f8000f60 tx=0x7f54f8009040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 msgr2=0x7f55080b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 0x7f55080b05c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f550806c4d0 tx=0x7f5500004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 shutdown_connections 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f54ec0662f0 0x7f54ec0687a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55080cc5d0 0x7f55080b05c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f550806ee30 0x7f550815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 --2- 172.21.15.46:0/3986655747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f550806ea60 0x7f550815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 >> 172.21.15.46:0/3986655747 conn(0x7f55080cc1a0 msgr2=0x7f550815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 shutdown_connections 2023-05-21T16:54:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f550e947700 1 -- 172.21.15.46:0/3986655747 wait complete. 2023-05-21T16:54:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.557+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f724c005890 con 0x7f7268070ca0 2023-05-21T16:54:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe3180733b0 con 0x7fe31806d870 2023-05-21T16:54:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f7256ffd700 1 -- 172.21.15.46:0/3722420523 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f725c0525f0 con 0x7f7268070ca0 2023-05-21T16:54:25.567 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7fe3157fa700 1 -- 172.21.15.46:0/1774438346 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3080537a0 con 0x7fe31806d870 2023-05-21T16:54:25.568 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f72480662f0 msgr2=0x7f72480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f72480662f0 0x7f72480687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f726815c7e0 tx=0x7f7260009040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 msgr2=0x7f72680c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 0x7f72680c2650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f725c000c00 tx=0x7f725c004770 comp rx=0 tx=0).stop 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 shutdown_connections 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f72480662f0 0x7f72480687a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7268158d90 0x7f7268149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72680ccec0 0x7f72680c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 --2- 172.21.15.46:0/3722420523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7268070ca0 0x7f72680c2650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 >> 172.21.15.46:0/3722420523 conn(0x7f72680cf720 msgr2=0x7f7268150040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 shutdown_connections 2023-05-21T16:54:25.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.561+0000 7f726759e700 1 -- 172.21.15.46:0/3722420523 wait complete. 2023-05-21T16:54:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe3040662f0 msgr2=0x7fe3040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe3040662f0 0x7fe3040687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3180c9b60 tx=0x7fe30c009240 comp rx=0 tx=0).stop 2023-05-21T16:54:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 msgr2=0x7fe3180ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 0x7fe3180ad0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe308001eb0 tx=0x7fe30800c7b0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 shutdown_connections 2023-05-21T16:54:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe3040662f0 0x7fe3040687a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe318158b60 0x7fe3180b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3180cd4e0 0x7fe318155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 --2- 172.21.15.46:0/1774438346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe31806d870 0x7fe3180ad0e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 >> 172.21.15.46:0/1774438346 conn(0x7fe3180cc1a0 msgr2=0x7fe3181570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 shutdown_connections 2023-05-21T16:54:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7fe31dd9c700 1 -- 172.21.15.46:0/1774438346 wait complete. 2023-05-21T16:54:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f34fc005890 con 0x7f35180ccce0 2023-05-21T16:54:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.569+0000 7f35157fa700 1 -- 172.21.15.46:0/4236753789 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f350c053b20 con 0x7f35180ccce0 2023-05-21T16:54:25.578 INFO:teuthology.orchestra.run.smithi046.stdout:55834574855 2023-05-21T16:54:25.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-05-21T16:54:25.579 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f35080663e0 msgr2=0x7f3508068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f35080663e0 0x7f3508068890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35180ad480 tx=0x7f3504009040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 msgr2=0x7f35181526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 0x7f35181526c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c530 tx=0x7f350c00c840 comp rx=0 tx=0).stop 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 shutdown_connections 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f35080663e0 0x7f3508068890 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3518160400 0x7f35180b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3518153b10 0x7f35180b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 --2- 172.21.15.46:0/4236753789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35180ccce0 0x7f35181526c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 >> 172.21.15.46:0/4236753789 conn(0x7f35180cf720 msgr2=0x7f35180ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 shutdown_connections 2023-05-21T16:54:25.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.573+0000 7f351ddce700 1 -- 172.21.15.46:0/4236753789 wait complete. 2023-05-21T16:54:25.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-05-21T16:54:25.582 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-05-21T16:54:25.584 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-05-21T16:54:25.585 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.581+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3564067ac0 con 0x7f35640ccec0 2023-05-21T16:54:25.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.581+0000 7f354bfff700 1 -- 172.21.15.46:0/2943501525 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f355c0547e0 con 0x7f35640ccec0 2023-05-21T16:54:25.587 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2023-05-21T16:54:25.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feed80733b0 con 0x7feed80709d0 2023-05-21T16:54:25.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feebffff700 1 -- 172.21.15.46:0/3100086115 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feed0018030 con 0x7feed80709d0 2023-05-21T16:54:25.589 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2023-05-21T16:54:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f354c066490 msgr2=0x7f354c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f354c066490 0x7f354c068940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3558006fd0 tx=0x7f3558008040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 msgr2=0x7f35640c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 0x7f35640c42a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f355c00cc20 tx=0x7f355c00cf30 comp rx=0 tx=0).stop 2023-05-21T16:54:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 shutdown_connections 2023-05-21T16:54:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f354c066490 0x7f354c068940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35640adc70 0x7f35640af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35640ccec0 0x7f35640c42a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 --2- 172.21.15.46:0/2943501525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35640b3660 0x7f3564154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 >> 172.21.15.46:0/2943501525 conn(0x7f35640cca00 msgr2=0x7f3564157500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 shutdown_connections 2023-05-21T16:54:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7f3568a75700 1 -- 172.21.15.46:0/2943501525 wait complete. 2023-05-21T16:54:25.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feec40662f0 msgr2=0x7feec40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feec40662f0 0x7feec40687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feed80703a0 tx=0x7feecc008040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 msgr2=0x7feed80c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 0x7feed80c6c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feed0001f80 tx=0x7feed000a340 comp rx=0 tx=0).stop 2023-05-21T16:54:25.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-05-21T16:54:25.593 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 shutdown_connections 2023-05-21T16:54:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feec40662f0 0x7feec40687a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed815c9b0 0x7feed81f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feed80ccaa0 0x7feed80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 --2- 172.21.15.46:0/3100086115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed80709d0 0x7feed80c6c10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 >> 172.21.15.46:0/3100086115 conn(0x7feed80cd6f0 msgr2=0x7feed815b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 shutdown_connections 2023-05-21T16:54:25.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.585+0000 7feedc9d4700 1 -- 172.21.15.46:0/3100086115 wait complete. 2023-05-21T16:54:25.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-05-21T16:54:25.600 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-05-21T16:54:25.601 DEBUG:teuthology.parallel:result is None 2023-05-21T16:54:25.602 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-21T16:54:25.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:54:25.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 Processor -- start 2023-05-21T16:54:25.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 -- start start 2023-05-21T16:54:25.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309406c760 0x7f309415a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f309415dbb0 0x7f309406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309406b9d0 con 0x7f3094069f80 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309406b450 con 0x7f309415dbb0 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3093fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3094159a90 con 0x7f309406c760 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30937fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3094069f80 0x7f309406a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33104/0 (socket says 172.21.15.46:33104) 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30937fe700 1 -- 172.21.15.46:0/2168452373 learned_addr learned my addr 172.21.15.46:0/2168452373 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3092ffd700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309406c760 0x7f309415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f308bfff700 1 --2- 172.21.15.46:0/2168452373 >> v2:172.21.15.142:3300/0 conn(0x7f309415dbb0 0x7f309406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955456814 0 0) 0x7f309406b9d0 con 0x7f3094069f80 2023-05-21T16:54:25.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30800035d0 con 0x7f3094069f80 2023-05-21T16:54:25.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3465241436 0 0) 0x7f30800035d0 con 0x7f3094069f80 2023-05-21T16:54:25.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309406c760 msgr2=0x7f309415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309406c760 0x7f309415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 >> v2:172.21.15.142:3300/0 conn(0x7f309415dbb0 msgr2=0x7f309406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 --2- 172.21.15.46:0/2168452373 >> v2:172.21.15.142:3300/0 conn(0x7f309415dbb0 0x7f309406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309406d070 con 0x7f3094069f80 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f308c0019f0 con 0x7f3094069f80 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 >> v1:172.21.15.46:6789/0 conn(0x7f3094069f80 legacy=0x7f309406a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3080003a20 0x7f3080003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004450 0x7f3080004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3080004fd0 0x7f308000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309406b450 con 0x7f3080004fd0 2023-05-21T16:54:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3094159a90 con 0x7f3080003a20 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308000bf70 con 0x7f3080004450 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f3092ffd700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309406c760 0x7f309415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f308bfff700 1 --2- 172.21.15.46:0/2168452373 >> v2:172.21.15.142:3300/0 conn(0x7f309415dbb0 0x7f309406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.749+0000 7f30937fe700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3080004fd0 0x7f308000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f308bfff700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004450 0x7f3080004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3092ffd700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3080003a20 0x7f3080003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 -- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004450 msgr2=0x7f3080004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004450 0x7f3080004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 -- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3080003a20 msgr2=0x7f3080003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3080003a20 0x7f3080003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 -- 172.21.15.46:0/2168452373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800035d0 con 0x7f3080004fd0 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3092ffd700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3080003a20 0x7f3080003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3080004fd0 0x7f308000ba30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f308c00a860 tx=0x7f30800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d62a7511a58144 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c0072d0 con 0x7f3080004fd0 2023-05-21T16:54:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c007450 con 0x7f3080004fd0 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30927fc700 1 -- 172.21.15.46:0/2168452373 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c007800 con 0x7f3080004fd0 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 -- 172.21.15.46:0/2168452373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3080004fd0 msgr2=0x7f308000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 --2- 172.21.15.46:0/2168452373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3080004fd0 0x7f308000ba30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f308c00a860 tx=0x7f30800058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f30937fe700 1 -- 172.21.15.46:0/2168452373 reap_dead start 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 -- 172.21.15.46:0/2168452373 shutdown_connections 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 -- 172.21.15.46:0/2168452373 >> 172.21.15.46:0/2168452373 conn(0x7f30940cf720 msgr2=0x7f30940cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 -- 172.21.15.46:0/2168452373 shutdown_connections 2023-05-21T16:54:25.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 -- 172.21.15.46:0/2168452373 wait complete. 2023-05-21T16:54:25.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 Processor -- start 2023-05-21T16:54:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.753+0000 7f3093fff700 1 -- start start 2023-05-21T16:54:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004fd0 0x7f30940c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30940c86f0 0x7f309414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 0x7f30940b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c6010 con 0x7f30940afd40 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940b06f0 con 0x7f30940c86f0 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c67c0 con 0x7f3080004fd0 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 0x7f30940b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 0x7f30940b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34750/0 (socket says 172.21.15.46:34750) 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 -- 172.21.15.46:0/3502909911 learned_addr learned my addr 172.21.15.46:0/3502909911 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f308bfff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30940c86f0 0x7f309414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3092ffd700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004fd0 0x7f30940c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 -- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004fd0 msgr2=0x7f30940c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004fd0 0x7f30940c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 -- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30940c86f0 msgr2=0x7f309414e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30940c86f0 0x7f309414e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 -- 172.21.15.46:0/3502909911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3094159d50 con 0x7f30940afd40 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f30937fe700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 0x7f30940b01b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f308c011000 tx=0x7f308c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c025030 con 0x7f30940afd40 2023-05-21T16:54:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c00a300 con 0x7f30940afd40 2023-05-21T16:54:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309406b6f0 con 0x7f30940afd40 2023-05-21T16:54:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c012640 con 0x7f30940afd40 2023-05-21T16:54:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309415a030 con 0x7f30940afd40 2023-05-21T16:54:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.757+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30940733b0 con 0x7f30940afd40 2023-05-21T16:54:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.761+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f308c028070 con 0x7f30940afd40 2023-05-21T16:54:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.761+0000 7f3090ff9700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3074066320 0x7f30740687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.761+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f308c026070 con 0x7f30940afd40 2023-05-21T16:54:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.761+0000 7f3092ffd700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3074066320 0x7f30740687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.761+0000 7f3092ffd700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3074066320 0x7f30740687d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3084009480 tx=0x7f3084008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.769+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f308c0529c0 con 0x7f30940afd40 2023-05-21T16:54:25.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.925+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f309406b230 con 0x7f3074066320 2023-05-21T16:54:25.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.941+0000 7f3090ff9700 1 -- 172.21.15.46:0/3502909911 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286618 (secure 0 0 0) 0x7f309406b230 con 0x7f3074066320 2023-05-21T16:54:25.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:25.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3074066320 msgr2=0x7f30740687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3074066320 0x7f30740687d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3084009480 tx=0x7f3084008040 comp rx=0 tx=0).stop 2023-05-21T16:54:25.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 msgr2=0x7f30940b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 0x7f30940b01b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f308c011000 tx=0x7f308c001d80 comp rx=0 tx=0).stop 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 shutdown_connections 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3074066320 0x7f30740687d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30940afd40 0x7f30940b01b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30940c86f0 0x7f309414e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 --2- 172.21.15.46:0/3502909911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3080004fd0 0x7f30940c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:25.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 >> 172.21.15.46:0/3502909911 conn(0x7f30940cf720 msgr2=0x7f3094070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:25.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 shutdown_connections 2023-05-21T16:54:25.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:25.945+0000 7f3093fff700 1 -- 172.21.15.46:0/3502909911 wait complete. 2023-05-21T16:54:25.953 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:54:25.963 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-05-21T16:54:24.784517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82888,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":79616,"kb_avail":754891832,"statfs":{"total":773094113280,"available":773009235968,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81526784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.020128"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507946+0000","last_change":"2023-05-21T16:54:18.173535+0000","last_active":"2023-05-21T16:54:19.507946+0000","last_peered":"2023-05-21T16:54:19.507946+0000","last_clean":"2023-05-21T16:54:19.507946+0000","last_became_active":"2023-05-21T16:54:18.172985+0000","last_became_peered":"2023-05-21T16:54:18.172985+0000","last_unstale":"2023-05-21T16:54:19.507946+0000","last_undegraded":"2023-05-21T16:54:19.507946+0000","last_fullsized":"2023-05-21T16:54:19.507946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:03:41.302203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955404+0000","last_change":"2023-05-21T16:54:18.168645+0000","last_active":"2023-05-21T16:54:19.955404+0000","last_peered":"2023-05-21T16:54:19.955404+0000","last_clean":"2023-05-21T16:54:19.955404+0000","last_became_active":"2023-05-21T16:54:18.168325+0000","last_became_peered":"2023-05-21T16:54:18.168325+0000","last_unstale":"2023-05-21T16:54:19.955404+0000","last_undegraded":"2023-05-21T16:54:19.955404+0000","last_fullsized":"2023-05-21T16:54:19.955404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231233+0000","last_change":"2023-05-21T16:54:18.174946+0000","last_active":"2023-05-21T16:54:19.231233+0000","last_peered":"2023-05-21T16:54:19.231233+0000","last_clean":"2023-05-21T16:54:19.231233+0000","last_became_active":"2023-05-21T16:54:18.174596+0000","last_became_peered":"2023-05-21T16:54:18.174596+0000","last_unstale":"2023-05-21T16:54:19.231233+0000","last_undegraded":"2023-05-21T16:54:19.231233+0000","last_fullsized":"2023-05-21T16:54:19.231233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153865+0000","last_change":"2023-05-21T16:54:18.168066+0000","last_active":"2023-05-21T16:54:19.153865+0000","last_peered":"2023-05-21T16:54:19.153865+0000","last_clean":"2023-05-21T16:54:19.153865+0000","last_became_active":"2023-05-21T16:54:18.167782+0000","last_became_peered":"2023-05-21T16:54:18.167782+0000","last_unstale":"2023-05-21T16:54:19.153865+0000","last_undegraded":"2023-05-21T16:54:19.153865+0000","last_fullsized":"2023-05-21T16:54:19.153865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:39:57.359288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151402+0000","last_change":"2023-05-21T16:54:18.179965+0000","last_active":"2023-05-21T16:54:19.151402+0000","last_peered":"2023-05-21T16:54:19.151402+0000","last_clean":"2023-05-21T16:54:19.151402+0000","last_became_active":"2023-05-21T16:54:18.179618+0000","last_became_peered":"2023-05-21T16:54:18.179618+0000","last_unstale":"2023-05-21T16:54:19.151402+0000","last_undegraded":"2023-05-21T16:54:19.151402+0000","last_fullsized":"2023-05-21T16:54:19.151402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230210+0000","last_change":"2023-05-21T16:54:18.174594+0000","last_active":"2023-05-21T16:54:19.230210+0000","last_peered":"2023-05-21T16:54:19.230210+0000","last_clean":"2023-05-21T16:54:19.230210+0000","last_became_active":"2023-05-21T16:54:18.170519+0000","last_became_peered":"2023-05-21T16:54:18.170519+0000","last_unstale":"2023-05-21T16:54:19.230210+0000","last_undegraded":"2023-05-21T16:54:19.230210+0000","last_fullsized":"2023-05-21T16:54:19.230210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152878+0000","last_change":"2023-05-21T16:54:18.169270+0000","last_active":"2023-05-21T16:54:19.152878+0000","last_peered":"2023-05-21T16:54:19.152878+0000","last_clean":"2023-05-21T16:54:19.152878+0000","last_became_active":"2023-05-21T16:54:18.168977+0000","last_became_peered":"2023-05-21T16:54:18.168977+0000","last_unstale":"2023-05-21T16:54:19.152878+0000","last_undegraded":"2023-05-21T16:54:19.152878+0000","last_fullsized":"2023-05-21T16:54:19.152878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954983+0000","last_change":"2023-05-21T16:54:18.165262+0000","last_active":"2023-05-21T16:54:19.954983+0000","last_peered":"2023-05-21T16:54:19.954983+0000","last_clean":"2023-05-21T16:54:19.954983+0000","last_became_active":"2023-05-21T16:54:18.164916+0000","last_became_peered":"2023-05-21T16:54:18.164916+0000","last_unstale":"2023-05-21T16:54:19.954983+0000","last_undegraded":"2023-05-21T16:54:19.954983+0000","last_fullsized":"2023-05-21T16:54:19.954983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151737+0000","last_change":"2023-05-21T16:54:18.174319+0000","last_active":"2023-05-21T16:54:19.151737+0000","last_peered":"2023-05-21T16:54:19.151737+0000","last_clean":"2023-05-21T16:54:19.151737+0000","last_became_active":"2023-05-21T16:54:18.174006+0000","last_became_peered":"2023-05-21T16:54:18.174006+0000","last_unstale":"2023-05-21T16:54:19.151737+0000","last_undegraded":"2023-05-21T16:54:19.151737+0000","last_fullsized":"2023-05-21T16:54:19.151737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955479+0000","last_change":"2023-05-21T16:54:18.172783+0000","last_active":"2023-05-21T16:54:19.955479+0000","last_peered":"2023-05-21T16:54:19.955479+0000","last_clean":"2023-05-21T16:54:19.955479+0000","last_became_active":"2023-05-21T16:54:18.172479+0000","last_became_peered":"2023-05-21T16:54:18.172479+0000","last_unstale":"2023-05-21T16:54:19.955479+0000","last_undegraded":"2023-05-21T16:54:19.955479+0000","last_fullsized":"2023-05-21T16:54:19.955479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231502+0000","last_change":"2023-05-21T16:54:18.177992+0000","last_active":"2023-05-21T16:54:19.231502+0000","last_peered":"2023-05-21T16:54:19.231502+0000","last_clean":"2023-05-21T16:54:19.231502+0000","last_became_active":"2023-05-21T16:54:18.177672+0000","last_became_peered":"2023-05-21T16:54:18.177672+0000","last_unstale":"2023-05-21T16:54:19.231502+0000","last_undegraded":"2023-05-21T16:54:19.231502+0000","last_fullsized":"2023-05-21T16:54:19.231502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507861+0000","last_change":"2023-05-21T16:54:18.178845+0000","last_active":"2023-05-21T16:54:19.507861+0000","last_peered":"2023-05-21T16:54:19.507861+0000","last_clean":"2023-05-21T16:54:19.507861+0000","last_became_active":"2023-05-21T16:54:18.178443+0000","last_became_peered":"2023-05-21T16:54:18.178443+0000","last_unstale":"2023-05-21T16:54:19.507861+0000","last_undegraded":"2023-05-21T16:54:19.507861+0000","last_fullsized":"2023-05-21T16:54:19.507861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:04.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507567+0000","last_change":"2023-05-21T16:54:18.173619+0000","last_active":"2023-05-21T16:54:19.507567+0000","last_peered":"2023-05-21T16:54:19.507567+0000","last_clean":"2023-05-21T16:54:19.507567+0000","last_became_active":"2023-05-21T16:54:18.173111+0000","last_became_peered":"2023-05-21T16:54:18.173111+0000","last_unstale":"2023-05-21T16:54:19.507567+0000","last_undegraded":"2023-05-21T16:54:19.507567+0000","last_fullsized":"2023-05-21T16:54:19.507567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:59:59.660879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955292+0000","last_change":"2023-05-21T16:54:18.161833+0000","last_active":"2023-05-21T16:54:19.955292+0000","last_peered":"2023-05-21T16:54:19.955292+0000","last_clean":"2023-05-21T16:54:19.955292+0000","last_became_active":"2023-05-21T16:54:18.161537+0000","last_became_peered":"2023-05-21T16:54:18.161537+0000","last_unstale":"2023-05-21T16:54:19.955292+0000","last_undegraded":"2023-05-21T16:54:19.955292+0000","last_fullsized":"2023-05-21T16:54:19.955292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153194+0000","last_change":"2023-05-21T16:54:18.167967+0000","last_active":"2023-05-21T16:54:19.153194+0000","last_peered":"2023-05-21T16:54:19.153194+0000","last_clean":"2023-05-21T16:54:19.153194+0000","last_became_active":"2023-05-21T16:54:18.167679+0000","last_became_peered":"2023-05-21T16:54:18.167679+0000","last_unstale":"2023-05-21T16:54:19.153194+0000","last_undegraded":"2023-05-21T16:54:19.153194+0000","last_fullsized":"2023-05-21T16:54:19.153194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229833+0000","last_change":"2023-05-21T16:54:18.174428+0000","last_active":"2023-05-21T16:54:19.229833+0000","last_peered":"2023-05-21T16:54:19.229833+0000","last_clean":"2023-05-21T16:54:19.229833+0000","last_became_active":"2023-05-21T16:54:18.171683+0000","last_became_peered":"2023-05-21T16:54:18.171683+0000","last_unstale":"2023-05-21T16:54:19.229833+0000","last_undegraded":"2023-05-21T16:54:19.229833+0000","last_fullsized":"2023-05-21T16:54:19.229833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151801+0000","last_change":"2023-05-21T16:54:18.174341+0000","last_active":"2023-05-21T16:54:19.151801+0000","last_peered":"2023-05-21T16:54:19.151801+0000","last_clean":"2023-05-21T16:54:19.151801+0000","last_became_active":"2023-05-21T16:54:18.172475+0000","last_became_peered":"2023-05-21T16:54:18.172475+0000","last_unstale":"2023-05-21T16:54:19.151801+0000","last_undegraded":"2023-05-21T16:54:19.151801+0000","last_fullsized":"2023-05-21T16:54:19.151801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230882+0000","last_change":"2023-05-21T16:54:18.172503+0000","last_active":"2023-05-21T16:54:19.230882+0000","last_peered":"2023-05-21T16:54:19.230882+0000","last_clean":"2023-05-21T16:54:19.230882+0000","last_became_active":"2023-05-21T16:54:18.171759+0000","last_became_peered":"2023-05-21T16:54:18.171759+0000","last_unstale":"2023-05-21T16:54:19.230882+0000","last_undegraded":"2023-05-21T16:54:19.230882+0000","last_fullsized":"2023-05-21T16:54:19.230882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507738+0000","last_change":"2023-05-21T16:54:18.177321+0000","last_active":"2023-05-21T16:54:19.507738+0000","last_peered":"2023-05-21T16:54:19.507738+0000","last_clean":"2023-05-21T16:54:19.507738+0000","last_became_active":"2023-05-21T16:54:18.177032+0000","last_became_peered":"2023-05-21T16:54:18.177032+0000","last_unstale":"2023-05-21T16:54:19.507738+0000","last_undegraded":"2023-05-21T16:54:19.507738+0000","last_fullsized":"2023-05-21T16:54:19.507738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:53:28.141995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231058+0000","last_change":"2023-05-21T16:54:18.174907+0000","last_active":"2023-05-21T16:54:19.231058+0000","last_peered":"2023-05-21T16:54:19.231058+0000","last_clean":"2023-05-21T16:54:19.231058+0000","last_became_active":"2023-05-21T16:54:18.174528+0000","last_became_peered":"2023-05-21T16:54:18.174528+0000","last_unstale":"2023-05-21T16:54:19.231058+0000","last_undegraded":"2023-05-21T16:54:19.231058+0000","last_fullsized":"2023-05-21T16:54:19.231058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153215+0000","last_change":"2023-05-21T16:54:18.172031+0000","last_active":"2023-05-21T16:54:19.153215+0000","last_peered":"2023-05-21T16:54:19.153215+0000","last_clean":"2023-05-21T16:54:19.153215+0000","last_became_active":"2023-05-21T16:54:18.170754+0000","last_became_peered":"2023-05-21T16:54:18.170754+0000","last_unstale":"2023-05-21T16:54:19.153215+0000","last_undegraded":"2023-05-21T16:54:19.153215+0000","last_fullsized":"2023-05-21T16:54:19.153215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151032+0000","last_change":"2023-05-21T16:54:18.177700+0000","last_active":"2023-05-21T16:54:19.151032+0000","last_peered":"2023-05-21T16:54:19.151032+0000","last_clean":"2023-05-21T16:54:19.151032+0000","last_became_active":"2023-05-21T16:54:18.177419+0000","last_became_peered":"2023-05-21T16:54:18.177419+0000","last_unstale":"2023-05-21T16:54:19.151032+0000","last_undegraded":"2023-05-21T16:54:19.151032+0000","last_fullsized":"2023-05-21T16:54:19.151032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009407+0000","last_change":"2023-05-21T16:54:18.173893+0000","last_active":"2023-05-21T16:54:20.009407+0000","last_peered":"2023-05-21T16:54:20.009407+0000","last_clean":"2023-05-21T16:54:20.009407+0000","last_became_active":"2023-05-21T16:54:18.173618+0000","last_became_peered":"2023-05-21T16:54:18.173618+0000","last_unstale":"2023-05-21T16:54:20.009407+0000","last_undegraded":"2023-05-21T16:54:20.009407+0000","last_fullsized":"2023-05-21T16:54:20.009407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152740+0000","last_change":"2023-05-21T16:54:18.178690+0000","last_active":"2023-05-21T16:54:19.152740+0000","last_peered":"2023-05-21T16:54:19.152740+0000","last_clean":"2023-05-21T16:54:19.152740+0000","last_became_active":"2023-05-21T16:54:18.178395+0000","last_became_peered":"2023-05-21T16:54:18.178395+0000","last_unstale":"2023-05-21T16:54:19.152740+0000","last_undegraded":"2023-05-21T16:54:19.152740+0000","last_fullsized":"2023-05-21T16:54:19.152740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010601+0000","last_change":"2023-05-21T16:54:18.174128+0000","last_active":"2023-05-21T16:54:20.010601+0000","last_peered":"2023-05-21T16:54:20.010601+0000","last_clean":"2023-05-21T16:54:20.010601+0000","last_became_active":"2023-05-21T16:54:18.173436+0000","last_became_peered":"2023-05-21T16:54:18.173436+0000","last_unstale":"2023-05-21T16:54:20.010601+0000","last_undegraded":"2023-05-21T16:54:20.010601+0000","last_fullsized":"2023-05-21T16:54:20.010601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010387+0000","last_change":"2023-05-21T16:54:18.166373+0000","last_active":"2023-05-21T16:54:20.010387+0000","last_peered":"2023-05-21T16:54:20.010387+0000","last_clean":"2023-05-21T16:54:20.010387+0000","last_became_active":"2023-05-21T16:54:18.166106+0000","last_became_peered":"2023-05-21T16:54:18.166106+0000","last_unstale":"2023-05-21T16:54:20.010387+0000","last_undegraded":"2023-05-21T16:54:20.010387+0000","last_fullsized":"2023-05-21T16:54:20.010387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955908+0000","last_change":"2023-05-21T16:54:18.165081+0000","last_active":"2023-05-21T16:54:19.955908+0000","last_peered":"2023-05-21T16:54:19.955908+0000","last_clean":"2023-05-21T16:54:19.955908+0000","last_became_active":"2023-05-21T16:54:18.164749+0000","last_became_peered":"2023-05-21T16:54:18.164749+0000","last_unstale":"2023-05-21T16:54:19.955908+0000","last_undegraded":"2023-05-21T16:54:19.955908+0000","last_fullsized":"2023-05-21T16:54:19.955908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010630+0000","last_change":"2023-05-21T16:54:18.178240+0000","last_active":"2023-05-21T16:54:20.010630+0000","last_peered":"2023-05-21T16:54:20.010630+0000","last_clean":"2023-05-21T16:54:20.010630+0000","last_became_active":"2023-05-21T16:54:18.177953+0000","last_became_peered":"2023-05-21T16:54:18.177953+0000","last_unstale":"2023-05-21T16:54:20.010630+0000","last_undegraded":"2023-05-21T16:54:20.010630+0000","last_fullsized":"2023-05-21T16:54:20.010630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011193+0000","last_change":"2023-05-21T16:54:18.171995+0000","last_active":"2023-05-21T16:54:20.011193+0000","last_peered":"2023-05-21T16:54:20.011193+0000","last_clean":"2023-05-21T16:54:20.011193+0000","last_became_active":"2023-05-21T16:54:18.170850+0000","last_became_peered":"2023-05-21T16:54:18.170850+0000","last_unstale":"2023-05-21T16:54:20.011193+0000","last_undegraded":"2023-05-21T16:54:20.011193+0000","last_fullsized":"2023-05-21T16:54:20.011193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230580+0000","last_change":"2023-05-21T16:54:18.175264+0000","last_active":"2023-05-21T16:54:19.230580+0000","last_peered":"2023-05-21T16:54:19.230580+0000","last_clean":"2023-05-21T16:54:19.230580+0000","last_became_active":"2023-05-21T16:54:18.174923+0000","last_became_peered":"2023-05-21T16:54:18.174923+0000","last_unstale":"2023-05-21T16:54:19.230580+0000","last_undegraded":"2023-05-21T16:54:19.230580+0000","last_fullsized":"2023-05-21T16:54:19.230580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009553+0000","last_change":"2023-05-21T16:54:18.178259+0000","last_active":"2023-05-21T16:54:20.009553+0000","last_peered":"2023-05-21T16:54:20.009553+0000","last_clean":"2023-05-21T16:54:20.009553+0000","last_became_active":"2023-05-21T16:54:18.177972+0000","last_became_peered":"2023-05-21T16:54:18.177972+0000","last_unstale":"2023-05-21T16:54:20.009553+0000","last_undegraded":"2023-05-21T16:54:20.009553+0000","last_fullsized":"2023-05-21T16:54:20.009553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153058+0000","last_change":"2023-05-21T16:54:18.169342+0000","last_active":"2023-05-21T16:54:19.153058+0000","last_peered":"2023-05-21T16:54:19.153058+0000","last_clean":"2023-05-21T16:54:19.153058+0000","last_became_active":"2023-05-21T16:54:18.169078+0000","last_became_peered":"2023-05-21T16:54:18.169078+0000","last_unstale":"2023-05-21T16:54:19.153058+0000","last_undegraded":"2023-05-21T16:54:19.153058+0000","last_fullsized":"2023-05-21T16:54:19.153058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011024+0000","last_change":"2023-05-21T16:54:18.178151+0000","last_active":"2023-05-21T16:54:20.011024+0000","last_peered":"2023-05-21T16:54:20.011024+0000","last_clean":"2023-05-21T16:54:20.011024+0000","last_became_active":"2023-05-21T16:54:18.177832+0000","last_became_peered":"2023-05-21T16:54:18.177832+0000","last_unstale":"2023-05-21T16:54:20.011024+0000","last_undegraded":"2023-05-21T16:54:20.011024+0000","last_fullsized":"2023-05-21T16:54:20.011024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153512+0000","last_change":"2023-05-21T16:54:17.791377+0000","last_active":"2023-05-21T16:54:19.153512+0000","last_peered":"2023-05-21T16:54:19.153512+0000","last_clean":"2023-05-21T16:54:19.153512+0000","last_became_active":"2023-05-21T16:54:17.791033+0000","last_became_peered":"2023-05-21T16:54:17.791033+0000","last_unstale":"2023-05-21T16:54:19.153512+0000","last_undegraded":"2023-05-21T16:54:19.153512+0000","last_fullsized":"2023-05-21T16:54:19.153512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956058+0000","last_change":"2023-05-21T16:54:18.160039+0000","last_active":"2023-05-21T16:54:19.956058+0000","last_peered":"2023-05-21T16:54:19.956058+0000","last_clean":"2023-05-21T16:54:19.956058+0000","last_became_active":"2023-05-21T16:54:18.159784+0000","last_became_peered":"2023-05-21T16:54:18.159784+0000","last_unstale":"2023-05-21T16:54:19.956058+0000","last_undegraded":"2023-05-21T16:54:19.956058+0000","last_fullsized":"2023-05-21T16:54:19.956058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151174+0000","last_change":"2023-05-21T16:54:17.793000+0000","last_active":"2023-05-21T16:54:19.151174+0000","last_peered":"2023-05-21T16:54:19.151174+0000","last_clean":"2023-05-21T16:54:19.151174+0000","last_became_active":"2023-05-21T16:54:17.792628+0000","last_became_peered":"2023-05-21T16:54:17.792628+0000","last_unstale":"2023-05-21T16:54:19.151174+0000","last_undegraded":"2023-05-21T16:54:19.151174+0000","last_fullsized":"2023-05-21T16:54:19.151174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151621+0000","last_change":"2023-05-21T16:54:18.171993+0000","last_active":"2023-05-21T16:54:19.151621+0000","last_peered":"2023-05-21T16:54:19.151621+0000","last_clean":"2023-05-21T16:54:19.151621+0000","last_became_active":"2023-05-21T16:54:18.171691+0000","last_became_peered":"2023-05-21T16:54:18.171691+0000","last_unstale":"2023-05-21T16:54:19.151621+0000","last_undegraded":"2023-05-21T16:54:19.151621+0000","last_fullsized":"2023-05-21T16:54:19.151621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153638+0000","last_change":"2023-05-21T16:54:17.792641+0000","last_active":"2023-05-21T16:54:19.153638+0000","last_peered":"2023-05-21T16:54:19.153638+0000","last_clean":"2023-05-21T16:54:19.153638+0000","last_became_active":"2023-05-21T16:54:17.792197+0000","last_became_peered":"2023-05-21T16:54:17.792197+0000","last_unstale":"2023-05-21T16:54:19.153638+0000","last_undegraded":"2023-05-21T16:54:19.153638+0000","last_fullsized":"2023-05-21T16:54:19.153638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:46:25.331076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011544+0000","last_change":"2023-05-21T16:54:18.171873+0000","last_active":"2023-05-21T16:54:20.011544+0000","last_peered":"2023-05-21T16:54:20.011544+0000","last_clean":"2023-05-21T16:54:20.011544+0000","last_became_active":"2023-05-21T16:54:18.171463+0000","last_became_peered":"2023-05-21T16:54:18.171463+0000","last_unstale":"2023-05-21T16:54:20.011544+0000","last_undegraded":"2023-05-21T16:54:20.011544+0000","last_fullsized":"2023-05-21T16:54:20.011544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153427+0000","last_change":"2023-05-21T16:54:17.793533+0000","last_active":"2023-05-21T16:54:19.153427+0000","last_peered":"2023-05-21T16:54:19.153427+0000","last_clean":"2023-05-21T16:54:19.153427+0000","last_became_active":"2023-05-21T16:54:17.793152+0000","last_became_peered":"2023-05-21T16:54:17.793152+0000","last_unstale":"2023-05-21T16:54:19.153427+0000","last_undegraded":"2023-05-21T16:54:19.153427+0000","last_fullsized":"2023-05-21T16:54:19.153427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:40:00.667703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154574+0000","last_change":"2023-05-21T16:54:17.792133+0000","last_active":"2023-05-21T16:54:19.154574+0000","last_peered":"2023-05-21T16:54:19.154574+0000","last_clean":"2023-05-21T16:54:19.154574+0000","last_became_active":"2023-05-21T16:54:17.791681+0000","last_became_peered":"2023-05-21T16:54:17.791681+0000","last_unstale":"2023-05-21T16:54:19.154574+0000","last_undegraded":"2023-05-21T16:54:19.154574+0000","last_fullsized":"2023-05-21T16:54:19.154574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:46:05.629379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954986+0000","last_change":"2023-05-21T16:54:18.159536+0000","last_active":"2023-05-21T16:54:19.954986+0000","last_peered":"2023-05-21T16:54:19.954986+0000","last_clean":"2023-05-21T16:54:19.954986+0000","last_became_active":"2023-05-21T16:54:18.158995+0000","last_became_peered":"2023-05-21T16:54:18.158995+0000","last_unstale":"2023-05-21T16:54:19.954986+0000","last_undegraded":"2023-05-21T16:54:19.954986+0000","last_fullsized":"2023-05-21T16:54:19.954986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153940+0000","last_change":"2023-05-21T16:54:17.791717+0000","last_active":"2023-05-21T16:54:19.153940+0000","last_peered":"2023-05-21T16:54:19.153940+0000","last_clean":"2023-05-21T16:54:19.153940+0000","last_became_active":"2023-05-21T16:54:17.791323+0000","last_became_peered":"2023-05-21T16:54:17.791323+0000","last_unstale":"2023-05-21T16:54:19.153940+0000","last_undegraded":"2023-05-21T16:54:19.153940+0000","last_fullsized":"2023-05-21T16:54:19.153940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:30:06.548887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229939+0000","last_change":"2023-05-21T16:54:18.176794+0000","last_active":"2023-05-21T16:54:19.229939+0000","last_peered":"2023-05-21T16:54:19.229939+0000","last_clean":"2023-05-21T16:54:19.229939+0000","last_became_active":"2023-05-21T16:54:18.176500+0000","last_became_peered":"2023-05-21T16:54:18.176500+0000","last_unstale":"2023-05-21T16:54:19.229939+0000","last_undegraded":"2023-05-21T16:54:19.229939+0000","last_fullsized":"2023-05-21T16:54:19.229939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153977+0000","last_change":"2023-05-21T16:54:17.791693+0000","last_active":"2023-05-21T16:54:19.153977+0000","last_peered":"2023-05-21T16:54:19.153977+0000","last_clean":"2023-05-21T16:54:19.153977+0000","last_became_active":"2023-05-21T16:54:17.790907+0000","last_became_peered":"2023-05-21T16:54:17.790907+0000","last_unstale":"2023-05-21T16:54:19.153977+0000","last_undegraded":"2023-05-21T16:54:19.153977+0000","last_fullsized":"2023-05-21T16:54:19.153977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:48.881822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153098+0000","last_change":"2023-05-21T16:54:18.176109+0000","last_active":"2023-05-21T16:54:19.153098+0000","last_peered":"2023-05-21T16:54:19.153098+0000","last_clean":"2023-05-21T16:54:19.153098+0000","last_became_active":"2023-05-21T16:54:18.175825+0000","last_became_peered":"2023-05-21T16:54:18.175825+0000","last_unstale":"2023-05-21T16:54:19.153098+0000","last_undegraded":"2023-05-21T16:54:19.153098+0000","last_fullsized":"2023-05-21T16:54:19.153098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:16.831930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955462+0000","last_change":"2023-05-21T16:54:17.785136+0000","last_active":"2023-05-21T16:54:19.955462+0000","last_peered":"2023-05-21T16:54:19.955462+0000","last_clean":"2023-05-21T16:54:19.955462+0000","last_became_active":"2023-05-21T16:54:17.784827+0000","last_became_peered":"2023-05-21T16:54:17.784827+0000","last_unstale":"2023-05-21T16:54:19.955462+0000","last_undegraded":"2023-05-21T16:54:19.955462+0000","last_fullsized":"2023-05-21T16:54:19.955462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151228+0000","last_change":"2023-05-21T16:54:18.177151+0000","last_active":"2023-05-21T16:54:19.151228+0000","last_peered":"2023-05-21T16:54:19.151228+0000","last_clean":"2023-05-21T16:54:19.151228+0000","last_became_active":"2023-05-21T16:54:18.176855+0000","last_became_peered":"2023-05-21T16:54:18.176855+0000","last_unstale":"2023-05-21T16:54:19.151228+0000","last_undegraded":"2023-05-21T16:54:19.151228+0000","last_fullsized":"2023-05-21T16:54:19.151228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011786+0000","last_change":"2023-05-21T16:54:17.797286+0000","last_active":"2023-05-21T16:54:20.011786+0000","last_peered":"2023-05-21T16:54:20.011786+0000","last_clean":"2023-05-21T16:54:20.011786+0000","last_became_active":"2023-05-21T16:54:17.796986+0000","last_became_peered":"2023-05-21T16:54:17.796986+0000","last_unstale":"2023-05-21T16:54:20.011786+0000","last_undegraded":"2023-05-21T16:54:20.011786+0000","last_fullsized":"2023-05-21T16:54:20.011786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231228+0000","last_change":"2023-05-21T16:54:18.178953+0000","last_active":"2023-05-21T16:54:19.231228+0000","last_peered":"2023-05-21T16:54:19.231228+0000","last_clean":"2023-05-21T16:54:19.231228+0000","last_became_active":"2023-05-21T16:54:18.178614+0000","last_became_peered":"2023-05-21T16:54:18.178614+0000","last_unstale":"2023-05-21T16:54:19.231228+0000","last_undegraded":"2023-05-21T16:54:19.231228+0000","last_fullsized":"2023-05-21T16:54:19.231228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:56.406296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154181+0000","last_change":"2023-05-21T16:54:17.788405+0000","last_active":"2023-05-21T16:54:19.154181+0000","last_peered":"2023-05-21T16:54:19.154181+0000","last_clean":"2023-05-21T16:54:19.154181+0000","last_became_active":"2023-05-21T16:54:17.788095+0000","last_became_peered":"2023-05-21T16:54:17.788095+0000","last_unstale":"2023-05-21T16:54:19.154181+0000","last_undegraded":"2023-05-21T16:54:19.154181+0000","last_fullsized":"2023-05-21T16:54:19.154181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231523+0000","last_change":"2023-05-21T16:54:18.171511+0000","last_active":"2023-05-21T16:54:19.231523+0000","last_peered":"2023-05-21T16:54:19.231523+0000","last_clean":"2023-05-21T16:54:19.231523+0000","last_became_active":"2023-05-21T16:54:18.171154+0000","last_became_peered":"2023-05-21T16:54:18.171154+0000","last_unstale":"2023-05-21T16:54:19.231523+0000","last_undegraded":"2023-05-21T16:54:19.231523+0000","last_fullsized":"2023-05-21T16:54:19.231523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:20.770522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230303+0000","last_change":"2023-05-21T16:54:17.786737+0000","last_active":"2023-05-21T16:54:19.230303+0000","last_peered":"2023-05-21T16:54:19.230303+0000","last_clean":"2023-05-21T16:54:19.230303+0000","last_became_active":"2023-05-21T16:54:17.786296+0000","last_became_peered":"2023-05-21T16:54:17.786296+0000","last_unstale":"2023-05-21T16:54:19.230303+0000","last_undegraded":"2023-05-21T16:54:19.230303+0000","last_fullsized":"2023-05-21T16:54:19.230303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230914+0000","last_change":"2023-05-21T16:54:18.174307+0000","last_active":"2023-05-21T16:54:19.230914+0000","last_peered":"2023-05-21T16:54:19.230914+0000","last_clean":"2023-05-21T16:54:19.230914+0000","last_became_active":"2023-05-21T16:54:18.172216+0000","last_became_peered":"2023-05-21T16:54:18.172216+0000","last_unstale":"2023-05-21T16:54:19.230914+0000","last_undegraded":"2023-05-21T16:54:19.230914+0000","last_fullsized":"2023-05-21T16:54:19.230914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009210+0000","last_change":"2023-05-21T16:54:17.789635+0000","last_active":"2023-05-21T16:54:20.009210+0000","last_peered":"2023-05-21T16:54:20.009210+0000","last_clean":"2023-05-21T16:54:20.009210+0000","last_became_active":"2023-05-21T16:54:17.789269+0000","last_became_peered":"2023-05-21T16:54:17.789269+0000","last_unstale":"2023-05-21T16:54:20.009210+0000","last_undegraded":"2023-05-21T16:54:20.009210+0000","last_fullsized":"2023-05-21T16:54:20.009210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010922+0000","last_change":"2023-05-21T16:54:18.172894+0000","last_active":"2023-05-21T16:54:20.010922+0000","last_peered":"2023-05-21T16:54:20.010922+0000","last_clean":"2023-05-21T16:54:20.010922+0000","last_became_active":"2023-05-21T16:54:18.172589+0000","last_became_peered":"2023-05-21T16:54:18.172589+0000","last_unstale":"2023-05-21T16:54:20.010922+0000","last_undegraded":"2023-05-21T16:54:20.010922+0000","last_fullsized":"2023-05-21T16:54:20.010922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152965+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:54:19.152965+0000","last_peered":"2023-05-21T16:54:19.152965+0000","last_clean":"2023-05-21T16:54:19.152965+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:54:19.152965+0000","last_undegraded":"2023-05-21T16:54:19.152965+0000","last_fullsized":"2023-05-21T16:54:19.152965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:58:58.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955263+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:54:19.955263+0000","last_peered":"2023-05-21T16:54:19.955263+0000","last_clean":"2023-05-21T16:54:19.955263+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:54:19.955263+0000","last_undegraded":"2023-05-21T16:54:19.955263+0000","last_fullsized":"2023-05-21T16:54:19.955263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011043+0000","last_change":"2023-05-21T16:54:17.787923+0000","last_active":"2023-05-21T16:54:20.011043+0000","last_peered":"2023-05-21T16:54:20.011043+0000","last_clean":"2023-05-21T16:54:20.011043+0000","last_became_active":"2023-05-21T16:54:17.786954+0000","last_became_peered":"2023-05-21T16:54:17.786954+0000","last_unstale":"2023-05-21T16:54:20.011043+0000","last_undegraded":"2023-05-21T16:54:20.011043+0000","last_fullsized":"2023-05-21T16:54:20.011043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154038+0000","last_change":"2023-05-21T16:54:18.178971+0000","last_active":"2023-05-21T16:54:19.154038+0000","last_peered":"2023-05-21T16:54:19.154038+0000","last_clean":"2023-05-21T16:54:19.154038+0000","last_became_active":"2023-05-21T16:54:18.178660+0000","last_became_peered":"2023-05-21T16:54:18.178660+0000","last_unstale":"2023-05-21T16:54:19.154038+0000","last_undegraded":"2023-05-21T16:54:19.154038+0000","last_fullsized":"2023-05-21T16:54:19.154038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152822+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:54:19.152822+0000","last_peered":"2023-05-21T16:54:19.152822+0000","last_clean":"2023-05-21T16:54:19.152822+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:54:19.152822+0000","last_undegraded":"2023-05-21T16:54:19.152822+0000","last_fullsized":"2023-05-21T16:54:19.152822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:51.273053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151242+0000","last_change":"2023-05-21T16:54:17.789501+0000","last_active":"2023-05-21T16:54:19.151242+0000","last_peered":"2023-05-21T16:54:19.151242+0000","last_clean":"2023-05-21T16:54:19.151242+0000","last_became_active":"2023-05-21T16:54:17.789206+0000","last_became_peered":"2023-05-21T16:54:17.789206+0000","last_unstale":"2023-05-21T16:54:19.151242+0000","last_undegraded":"2023-05-21T16:54:19.151242+0000","last_fullsized":"2023-05-21T16:54:19.151242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:23.152767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151696+0000","last_change":"2023-05-21T16:54:18.177266+0000","last_active":"2023-05-21T16:54:19.151696+0000","last_peered":"2023-05-21T16:54:19.151696+0000","last_clean":"2023-05-21T16:54:19.151696+0000","last_became_active":"2023-05-21T16:54:18.176940+0000","last_became_peered":"2023-05-21T16:54:18.176940+0000","last_unstale":"2023-05-21T16:54:19.151696+0000","last_undegraded":"2023-05-21T16:54:19.151696+0000","last_fullsized":"2023-05-21T16:54:19.151696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507390+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:54:19.507390+0000","last_peered":"2023-05-21T16:54:19.507390+0000","last_clean":"2023-05-21T16:54:19.507390+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:54:19.507390+0000","last_undegraded":"2023-05-21T16:54:19.507390+0000","last_fullsized":"2023-05-21T16:54:19.507390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:33:24.899208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.007932+0000","last_change":"2023-05-21T16:54:17.788365+0000","last_active":"2023-05-21T16:54:20.007932+0000","last_peered":"2023-05-21T16:54:20.007932+0000","last_clean":"2023-05-21T16:54:20.007932+0000","last_became_active":"2023-05-21T16:54:17.788057+0000","last_became_peered":"2023-05-21T16:54:17.788057+0000","last_unstale":"2023-05-21T16:54:20.007932+0000","last_undegraded":"2023-05-21T16:54:20.007932+0000","last_fullsized":"2023-05-21T16:54:20.007932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011232+0000","last_change":"2023-05-21T16:54:18.171962+0000","last_active":"2023-05-21T16:54:20.011232+0000","last_peered":"2023-05-21T16:54:20.011232+0000","last_clean":"2023-05-21T16:54:20.011232+0000","last_became_active":"2023-05-21T16:54:18.171665+0000","last_became_peered":"2023-05-21T16:54:18.171665+0000","last_unstale":"2023-05-21T16:54:20.011232+0000","last_undegraded":"2023-05-21T16:54:20.011232+0000","last_fullsized":"2023-05-21T16:54:20.011232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955100+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:54:19.955100+0000","last_peered":"2023-05-21T16:54:19.955100+0000","last_clean":"2023-05-21T16:54:19.955100+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:54:19.955100+0000","last_undegraded":"2023-05-21T16:54:19.955100+0000","last_fullsized":"2023-05-21T16:54:19.955100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:21.763386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231112+0000","last_change":"2023-05-21T16:54:17.793714+0000","last_active":"2023-05-21T16:54:19.231112+0000","last_peered":"2023-05-21T16:54:19.231112+0000","last_clean":"2023-05-21T16:54:19.231112+0000","last_became_active":"2023-05-21T16:54:17.793497+0000","last_became_peered":"2023-05-21T16:54:17.793497+0000","last_unstale":"2023-05-21T16:54:19.231112+0000","last_undegraded":"2023-05-21T16:54:19.231112+0000","last_fullsized":"2023-05-21T16:54:19.231112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:32.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010033+0000","last_change":"2023-05-21T16:54:18.172642+0000","last_active":"2023-05-21T16:54:20.010033+0000","last_peered":"2023-05-21T16:54:20.010033+0000","last_clean":"2023-05-21T16:54:20.010033+0000","last_became_active":"2023-05-21T16:54:18.172368+0000","last_became_peered":"2023-05-21T16:54:18.172368+0000","last_unstale":"2023-05-21T16:54:20.010033+0000","last_undegraded":"2023-05-21T16:54:20.010033+0000","last_fullsized":"2023-05-21T16:54:20.010033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956342+0000","last_change":"2023-05-21T16:54:17.786742+0000","last_active":"2023-05-21T16:54:19.956342+0000","last_peered":"2023-05-21T16:54:19.956342+0000","last_clean":"2023-05-21T16:54:19.956342+0000","last_became_active":"2023-05-21T16:54:17.785555+0000","last_became_peered":"2023-05-21T16:54:17.785555+0000","last_unstale":"2023-05-21T16:54:19.956342+0000","last_undegraded":"2023-05-21T16:54:19.956342+0000","last_fullsized":"2023-05-21T16:54:19.956342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011595+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:54:20.011595+0000","last_peered":"2023-05-21T16:54:20.011595+0000","last_clean":"2023-05-21T16:54:20.011595+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:54:20.011595+0000","last_undegraded":"2023-05-21T16:54:20.011595+0000","last_fullsized":"2023-05-21T16:54:20.011595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:28.413313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009230+0000","last_change":"2023-05-21T16:54:18.168021+0000","last_active":"2023-05-21T16:54:20.009230+0000","last_peered":"2023-05-21T16:54:20.009230+0000","last_clean":"2023-05-21T16:54:20.009230+0000","last_became_active":"2023-05-21T16:54:18.167737+0000","last_became_peered":"2023-05-21T16:54:18.167737+0000","last_unstale":"2023-05-21T16:54:20.009230+0000","last_undegraded":"2023-05-21T16:54:20.009230+0000","last_fullsized":"2023-05-21T16:54:20.009230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010243+0000","last_change":"2023-05-21T16:54:17.790619+0000","last_active":"2023-05-21T16:54:20.010243+0000","last_peered":"2023-05-21T16:54:20.010243+0000","last_clean":"2023-05-21T16:54:20.010243+0000","last_became_active":"2023-05-21T16:54:17.790299+0000","last_became_peered":"2023-05-21T16:54:17.790299+0000","last_unstale":"2023-05-21T16:54:20.010243+0000","last_undegraded":"2023-05-21T16:54:20.010243+0000","last_fullsized":"2023-05-21T16:54:20.010243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154364+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:54:19.154364+0000","last_peered":"2023-05-21T16:54:19.154364+0000","last_clean":"2023-05-21T16:54:19.154364+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:54:19.154364+0000","last_undegraded":"2023-05-21T16:54:19.154364+0000","last_fullsized":"2023-05-21T16:54:19.154364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:10:31.136089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151575+0000","last_change":"2023-05-21T16:54:18.171071+0000","last_active":"2023-05-21T16:54:19.151575+0000","last_peered":"2023-05-21T16:54:19.151575+0000","last_clean":"2023-05-21T16:54:19.151575+0000","last_became_active":"2023-05-21T16:54:18.170780+0000","last_became_peered":"2023-05-21T16:54:18.170780+0000","last_unstale":"2023-05-21T16:54:19.151575+0000","last_undegraded":"2023-05-21T16:54:19.151575+0000","last_fullsized":"2023-05-21T16:54:19.151575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011773+0000","last_change":"2023-05-21T16:54:17.797231+0000","last_active":"2023-05-21T16:54:20.011773+0000","last_peered":"2023-05-21T16:54:20.011773+0000","last_clean":"2023-05-21T16:54:20.011773+0000","last_became_active":"2023-05-21T16:54:17.796914+0000","last_became_peered":"2023-05-21T16:54:17.796914+0000","last_unstale":"2023-05-21T16:54:20.011773+0000","last_undegraded":"2023-05-21T16:54:20.011773+0000","last_fullsized":"2023-05-21T16:54:20.011773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:56.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010479+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:54:20.010479+0000","last_peered":"2023-05-21T16:54:20.010479+0000","last_clean":"2023-05-21T16:54:20.010479+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:54:20.010479+0000","last_undegraded":"2023-05-21T16:54:20.010479+0000","last_fullsized":"2023-05-21T16:54:20.010479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008889+0000","last_change":"2023-05-21T16:54:18.165428+0000","last_active":"2023-05-21T16:54:20.008889+0000","last_peered":"2023-05-21T16:54:20.008889+0000","last_clean":"2023-05-21T16:54:20.008889+0000","last_became_active":"2023-05-21T16:54:18.164994+0000","last_became_peered":"2023-05-21T16:54:18.164994+0000","last_unstale":"2023-05-21T16:54:20.008889+0000","last_undegraded":"2023-05-21T16:54:20.008889+0000","last_fullsized":"2023-05-21T16:54:20.008889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151685+0000","last_change":"2023-05-21T16:54:17.789570+0000","last_active":"2023-05-21T16:54:19.151685+0000","last_peered":"2023-05-21T16:54:19.151685+0000","last_clean":"2023-05-21T16:54:19.151685+0000","last_became_active":"2023-05-21T16:54:17.789267+0000","last_became_peered":"2023-05-21T16:54:17.789267+0000","last_unstale":"2023-05-21T16:54:19.151685+0000","last_undegraded":"2023-05-21T16:54:19.151685+0000","last_fullsized":"2023-05-21T16:54:19.151685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:26.101781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154723+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:54:19.154723+0000","last_peered":"2023-05-21T16:54:19.154723+0000","last_clean":"2023-05-21T16:54:19.154723+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:54:19.154723+0000","last_undegraded":"2023-05-21T16:54:19.154723+0000","last_fullsized":"2023-05-21T16:54:19.154723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:02.287898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230335+0000","last_change":"2023-05-21T16:54:18.171372+0000","last_active":"2023-05-21T16:54:19.230335+0000","last_peered":"2023-05-21T16:54:19.230335+0000","last_clean":"2023-05-21T16:54:19.230335+0000","last_became_active":"2023-05-21T16:54:18.171041+0000","last_became_peered":"2023-05-21T16:54:18.171041+0000","last_unstale":"2023-05-21T16:54:19.230335+0000","last_undegraded":"2023-05-21T16:54:19.230335+0000","last_fullsized":"2023-05-21T16:54:19.230335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230870+0000","last_change":"2023-05-21T16:54:18.171452+0000","last_active":"2023-05-21T16:54:19.230870+0000","last_peered":"2023-05-21T16:54:19.230870+0000","last_clean":"2023-05-21T16:54:19.230870+0000","last_became_active":"2023-05-21T16:54:18.170959+0000","last_became_peered":"2023-05-21T16:54:18.170959+0000","last_unstale":"2023-05-21T16:54:19.230870+0000","last_undegraded":"2023-05-21T16:54:19.230870+0000","last_fullsized":"2023-05-21T16:54:19.230870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231346+0000","last_change":"2023-05-21T16:54:17.791905+0000","last_active":"2023-05-21T16:54:19.231346+0000","last_peered":"2023-05-21T16:54:19.231346+0000","last_clean":"2023-05-21T16:54:19.231346+0000","last_became_active":"2023-05-21T16:54:17.791648+0000","last_became_peered":"2023-05-21T16:54:17.791648+0000","last_unstale":"2023-05-21T16:54:19.231346+0000","last_undegraded":"2023-05-21T16:54:19.231346+0000","last_fullsized":"2023-05-21T16:54:19.231346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:43.421675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008777+0000","last_change":"2023-05-21T16:54:18.173713+0000","last_active":"2023-05-21T16:54:20.008777+0000","last_peered":"2023-05-21T16:54:20.008777+0000","last_clean":"2023-05-21T16:54:20.008777+0000","last_became_active":"2023-05-21T16:54:18.173426+0000","last_became_peered":"2023-05-21T16:54:18.173426+0000","last_unstale":"2023-05-21T16:54:20.008777+0000","last_undegraded":"2023-05-21T16:54:20.008777+0000","last_fullsized":"2023-05-21T16:54:20.008777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153630+0000","last_change":"2023-05-21T16:54:17.792289+0000","last_active":"2023-05-21T16:54:19.153630+0000","last_peered":"2023-05-21T16:54:19.153630+0000","last_clean":"2023-05-21T16:54:19.153630+0000","last_became_active":"2023-05-21T16:54:17.791948+0000","last_became_peered":"2023-05-21T16:54:17.791948+0000","last_unstale":"2023-05-21T16:54:19.153630+0000","last_undegraded":"2023-05-21T16:54:19.153630+0000","last_fullsized":"2023-05-21T16:54:19.153630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:07:52.585290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955638+0000","last_change":"2023-05-21T16:54:17.793117+0000","last_active":"2023-05-21T16:54:19.955638+0000","last_peered":"2023-05-21T16:54:19.955638+0000","last_clean":"2023-05-21T16:54:19.955638+0000","last_became_active":"2023-05-21T16:54:17.792787+0000","last_became_peered":"2023-05-21T16:54:17.792787+0000","last_unstale":"2023-05-21T16:54:19.955638+0000","last_undegraded":"2023-05-21T16:54:19.955638+0000","last_fullsized":"2023-05-21T16:54:19.955638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:55.401719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009694+0000","last_change":"2023-05-21T16:54:18.170857+0000","last_active":"2023-05-21T16:54:20.009694+0000","last_peered":"2023-05-21T16:54:20.009694+0000","last_clean":"2023-05-21T16:54:20.009694+0000","last_became_active":"2023-05-21T16:54:18.170581+0000","last_became_peered":"2023-05-21T16:54:18.170581+0000","last_unstale":"2023-05-21T16:54:20.009694+0000","last_undegraded":"2023-05-21T16:54:20.009694+0000","last_fullsized":"2023-05-21T16:54:20.009694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151922+0000","last_change":"2023-05-21T16:54:17.786946+0000","last_active":"2023-05-21T16:54:19.151922+0000","last_peered":"2023-05-21T16:54:19.151922+0000","last_clean":"2023-05-21T16:54:19.151922+0000","last_became_active":"2023-05-21T16:54:17.786198+0000","last_became_peered":"2023-05-21T16:54:17.786198+0000","last_unstale":"2023-05-21T16:54:19.151922+0000","last_undegraded":"2023-05-21T16:54:19.151922+0000","last_fullsized":"2023-05-21T16:54:19.151922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:09.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008455+0000","last_change":"2023-05-21T16:54:18.169451+0000","last_active":"2023-05-21T16:54:20.008455+0000","last_peered":"2023-05-21T16:54:20.008455+0000","last_clean":"2023-05-21T16:54:20.008455+0000","last_became_active":"2023-05-21T16:54:18.169174+0000","last_became_peered":"2023-05-21T16:54:18.169174+0000","last_unstale":"2023-05-21T16:54:20.008455+0000","last_undegraded":"2023-05-21T16:54:20.008455+0000","last_fullsized":"2023-05-21T16:54:20.008455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154470+0000","last_change":"2023-05-21T16:54:18.168251+0000","last_active":"2023-05-21T16:54:19.154470+0000","last_peered":"2023-05-21T16:54:19.154470+0000","last_clean":"2023-05-21T16:54:19.154470+0000","last_became_active":"2023-05-21T16:54:18.167942+0000","last_became_peered":"2023-05-21T16:54:18.167942+0000","last_unstale":"2023-05-21T16:54:19.154470+0000","last_undegraded":"2023-05-21T16:54:19.154470+0000","last_fullsized":"2023-05-21T16:54:19.154470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008745+0000","last_change":"2023-05-21T16:54:17.797264+0000","last_active":"2023-05-21T16:54:20.008745+0000","last_peered":"2023-05-21T16:54:20.008745+0000","last_clean":"2023-05-21T16:54:20.008745+0000","last_became_active":"2023-05-21T16:54:17.796966+0000","last_became_peered":"2023-05-21T16:54:17.796966+0000","last_unstale":"2023-05-21T16:54:20.008745+0000","last_undegraded":"2023-05-21T16:54:20.008745+0000","last_fullsized":"2023-05-21T16:54:20.008745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:06.416563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151506+0000","last_change":"2023-05-21T16:54:18.171476+0000","last_active":"2023-05-21T16:54:19.151506+0000","last_peered":"2023-05-21T16:54:19.151506+0000","last_clean":"2023-05-21T16:54:19.151506+0000","last_became_active":"2023-05-21T16:54:18.171200+0000","last_became_peered":"2023-05-21T16:54:18.171200+0000","last_unstale":"2023-05-21T16:54:19.151506+0000","last_undegraded":"2023-05-21T16:54:19.151506+0000","last_fullsized":"2023-05-21T16:54:19.151506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008926+0000","last_change":"2023-05-21T16:54:17.791998+0000","last_active":"2023-05-21T16:54:20.008926+0000","last_peered":"2023-05-21T16:54:20.008926+0000","last_clean":"2023-05-21T16:54:20.008926+0000","last_became_active":"2023-05-21T16:54:17.791713+0000","last_became_peered":"2023-05-21T16:54:17.791713+0000","last_unstale":"2023-05-21T16:54:20.008926+0000","last_undegraded":"2023-05-21T16:54:20.008926+0000","last_fullsized":"2023-05-21T16:54:20.008926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011837+0000","last_change":"2023-05-21T16:54:18.169485+0000","last_active":"2023-05-21T16:54:20.011837+0000","last_peered":"2023-05-21T16:54:20.011837+0000","last_clean":"2023-05-21T16:54:20.011837+0000","last_became_active":"2023-05-21T16:54:18.169213+0000","last_became_peered":"2023-05-21T16:54:18.169213+0000","last_unstale":"2023-05-21T16:54:20.011837+0000","last_undegraded":"2023-05-21T16:54:20.011837+0000","last_fullsized":"2023-05-21T16:54:20.011837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230735+0000","last_change":"2023-05-21T16:54:17.789625+0000","last_active":"2023-05-21T16:54:19.230735+0000","last_peered":"2023-05-21T16:54:19.230735+0000","last_clean":"2023-05-21T16:54:19.230735+0000","last_became_active":"2023-05-21T16:54:17.789405+0000","last_became_peered":"2023-05-21T16:54:17.789405+0000","last_unstale":"2023-05-21T16:54:19.230735+0000","last_undegraded":"2023-05-21T16:54:19.230735+0000","last_fullsized":"2023-05-21T16:54:19.230735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:25.892052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.508051+0000","last_change":"2023-05-21T16:54:18.177566+0000","last_active":"2023-05-21T16:54:19.508051+0000","last_peered":"2023-05-21T16:54:19.508051+0000","last_clean":"2023-05-21T16:54:19.508051+0000","last_became_active":"2023-05-21T16:54:18.177265+0000","last_became_peered":"2023-05-21T16:54:18.177265+0000","last_unstale":"2023-05-21T16:54:19.508051+0000","last_undegraded":"2023-05-21T16:54:19.508051+0000","last_fullsized":"2023-05-21T16:54:19.508051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151553+0000","last_change":"2023-05-21T16:54:17.789123+0000","last_active":"2023-05-21T16:54:19.151553+0000","last_peered":"2023-05-21T16:54:19.151553+0000","last_clean":"2023-05-21T16:54:19.151553+0000","last_became_active":"2023-05-21T16:54:17.788842+0000","last_became_peered":"2023-05-21T16:54:17.788842+0000","last_unstale":"2023-05-21T16:54:19.151553+0000","last_undegraded":"2023-05-21T16:54:19.151553+0000","last_fullsized":"2023-05-21T16:54:19.151553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:26.181658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230869+0000","last_change":"2023-05-21T16:54:18.179233+0000","last_active":"2023-05-21T16:54:19.230869+0000","last_peered":"2023-05-21T16:54:19.230869+0000","last_clean":"2023-05-21T16:54:19.230869+0000","last_became_active":"2023-05-21T16:54:18.178643+0000","last_became_peered":"2023-05-21T16:54:18.178643+0000","last_unstale":"2023-05-21T16:54:19.230869+0000","last_undegraded":"2023-05-21T16:54:19.230869+0000","last_fullsized":"2023-05-21T16:54:19.230869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955235+0000","last_change":"2023-05-21T16:54:17.786129+0000","last_active":"2023-05-21T16:54:19.955235+0000","last_peered":"2023-05-21T16:54:19.955235+0000","last_clean":"2023-05-21T16:54:19.955235+0000","last_became_active":"2023-05-21T16:54:17.785487+0000","last_became_peered":"2023-05-21T16:54:17.785487+0000","last_unstale":"2023-05-21T16:54:19.955235+0000","last_undegraded":"2023-05-21T16:54:19.955235+0000","last_fullsized":"2023-05-21T16:54:19.955235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230365+0000","last_change":"2023-05-21T16:54:18.175866+0000","last_active":"2023-05-21T16:54:19.230365+0000","last_peered":"2023-05-21T16:54:19.230365+0000","last_clean":"2023-05-21T16:54:19.230365+0000","last_became_active":"2023-05-21T16:54:18.175140+0000","last_became_peered":"2023-05-21T16:54:18.175140+0000","last_unstale":"2023-05-21T16:54:19.230365+0000","last_undegraded":"2023-05-21T16:54:19.230365+0000","last_fullsized":"2023-05-21T16:54:19.230365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956206+0000","last_change":"2023-05-21T16:54:17.786929+0000","last_active":"2023-05-21T16:54:19.956206+0000","last_peered":"2023-05-21T16:54:19.956206+0000","last_clean":"2023-05-21T16:54:19.956206+0000","last_became_active":"2023-05-21T16:54:17.786470+0000","last_became_peered":"2023-05-21T16:54:17.786470+0000","last_unstale":"2023-05-21T16:54:19.956206+0000","last_undegraded":"2023-05-21T16:54:19.956206+0000","last_fullsized":"2023-05-21T16:54:19.956206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:42.194752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010107+0000","last_change":"2023-05-21T16:54:18.173334+0000","last_active":"2023-05-21T16:54:20.010107+0000","last_peered":"2023-05-21T16:54:20.010107+0000","last_clean":"2023-05-21T16:54:20.010107+0000","last_became_active":"2023-05-21T16:54:18.173027+0000","last_became_peered":"2023-05-21T16:54:18.173027+0000","last_unstale":"2023-05-21T16:54:20.010107+0000","last_undegraded":"2023-05-21T16:54:20.010107+0000","last_fullsized":"2023-05-21T16:54:20.010107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010797+0000","last_change":"2023-05-21T16:54:17.788520+0000","last_active":"2023-05-21T16:54:20.010797+0000","last_peered":"2023-05-21T16:54:20.010797+0000","last_clean":"2023-05-21T16:54:20.010797+0000","last_became_active":"2023-05-21T16:54:17.788210+0000","last_became_peered":"2023-05-21T16:54:17.788210+0000","last_unstale":"2023-05-21T16:54:20.010797+0000","last_undegraded":"2023-05-21T16:54:20.010797+0000","last_fullsized":"2023-05-21T16:54:20.010797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229927+0000","last_change":"2023-05-21T16:54:18.175394+0000","last_active":"2023-05-21T16:54:19.229927+0000","last_peered":"2023-05-21T16:54:19.229927+0000","last_clean":"2023-05-21T16:54:19.229927+0000","last_became_active":"2023-05-21T16:54:18.174764+0000","last_became_peered":"2023-05-21T16:54:18.174764+0000","last_unstale":"2023-05-21T16:54:19.229927+0000","last_undegraded":"2023-05-21T16:54:19.229927+0000","last_fullsized":"2023-05-21T16:54:19.229927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151863+0000","last_change":"2023-05-21T16:54:17.786133+0000","last_active":"2023-05-21T16:54:19.151863+0000","last_peered":"2023-05-21T16:54:19.151863+0000","last_clean":"2023-05-21T16:54:19.151863+0000","last_became_active":"2023-05-21T16:54:17.785810+0000","last_became_peered":"2023-05-21T16:54:17.785810+0000","last_unstale":"2023-05-21T16:54:19.151863+0000","last_undegraded":"2023-05-21T16:54:19.151863+0000","last_fullsized":"2023-05-21T16:54:19.151863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:34.911070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12164,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359676,"statfs":{"total":96636764160,"available":96624308224,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12096,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359744,"statfs":{"total":96636764160,"available":96624377856,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12160,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359680,"statfs":{"total":96636764160,"available":96624312320,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13256,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358584,"statfs":{"total":96636764160,"available":96623190016,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:54:25.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:54:26.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 Processor -- start 2023-05-21T16:54:26.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- start start 2023-05-21T16:54:26.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408006c760 0x7f408015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f408015dbb0 0x7f408006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4080069f80 0x7f408006a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408006b9d0 con 0x7f408015dbb0 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408006b450 con 0x7f4080069f80 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4080159a90 con 0x7f408006c760 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f408015dbb0 0x7f408006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f408015dbb0 0x7f408006cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34762/0 (socket says 172.21.15.46:34762) 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 -- 172.21.15.46:0/3127658355 learned_addr learned my addr 172.21.15.46:0/3127658355 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:26.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407f7fe700 1 --2- 172.21.15.46:0/3127658355 >> v2:172.21.15.142:3300/0 conn(0x7f4080069f80 0x7f408006a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407effd700 1 --2- 172.21.15.46:0/3127658355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408006c760 0x7f408015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 -- 172.21.15.46:0/3127658355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408006c760 msgr2=0x7f408015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 --2- 172.21.15.46:0/3127658355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408006c760 0x7f408015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 -- 172.21.15.46:0/3127658355 >> v2:172.21.15.142:3300/0 conn(0x7f4080069f80 msgr2=0x7f408006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 --2- 172.21.15.46:0/3127658355 >> v2:172.21.15.142:3300/0 conn(0x7f4080069f80 0x7f408006a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 -- 172.21.15.46:0/3127658355 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408006d070 con 0x7f408015dbb0 2023-05-21T16:54:26.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407f7fe700 1 --2- 172.21.15.46:0/3127658355 >> v2:172.21.15.142:3300/0 conn(0x7f4080069f80 0x7f408006a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:26.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407e7fc700 1 --2- 172.21.15.46:0/3127658355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408015dbb0 0x7f408006cb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f40800cc4d0 tx=0x7f406800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d715fd646d139d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407dffb700 1 -- 172.21.15.46:0/3127658355 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800dd90 con 0x7f408015dbb0 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407dffb700 1 -- 172.21.15.46:0/3127658355 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4068010470 con 0x7f408015dbb0 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407dffb700 1 -- 172.21.15.46:0/3127658355 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068010800 con 0x7f408015dbb0 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- 172.21.15.46:0/3127658355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408015dbb0 msgr2=0x7f408006cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- 172.21.15.46:0/3127658355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408015dbb0 0x7f408006cb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f40800cc4d0 tx=0x7f406800be90 comp rx=0 tx=0).stop 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- 172.21.15.46:0/3127658355 shutdown_connections 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- 172.21.15.46:0/3127658355 >> v2:172.21.15.142:3300/0 conn(0x7f4080069f80 0x7f408006a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- 172.21.15.46:0/3127658355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408015dbb0 0x7f408006cb30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 --2- 172.21.15.46:0/3127658355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408006c760 0x7f408015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- 172.21.15.46:0/3127658355 >> 172.21.15.46:0/3127658355 conn(0x7f40800cf720 msgr2=0x7f40800cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:26.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- 172.21.15.46:0/3127658355 shutdown_connections 2023-05-21T16:54:26.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.073+0000 7f407ffff700 1 -- 172.21.15.46:0/3127658355 wait complete. 2023-05-21T16:54:26.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 Processor -- start 2023-05-21T16:54:26.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 -- start start 2023-05-21T16:54:26.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 0x7f40800b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408006c760 0x7f408015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408015dbb0 0x7f4080152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c6f00 con 0x7f4080069f80 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c71e0 con 0x7f408006c760 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c74c0 con 0x7f408015dbb0 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 0x7f40800b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 0x7f40800b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34768/0 (socket says 172.21.15.46:34768) 2023-05-21T16:54:26.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 -- 172.21.15.46:0/3723960136 learned_addr learned my addr 172.21.15.46:0/3723960136 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:26.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407e7fc700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408006c760 0x7f408015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407f7fe700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408015dbb0 0x7f4080152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 -- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408015dbb0 msgr2=0x7f4080152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408015dbb0 0x7f4080152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 -- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408006c760 msgr2=0x7f408015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408006c760 0x7f408015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.077+0000 7f407effd700 1 -- 172.21.15.46:0/3723960136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406800b810 con 0x7f4080069f80 2023-05-21T16:54:26.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f407effd700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 0x7f40800b18e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f407000e760 tx=0x7f407000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000c070 con 0x7f4080069f80 2023-05-21T16:54:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4070013610 con 0x7f4080069f80 2023-05-21T16:54:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4080159d50 con 0x7f4080069f80 2023-05-21T16:54:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070013980 con 0x7f4080069f80 2023-05-21T16:54:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408006b6f0 con 0x7f4080069f80 2023-05-21T16:54:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.081+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408015a030 con 0x7f4080069f80 2023-05-21T16:54:26.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.085+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4070013ae0 con 0x7f4080069f80 2023-05-21T16:54:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.085+0000 7f40777fe700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40600662f0 0x7f40600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.085+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40700839d0 con 0x7f4080069f80 2023-05-21T16:54:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.085+0000 7f407e7fc700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40600662f0 0x7f40600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.085+0000 7f407e7fc700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40600662f0 0x7f40600687a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f406800bfd0 tx=0x7f4068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.093+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4070054970 con 0x7f4080069f80 2023-05-21T16:54:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.249+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40800c7040 con 0x7f40600662f0 2023-05-21T16:54:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.257+0000 7f40777fe700 1 -- 172.21.15.46:0/3723960136 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286618 (secure 0 0 0) 0x7f40800c7040 con 0x7f40600662f0 2023-05-21T16:54:26.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:26.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40600662f0 msgr2=0x7f40600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40600662f0 0x7f40600687a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f406800bfd0 tx=0x7f4068008040 comp rx=0 tx=0).stop 2023-05-21T16:54:26.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 msgr2=0x7f40800b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 0x7f40800b18e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f407000e760 tx=0x7f407000ea70 comp rx=0 tx=0).stop 2023-05-21T16:54:26.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 shutdown_connections 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40600662f0 0x7f40600687a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408015dbb0 0x7f4080152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408006c760 0x7f408015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 --2- 172.21.15.46:0/3723960136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4080069f80 0x7f40800b18e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 >> 172.21.15.46:0/3723960136 conn(0x7f40800cf720 msgr2=0x7f40800ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 shutdown_connections 2023-05-21T16:54:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.261+0000 7f407ffff700 1 -- 172.21.15.46:0/3723960136 wait complete. 2023-05-21T16:54:26.270 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:54:26.278 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-05-21T16:54:24.784517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82888,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":79616,"kb_avail":754891832,"statfs":{"total":773094113280,"available":773009235968,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81526784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.020128"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507946+0000","last_change":"2023-05-21T16:54:18.173535+0000","last_active":"2023-05-21T16:54:19.507946+0000","last_peered":"2023-05-21T16:54:19.507946+0000","last_clean":"2023-05-21T16:54:19.507946+0000","last_became_active":"2023-05-21T16:54:18.172985+0000","last_became_peered":"2023-05-21T16:54:18.172985+0000","last_unstale":"2023-05-21T16:54:19.507946+0000","last_undegraded":"2023-05-21T16:54:19.507946+0000","last_fullsized":"2023-05-21T16:54:19.507946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:03:41.302203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955404+0000","last_change":"2023-05-21T16:54:18.168645+0000","last_active":"2023-05-21T16:54:19.955404+0000","last_peered":"2023-05-21T16:54:19.955404+0000","last_clean":"2023-05-21T16:54:19.955404+0000","last_became_active":"2023-05-21T16:54:18.168325+0000","last_became_peered":"2023-05-21T16:54:18.168325+0000","last_unstale":"2023-05-21T16:54:19.955404+0000","last_undegraded":"2023-05-21T16:54:19.955404+0000","last_fullsized":"2023-05-21T16:54:19.955404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231233+0000","last_change":"2023-05-21T16:54:18.174946+0000","last_active":"2023-05-21T16:54:19.231233+0000","last_peered":"2023-05-21T16:54:19.231233+0000","last_clean":"2023-05-21T16:54:19.231233+0000","last_became_active":"2023-05-21T16:54:18.174596+0000","last_became_peered":"2023-05-21T16:54:18.174596+0000","last_unstale":"2023-05-21T16:54:19.231233+0000","last_undegraded":"2023-05-21T16:54:19.231233+0000","last_fullsized":"2023-05-21T16:54:19.231233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153865+0000","last_change":"2023-05-21T16:54:18.168066+0000","last_active":"2023-05-21T16:54:19.153865+0000","last_peered":"2023-05-21T16:54:19.153865+0000","last_clean":"2023-05-21T16:54:19.153865+0000","last_became_active":"2023-05-21T16:54:18.167782+0000","last_became_peered":"2023-05-21T16:54:18.167782+0000","last_unstale":"2023-05-21T16:54:19.153865+0000","last_undegraded":"2023-05-21T16:54:19.153865+0000","last_fullsized":"2023-05-21T16:54:19.153865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:39:57.359288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151402+0000","last_change":"2023-05-21T16:54:18.179965+0000","last_active":"2023-05-21T16:54:19.151402+0000","last_peered":"2023-05-21T16:54:19.151402+0000","last_clean":"2023-05-21T16:54:19.151402+0000","last_became_active":"2023-05-21T16:54:18.179618+0000","last_became_peered":"2023-05-21T16:54:18.179618+0000","last_unstale":"2023-05-21T16:54:19.151402+0000","last_undegraded":"2023-05-21T16:54:19.151402+0000","last_fullsized":"2023-05-21T16:54:19.151402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230210+0000","last_change":"2023-05-21T16:54:18.174594+0000","last_active":"2023-05-21T16:54:19.230210+0000","last_peered":"2023-05-21T16:54:19.230210+0000","last_clean":"2023-05-21T16:54:19.230210+0000","last_became_active":"2023-05-21T16:54:18.170519+0000","last_became_peered":"2023-05-21T16:54:18.170519+0000","last_unstale":"2023-05-21T16:54:19.230210+0000","last_undegraded":"2023-05-21T16:54:19.230210+0000","last_fullsized":"2023-05-21T16:54:19.230210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152878+0000","last_change":"2023-05-21T16:54:18.169270+0000","last_active":"2023-05-21T16:54:19.152878+0000","last_peered":"2023-05-21T16:54:19.152878+0000","last_clean":"2023-05-21T16:54:19.152878+0000","last_became_active":"2023-05-21T16:54:18.168977+0000","last_became_peered":"2023-05-21T16:54:18.168977+0000","last_unstale":"2023-05-21T16:54:19.152878+0000","last_undegraded":"2023-05-21T16:54:19.152878+0000","last_fullsized":"2023-05-21T16:54:19.152878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954983+0000","last_change":"2023-05-21T16:54:18.165262+0000","last_active":"2023-05-21T16:54:19.954983+0000","last_peered":"2023-05-21T16:54:19.954983+0000","last_clean":"2023-05-21T16:54:19.954983+0000","last_became_active":"2023-05-21T16:54:18.164916+0000","last_became_peered":"2023-05-21T16:54:18.164916+0000","last_unstale":"2023-05-21T16:54:19.954983+0000","last_undegraded":"2023-05-21T16:54:19.954983+0000","last_fullsized":"2023-05-21T16:54:19.954983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151737+0000","last_change":"2023-05-21T16:54:18.174319+0000","last_active":"2023-05-21T16:54:19.151737+0000","last_peered":"2023-05-21T16:54:19.151737+0000","last_clean":"2023-05-21T16:54:19.151737+0000","last_became_active":"2023-05-21T16:54:18.174006+0000","last_became_peered":"2023-05-21T16:54:18.174006+0000","last_unstale":"2023-05-21T16:54:19.151737+0000","last_undegraded":"2023-05-21T16:54:19.151737+0000","last_fullsized":"2023-05-21T16:54:19.151737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955479+0000","last_change":"2023-05-21T16:54:18.172783+0000","last_active":"2023-05-21T16:54:19.955479+0000","last_peered":"2023-05-21T16:54:19.955479+0000","last_clean":"2023-05-21T16:54:19.955479+0000","last_became_active":"2023-05-21T16:54:18.172479+0000","last_became_peered":"2023-05-21T16:54:18.172479+0000","last_unstale":"2023-05-21T16:54:19.955479+0000","last_undegraded":"2023-05-21T16:54:19.955479+0000","last_fullsized":"2023-05-21T16:54:19.955479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231502+0000","last_change":"2023-05-21T16:54:18.177992+0000","last_active":"2023-05-21T16:54:19.231502+0000","last_peered":"2023-05-21T16:54:19.231502+0000","last_clean":"2023-05-21T16:54:19.231502+0000","last_became_active":"2023-05-21T16:54:18.177672+0000","last_became_peered":"2023-05-21T16:54:18.177672+0000","last_unstale":"2023-05-21T16:54:19.231502+0000","last_undegraded":"2023-05-21T16:54:19.231502+0000","last_fullsized":"2023-05-21T16:54:19.231502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507861+0000","last_change":"2023-05-21T16:54:18.178845+0000","last_active":"2023-05-21T16:54:19.507861+0000","last_peered":"2023-05-21T16:54:19.507861+0000","last_clean":"2023-05-21T16:54:19.507861+0000","last_became_active":"2023-05-21T16:54:18.178443+0000","last_became_peered":"2023-05-21T16:54:18.178443+0000","last_unstale":"2023-05-21T16:54:19.507861+0000","last_undegraded":"2023-05-21T16:54:19.507861+0000","last_fullsized":"2023-05-21T16:54:19.507861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:04.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507567+0000","last_change":"2023-05-21T16:54:18.173619+0000","last_active":"2023-05-21T16:54:19.507567+0000","last_peered":"2023-05-21T16:54:19.507567+0000","last_clean":"2023-05-21T16:54:19.507567+0000","last_became_active":"2023-05-21T16:54:18.173111+0000","last_became_peered":"2023-05-21T16:54:18.173111+0000","last_unstale":"2023-05-21T16:54:19.507567+0000","last_undegraded":"2023-05-21T16:54:19.507567+0000","last_fullsized":"2023-05-21T16:54:19.507567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:59:59.660879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955292+0000","last_change":"2023-05-21T16:54:18.161833+0000","last_active":"2023-05-21T16:54:19.955292+0000","last_peered":"2023-05-21T16:54:19.955292+0000","last_clean":"2023-05-21T16:54:19.955292+0000","last_became_active":"2023-05-21T16:54:18.161537+0000","last_became_peered":"2023-05-21T16:54:18.161537+0000","last_unstale":"2023-05-21T16:54:19.955292+0000","last_undegraded":"2023-05-21T16:54:19.955292+0000","last_fullsized":"2023-05-21T16:54:19.955292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153194+0000","last_change":"2023-05-21T16:54:18.167967+0000","last_active":"2023-05-21T16:54:19.153194+0000","last_peered":"2023-05-21T16:54:19.153194+0000","last_clean":"2023-05-21T16:54:19.153194+0000","last_became_active":"2023-05-21T16:54:18.167679+0000","last_became_peered":"2023-05-21T16:54:18.167679+0000","last_unstale":"2023-05-21T16:54:19.153194+0000","last_undegraded":"2023-05-21T16:54:19.153194+0000","last_fullsized":"2023-05-21T16:54:19.153194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229833+0000","last_change":"2023-05-21T16:54:18.174428+0000","last_active":"2023-05-21T16:54:19.229833+0000","last_peered":"2023-05-21T16:54:19.229833+0000","last_clean":"2023-05-21T16:54:19.229833+0000","last_became_active":"2023-05-21T16:54:18.171683+0000","last_became_peered":"2023-05-21T16:54:18.171683+0000","last_unstale":"2023-05-21T16:54:19.229833+0000","last_undegraded":"2023-05-21T16:54:19.229833+0000","last_fullsized":"2023-05-21T16:54:19.229833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151801+0000","last_change":"2023-05-21T16:54:18.174341+0000","last_active":"2023-05-21T16:54:19.151801+0000","last_peered":"2023-05-21T16:54:19.151801+0000","last_clean":"2023-05-21T16:54:19.151801+0000","last_became_active":"2023-05-21T16:54:18.172475+0000","last_became_peered":"2023-05-21T16:54:18.172475+0000","last_unstale":"2023-05-21T16:54:19.151801+0000","last_undegraded":"2023-05-21T16:54:19.151801+0000","last_fullsized":"2023-05-21T16:54:19.151801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230882+0000","last_change":"2023-05-21T16:54:18.172503+0000","last_active":"2023-05-21T16:54:19.230882+0000","last_peered":"2023-05-21T16:54:19.230882+0000","last_clean":"2023-05-21T16:54:19.230882+0000","last_became_active":"2023-05-21T16:54:18.171759+0000","last_became_peered":"2023-05-21T16:54:18.171759+0000","last_unstale":"2023-05-21T16:54:19.230882+0000","last_undegraded":"2023-05-21T16:54:19.230882+0000","last_fullsized":"2023-05-21T16:54:19.230882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507738+0000","last_change":"2023-05-21T16:54:18.177321+0000","last_active":"2023-05-21T16:54:19.507738+0000","last_peered":"2023-05-21T16:54:19.507738+0000","last_clean":"2023-05-21T16:54:19.507738+0000","last_became_active":"2023-05-21T16:54:18.177032+0000","last_became_peered":"2023-05-21T16:54:18.177032+0000","last_unstale":"2023-05-21T16:54:19.507738+0000","last_undegraded":"2023-05-21T16:54:19.507738+0000","last_fullsized":"2023-05-21T16:54:19.507738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:53:28.141995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231058+0000","last_change":"2023-05-21T16:54:18.174907+0000","last_active":"2023-05-21T16:54:19.231058+0000","last_peered":"2023-05-21T16:54:19.231058+0000","last_clean":"2023-05-21T16:54:19.231058+0000","last_became_active":"2023-05-21T16:54:18.174528+0000","last_became_peered":"2023-05-21T16:54:18.174528+0000","last_unstale":"2023-05-21T16:54:19.231058+0000","last_undegraded":"2023-05-21T16:54:19.231058+0000","last_fullsized":"2023-05-21T16:54:19.231058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153215+0000","last_change":"2023-05-21T16:54:18.172031+0000","last_active":"2023-05-21T16:54:19.153215+0000","last_peered":"2023-05-21T16:54:19.153215+0000","last_clean":"2023-05-21T16:54:19.153215+0000","last_became_active":"2023-05-21T16:54:18.170754+0000","last_became_peered":"2023-05-21T16:54:18.170754+0000","last_unstale":"2023-05-21T16:54:19.153215+0000","last_undegraded":"2023-05-21T16:54:19.153215+0000","last_fullsized":"2023-05-21T16:54:19.153215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:43.199329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151032+0000","last_change":"2023-05-21T16:54:18.177700+0000","last_active":"2023-05-21T16:54:19.151032+0000","last_peered":"2023-05-21T16:54:19.151032+0000","last_clean":"2023-05-21T16:54:19.151032+0000","last_became_active":"2023-05-21T16:54:18.177419+0000","last_became_peered":"2023-05-21T16:54:18.177419+0000","last_unstale":"2023-05-21T16:54:19.151032+0000","last_undegraded":"2023-05-21T16:54:19.151032+0000","last_fullsized":"2023-05-21T16:54:19.151032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009407+0000","last_change":"2023-05-21T16:54:18.173893+0000","last_active":"2023-05-21T16:54:20.009407+0000","last_peered":"2023-05-21T16:54:20.009407+0000","last_clean":"2023-05-21T16:54:20.009407+0000","last_became_active":"2023-05-21T16:54:18.173618+0000","last_became_peered":"2023-05-21T16:54:18.173618+0000","last_unstale":"2023-05-21T16:54:20.009407+0000","last_undegraded":"2023-05-21T16:54:20.009407+0000","last_fullsized":"2023-05-21T16:54:20.009407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152740+0000","last_change":"2023-05-21T16:54:18.178690+0000","last_active":"2023-05-21T16:54:19.152740+0000","last_peered":"2023-05-21T16:54:19.152740+0000","last_clean":"2023-05-21T16:54:19.152740+0000","last_became_active":"2023-05-21T16:54:18.178395+0000","last_became_peered":"2023-05-21T16:54:18.178395+0000","last_unstale":"2023-05-21T16:54:19.152740+0000","last_undegraded":"2023-05-21T16:54:19.152740+0000","last_fullsized":"2023-05-21T16:54:19.152740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010601+0000","last_change":"2023-05-21T16:54:18.174128+0000","last_active":"2023-05-21T16:54:20.010601+0000","last_peered":"2023-05-21T16:54:20.010601+0000","last_clean":"2023-05-21T16:54:20.010601+0000","last_became_active":"2023-05-21T16:54:18.173436+0000","last_became_peered":"2023-05-21T16:54:18.173436+0000","last_unstale":"2023-05-21T16:54:20.010601+0000","last_undegraded":"2023-05-21T16:54:20.010601+0000","last_fullsized":"2023-05-21T16:54:20.010601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010387+0000","last_change":"2023-05-21T16:54:18.166373+0000","last_active":"2023-05-21T16:54:20.010387+0000","last_peered":"2023-05-21T16:54:20.010387+0000","last_clean":"2023-05-21T16:54:20.010387+0000","last_became_active":"2023-05-21T16:54:18.166106+0000","last_became_peered":"2023-05-21T16:54:18.166106+0000","last_unstale":"2023-05-21T16:54:20.010387+0000","last_undegraded":"2023-05-21T16:54:20.010387+0000","last_fullsized":"2023-05-21T16:54:20.010387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955908+0000","last_change":"2023-05-21T16:54:18.165081+0000","last_active":"2023-05-21T16:54:19.955908+0000","last_peered":"2023-05-21T16:54:19.955908+0000","last_clean":"2023-05-21T16:54:19.955908+0000","last_became_active":"2023-05-21T16:54:18.164749+0000","last_became_peered":"2023-05-21T16:54:18.164749+0000","last_unstale":"2023-05-21T16:54:19.955908+0000","last_undegraded":"2023-05-21T16:54:19.955908+0000","last_fullsized":"2023-05-21T16:54:19.955908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:59:08.489549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010630+0000","last_change":"2023-05-21T16:54:18.178240+0000","last_active":"2023-05-21T16:54:20.010630+0000","last_peered":"2023-05-21T16:54:20.010630+0000","last_clean":"2023-05-21T16:54:20.010630+0000","last_became_active":"2023-05-21T16:54:18.177953+0000","last_became_peered":"2023-05-21T16:54:18.177953+0000","last_unstale":"2023-05-21T16:54:20.010630+0000","last_undegraded":"2023-05-21T16:54:20.010630+0000","last_fullsized":"2023-05-21T16:54:20.010630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011193+0000","last_change":"2023-05-21T16:54:18.171995+0000","last_active":"2023-05-21T16:54:20.011193+0000","last_peered":"2023-05-21T16:54:20.011193+0000","last_clean":"2023-05-21T16:54:20.011193+0000","last_became_active":"2023-05-21T16:54:18.170850+0000","last_became_peered":"2023-05-21T16:54:18.170850+0000","last_unstale":"2023-05-21T16:54:20.011193+0000","last_undegraded":"2023-05-21T16:54:20.011193+0000","last_fullsized":"2023-05-21T16:54:20.011193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230580+0000","last_change":"2023-05-21T16:54:18.175264+0000","last_active":"2023-05-21T16:54:19.230580+0000","last_peered":"2023-05-21T16:54:19.230580+0000","last_clean":"2023-05-21T16:54:19.230580+0000","last_became_active":"2023-05-21T16:54:18.174923+0000","last_became_peered":"2023-05-21T16:54:18.174923+0000","last_unstale":"2023-05-21T16:54:19.230580+0000","last_undegraded":"2023-05-21T16:54:19.230580+0000","last_fullsized":"2023-05-21T16:54:19.230580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009553+0000","last_change":"2023-05-21T16:54:18.178259+0000","last_active":"2023-05-21T16:54:20.009553+0000","last_peered":"2023-05-21T16:54:20.009553+0000","last_clean":"2023-05-21T16:54:20.009553+0000","last_became_active":"2023-05-21T16:54:18.177972+0000","last_became_peered":"2023-05-21T16:54:18.177972+0000","last_unstale":"2023-05-21T16:54:20.009553+0000","last_undegraded":"2023-05-21T16:54:20.009553+0000","last_fullsized":"2023-05-21T16:54:20.009553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153058+0000","last_change":"2023-05-21T16:54:18.169342+0000","last_active":"2023-05-21T16:54:19.153058+0000","last_peered":"2023-05-21T16:54:19.153058+0000","last_clean":"2023-05-21T16:54:19.153058+0000","last_became_active":"2023-05-21T16:54:18.169078+0000","last_became_peered":"2023-05-21T16:54:18.169078+0000","last_unstale":"2023-05-21T16:54:19.153058+0000","last_undegraded":"2023-05-21T16:54:19.153058+0000","last_fullsized":"2023-05-21T16:54:19.153058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011024+0000","last_change":"2023-05-21T16:54:18.178151+0000","last_active":"2023-05-21T16:54:20.011024+0000","last_peered":"2023-05-21T16:54:20.011024+0000","last_clean":"2023-05-21T16:54:20.011024+0000","last_became_active":"2023-05-21T16:54:18.177832+0000","last_became_peered":"2023-05-21T16:54:18.177832+0000","last_unstale":"2023-05-21T16:54:20.011024+0000","last_undegraded":"2023-05-21T16:54:20.011024+0000","last_fullsized":"2023-05-21T16:54:20.011024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:26.896628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153512+0000","last_change":"2023-05-21T16:54:17.791377+0000","last_active":"2023-05-21T16:54:19.153512+0000","last_peered":"2023-05-21T16:54:19.153512+0000","last_clean":"2023-05-21T16:54:19.153512+0000","last_became_active":"2023-05-21T16:54:17.791033+0000","last_became_peered":"2023-05-21T16:54:17.791033+0000","last_unstale":"2023-05-21T16:54:19.153512+0000","last_undegraded":"2023-05-21T16:54:19.153512+0000","last_fullsized":"2023-05-21T16:54:19.153512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956058+0000","last_change":"2023-05-21T16:54:18.160039+0000","last_active":"2023-05-21T16:54:19.956058+0000","last_peered":"2023-05-21T16:54:19.956058+0000","last_clean":"2023-05-21T16:54:19.956058+0000","last_became_active":"2023-05-21T16:54:18.159784+0000","last_became_peered":"2023-05-21T16:54:18.159784+0000","last_unstale":"2023-05-21T16:54:19.956058+0000","last_undegraded":"2023-05-21T16:54:19.956058+0000","last_fullsized":"2023-05-21T16:54:19.956058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:44.426252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151174+0000","last_change":"2023-05-21T16:54:17.793000+0000","last_active":"2023-05-21T16:54:19.151174+0000","last_peered":"2023-05-21T16:54:19.151174+0000","last_clean":"2023-05-21T16:54:19.151174+0000","last_became_active":"2023-05-21T16:54:17.792628+0000","last_became_peered":"2023-05-21T16:54:17.792628+0000","last_unstale":"2023-05-21T16:54:19.151174+0000","last_undegraded":"2023-05-21T16:54:19.151174+0000","last_fullsized":"2023-05-21T16:54:19.151174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151621+0000","last_change":"2023-05-21T16:54:18.171993+0000","last_active":"2023-05-21T16:54:19.151621+0000","last_peered":"2023-05-21T16:54:19.151621+0000","last_clean":"2023-05-21T16:54:19.151621+0000","last_became_active":"2023-05-21T16:54:18.171691+0000","last_became_peered":"2023-05-21T16:54:18.171691+0000","last_unstale":"2023-05-21T16:54:19.151621+0000","last_undegraded":"2023-05-21T16:54:19.151621+0000","last_fullsized":"2023-05-21T16:54:19.151621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153638+0000","last_change":"2023-05-21T16:54:17.792641+0000","last_active":"2023-05-21T16:54:19.153638+0000","last_peered":"2023-05-21T16:54:19.153638+0000","last_clean":"2023-05-21T16:54:19.153638+0000","last_became_active":"2023-05-21T16:54:17.792197+0000","last_became_peered":"2023-05-21T16:54:17.792197+0000","last_unstale":"2023-05-21T16:54:19.153638+0000","last_undegraded":"2023-05-21T16:54:19.153638+0000","last_fullsized":"2023-05-21T16:54:19.153638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:46:25.331076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011544+0000","last_change":"2023-05-21T16:54:18.171873+0000","last_active":"2023-05-21T16:54:20.011544+0000","last_peered":"2023-05-21T16:54:20.011544+0000","last_clean":"2023-05-21T16:54:20.011544+0000","last_became_active":"2023-05-21T16:54:18.171463+0000","last_became_peered":"2023-05-21T16:54:18.171463+0000","last_unstale":"2023-05-21T16:54:20.011544+0000","last_undegraded":"2023-05-21T16:54:20.011544+0000","last_fullsized":"2023-05-21T16:54:20.011544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:10.479196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153427+0000","last_change":"2023-05-21T16:54:17.793533+0000","last_active":"2023-05-21T16:54:19.153427+0000","last_peered":"2023-05-21T16:54:19.153427+0000","last_clean":"2023-05-21T16:54:19.153427+0000","last_became_active":"2023-05-21T16:54:17.793152+0000","last_became_peered":"2023-05-21T16:54:17.793152+0000","last_unstale":"2023-05-21T16:54:19.153427+0000","last_undegraded":"2023-05-21T16:54:19.153427+0000","last_fullsized":"2023-05-21T16:54:19.153427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:40:00.667703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154574+0000","last_change":"2023-05-21T16:54:17.792133+0000","last_active":"2023-05-21T16:54:19.154574+0000","last_peered":"2023-05-21T16:54:19.154574+0000","last_clean":"2023-05-21T16:54:19.154574+0000","last_became_active":"2023-05-21T16:54:17.791681+0000","last_became_peered":"2023-05-21T16:54:17.791681+0000","last_unstale":"2023-05-21T16:54:19.154574+0000","last_undegraded":"2023-05-21T16:54:19.154574+0000","last_fullsized":"2023-05-21T16:54:19.154574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:46:05.629379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.954986+0000","last_change":"2023-05-21T16:54:18.159536+0000","last_active":"2023-05-21T16:54:19.954986+0000","last_peered":"2023-05-21T16:54:19.954986+0000","last_clean":"2023-05-21T16:54:19.954986+0000","last_became_active":"2023-05-21T16:54:18.158995+0000","last_became_peered":"2023-05-21T16:54:18.158995+0000","last_unstale":"2023-05-21T16:54:19.954986+0000","last_undegraded":"2023-05-21T16:54:19.954986+0000","last_fullsized":"2023-05-21T16:54:19.954986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153940+0000","last_change":"2023-05-21T16:54:17.791717+0000","last_active":"2023-05-21T16:54:19.153940+0000","last_peered":"2023-05-21T16:54:19.153940+0000","last_clean":"2023-05-21T16:54:19.153940+0000","last_became_active":"2023-05-21T16:54:17.791323+0000","last_became_peered":"2023-05-21T16:54:17.791323+0000","last_unstale":"2023-05-21T16:54:19.153940+0000","last_undegraded":"2023-05-21T16:54:19.153940+0000","last_fullsized":"2023-05-21T16:54:19.153940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:30:06.548887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229939+0000","last_change":"2023-05-21T16:54:18.176794+0000","last_active":"2023-05-21T16:54:19.229939+0000","last_peered":"2023-05-21T16:54:19.229939+0000","last_clean":"2023-05-21T16:54:19.229939+0000","last_became_active":"2023-05-21T16:54:18.176500+0000","last_became_peered":"2023-05-21T16:54:18.176500+0000","last_unstale":"2023-05-21T16:54:19.229939+0000","last_undegraded":"2023-05-21T16:54:19.229939+0000","last_fullsized":"2023-05-21T16:54:19.229939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153977+0000","last_change":"2023-05-21T16:54:17.791693+0000","last_active":"2023-05-21T16:54:19.153977+0000","last_peered":"2023-05-21T16:54:19.153977+0000","last_clean":"2023-05-21T16:54:19.153977+0000","last_became_active":"2023-05-21T16:54:17.790907+0000","last_became_peered":"2023-05-21T16:54:17.790907+0000","last_unstale":"2023-05-21T16:54:19.153977+0000","last_undegraded":"2023-05-21T16:54:19.153977+0000","last_fullsized":"2023-05-21T16:54:19.153977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:48.881822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153098+0000","last_change":"2023-05-21T16:54:18.176109+0000","last_active":"2023-05-21T16:54:19.153098+0000","last_peered":"2023-05-21T16:54:19.153098+0000","last_clean":"2023-05-21T16:54:19.153098+0000","last_became_active":"2023-05-21T16:54:18.175825+0000","last_became_peered":"2023-05-21T16:54:18.175825+0000","last_unstale":"2023-05-21T16:54:19.153098+0000","last_undegraded":"2023-05-21T16:54:19.153098+0000","last_fullsized":"2023-05-21T16:54:19.153098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:16.831930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955462+0000","last_change":"2023-05-21T16:54:17.785136+0000","last_active":"2023-05-21T16:54:19.955462+0000","last_peered":"2023-05-21T16:54:19.955462+0000","last_clean":"2023-05-21T16:54:19.955462+0000","last_became_active":"2023-05-21T16:54:17.784827+0000","last_became_peered":"2023-05-21T16:54:17.784827+0000","last_unstale":"2023-05-21T16:54:19.955462+0000","last_undegraded":"2023-05-21T16:54:19.955462+0000","last_fullsized":"2023-05-21T16:54:19.955462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151228+0000","last_change":"2023-05-21T16:54:18.177151+0000","last_active":"2023-05-21T16:54:19.151228+0000","last_peered":"2023-05-21T16:54:19.151228+0000","last_clean":"2023-05-21T16:54:19.151228+0000","last_became_active":"2023-05-21T16:54:18.176855+0000","last_became_peered":"2023-05-21T16:54:18.176855+0000","last_unstale":"2023-05-21T16:54:19.151228+0000","last_undegraded":"2023-05-21T16:54:19.151228+0000","last_fullsized":"2023-05-21T16:54:19.151228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:07.421140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011786+0000","last_change":"2023-05-21T16:54:17.797286+0000","last_active":"2023-05-21T16:54:20.011786+0000","last_peered":"2023-05-21T16:54:20.011786+0000","last_clean":"2023-05-21T16:54:20.011786+0000","last_became_active":"2023-05-21T16:54:17.796986+0000","last_became_peered":"2023-05-21T16:54:17.796986+0000","last_unstale":"2023-05-21T16:54:20.011786+0000","last_undegraded":"2023-05-21T16:54:20.011786+0000","last_fullsized":"2023-05-21T16:54:20.011786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:20.953657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231228+0000","last_change":"2023-05-21T16:54:18.178953+0000","last_active":"2023-05-21T16:54:19.231228+0000","last_peered":"2023-05-21T16:54:19.231228+0000","last_clean":"2023-05-21T16:54:19.231228+0000","last_became_active":"2023-05-21T16:54:18.178614+0000","last_became_peered":"2023-05-21T16:54:18.178614+0000","last_unstale":"2023-05-21T16:54:19.231228+0000","last_undegraded":"2023-05-21T16:54:19.231228+0000","last_fullsized":"2023-05-21T16:54:19.231228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:56.406296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154181+0000","last_change":"2023-05-21T16:54:17.788405+0000","last_active":"2023-05-21T16:54:19.154181+0000","last_peered":"2023-05-21T16:54:19.154181+0000","last_clean":"2023-05-21T16:54:19.154181+0000","last_became_active":"2023-05-21T16:54:17.788095+0000","last_became_peered":"2023-05-21T16:54:17.788095+0000","last_unstale":"2023-05-21T16:54:19.154181+0000","last_undegraded":"2023-05-21T16:54:19.154181+0000","last_fullsized":"2023-05-21T16:54:19.154181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:32:30.280028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231523+0000","last_change":"2023-05-21T16:54:18.171511+0000","last_active":"2023-05-21T16:54:19.231523+0000","last_peered":"2023-05-21T16:54:19.231523+0000","last_clean":"2023-05-21T16:54:19.231523+0000","last_became_active":"2023-05-21T16:54:18.171154+0000","last_became_peered":"2023-05-21T16:54:18.171154+0000","last_unstale":"2023-05-21T16:54:19.231523+0000","last_undegraded":"2023-05-21T16:54:19.231523+0000","last_fullsized":"2023-05-21T16:54:19.231523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:20.770522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230303+0000","last_change":"2023-05-21T16:54:17.786737+0000","last_active":"2023-05-21T16:54:19.230303+0000","last_peered":"2023-05-21T16:54:19.230303+0000","last_clean":"2023-05-21T16:54:19.230303+0000","last_became_active":"2023-05-21T16:54:17.786296+0000","last_became_peered":"2023-05-21T16:54:17.786296+0000","last_unstale":"2023-05-21T16:54:19.230303+0000","last_undegraded":"2023-05-21T16:54:19.230303+0000","last_fullsized":"2023-05-21T16:54:19.230303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230914+0000","last_change":"2023-05-21T16:54:18.174307+0000","last_active":"2023-05-21T16:54:19.230914+0000","last_peered":"2023-05-21T16:54:19.230914+0000","last_clean":"2023-05-21T16:54:19.230914+0000","last_became_active":"2023-05-21T16:54:18.172216+0000","last_became_peered":"2023-05-21T16:54:18.172216+0000","last_unstale":"2023-05-21T16:54:19.230914+0000","last_undegraded":"2023-05-21T16:54:19.230914+0000","last_fullsized":"2023-05-21T16:54:19.230914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009210+0000","last_change":"2023-05-21T16:54:17.789635+0000","last_active":"2023-05-21T16:54:20.009210+0000","last_peered":"2023-05-21T16:54:20.009210+0000","last_clean":"2023-05-21T16:54:20.009210+0000","last_became_active":"2023-05-21T16:54:17.789269+0000","last_became_peered":"2023-05-21T16:54:17.789269+0000","last_unstale":"2023-05-21T16:54:20.009210+0000","last_undegraded":"2023-05-21T16:54:20.009210+0000","last_fullsized":"2023-05-21T16:54:20.009210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010922+0000","last_change":"2023-05-21T16:54:18.172894+0000","last_active":"2023-05-21T16:54:20.010922+0000","last_peered":"2023-05-21T16:54:20.010922+0000","last_clean":"2023-05-21T16:54:20.010922+0000","last_became_active":"2023-05-21T16:54:18.172589+0000","last_became_peered":"2023-05-21T16:54:18.172589+0000","last_unstale":"2023-05-21T16:54:20.010922+0000","last_undegraded":"2023-05-21T16:54:20.010922+0000","last_fullsized":"2023-05-21T16:54:20.010922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:57.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152965+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:54:19.152965+0000","last_peered":"2023-05-21T16:54:19.152965+0000","last_clean":"2023-05-21T16:54:19.152965+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:54:19.152965+0000","last_undegraded":"2023-05-21T16:54:19.152965+0000","last_fullsized":"2023-05-21T16:54:19.152965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:58:58.129935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955263+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:54:19.955263+0000","last_peered":"2023-05-21T16:54:19.955263+0000","last_clean":"2023-05-21T16:54:19.955263+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:54:19.955263+0000","last_undegraded":"2023-05-21T16:54:19.955263+0000","last_fullsized":"2023-05-21T16:54:19.955263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011043+0000","last_change":"2023-05-21T16:54:17.787923+0000","last_active":"2023-05-21T16:54:20.011043+0000","last_peered":"2023-05-21T16:54:20.011043+0000","last_clean":"2023-05-21T16:54:20.011043+0000","last_became_active":"2023-05-21T16:54:17.786954+0000","last_became_peered":"2023-05-21T16:54:17.786954+0000","last_unstale":"2023-05-21T16:54:20.011043+0000","last_undegraded":"2023-05-21T16:54:20.011043+0000","last_fullsized":"2023-05-21T16:54:20.011043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154038+0000","last_change":"2023-05-21T16:54:18.178971+0000","last_active":"2023-05-21T16:54:19.154038+0000","last_peered":"2023-05-21T16:54:19.154038+0000","last_clean":"2023-05-21T16:54:19.154038+0000","last_became_active":"2023-05-21T16:54:18.178660+0000","last_became_peered":"2023-05-21T16:54:18.178660+0000","last_unstale":"2023-05-21T16:54:19.154038+0000","last_undegraded":"2023-05-21T16:54:19.154038+0000","last_fullsized":"2023-05-21T16:54:19.154038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:09:57.619523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.152822+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:54:19.152822+0000","last_peered":"2023-05-21T16:54:19.152822+0000","last_clean":"2023-05-21T16:54:19.152822+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:54:19.152822+0000","last_undegraded":"2023-05-21T16:54:19.152822+0000","last_fullsized":"2023-05-21T16:54:19.152822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:51.273053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151242+0000","last_change":"2023-05-21T16:54:17.789501+0000","last_active":"2023-05-21T16:54:19.151242+0000","last_peered":"2023-05-21T16:54:19.151242+0000","last_clean":"2023-05-21T16:54:19.151242+0000","last_became_active":"2023-05-21T16:54:17.789206+0000","last_became_peered":"2023-05-21T16:54:17.789206+0000","last_unstale":"2023-05-21T16:54:19.151242+0000","last_undegraded":"2023-05-21T16:54:19.151242+0000","last_fullsized":"2023-05-21T16:54:19.151242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:23.152767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151696+0000","last_change":"2023-05-21T16:54:18.177266+0000","last_active":"2023-05-21T16:54:19.151696+0000","last_peered":"2023-05-21T16:54:19.151696+0000","last_clean":"2023-05-21T16:54:19.151696+0000","last_became_active":"2023-05-21T16:54:18.176940+0000","last_became_peered":"2023-05-21T16:54:18.176940+0000","last_unstale":"2023-05-21T16:54:19.151696+0000","last_undegraded":"2023-05-21T16:54:19.151696+0000","last_fullsized":"2023-05-21T16:54:19.151696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:02.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.507390+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:54:19.507390+0000","last_peered":"2023-05-21T16:54:19.507390+0000","last_clean":"2023-05-21T16:54:19.507390+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:54:19.507390+0000","last_undegraded":"2023-05-21T16:54:19.507390+0000","last_fullsized":"2023-05-21T16:54:19.507390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:33:24.899208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.007932+0000","last_change":"2023-05-21T16:54:17.788365+0000","last_active":"2023-05-21T16:54:20.007932+0000","last_peered":"2023-05-21T16:54:20.007932+0000","last_clean":"2023-05-21T16:54:20.007932+0000","last_became_active":"2023-05-21T16:54:17.788057+0000","last_became_peered":"2023-05-21T16:54:17.788057+0000","last_unstale":"2023-05-21T16:54:20.007932+0000","last_undegraded":"2023-05-21T16:54:20.007932+0000","last_fullsized":"2023-05-21T16:54:20.007932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:45.510606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011232+0000","last_change":"2023-05-21T16:54:18.171962+0000","last_active":"2023-05-21T16:54:20.011232+0000","last_peered":"2023-05-21T16:54:20.011232+0000","last_clean":"2023-05-21T16:54:20.011232+0000","last_became_active":"2023-05-21T16:54:18.171665+0000","last_became_peered":"2023-05-21T16:54:18.171665+0000","last_unstale":"2023-05-21T16:54:20.011232+0000","last_undegraded":"2023-05-21T16:54:20.011232+0000","last_fullsized":"2023-05-21T16:54:20.011232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:57:21.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955100+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:54:19.955100+0000","last_peered":"2023-05-21T16:54:19.955100+0000","last_clean":"2023-05-21T16:54:19.955100+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:54:19.955100+0000","last_undegraded":"2023-05-21T16:54:19.955100+0000","last_fullsized":"2023-05-21T16:54:19.955100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:21.763386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231112+0000","last_change":"2023-05-21T16:54:17.793714+0000","last_active":"2023-05-21T16:54:19.231112+0000","last_peered":"2023-05-21T16:54:19.231112+0000","last_clean":"2023-05-21T16:54:19.231112+0000","last_became_active":"2023-05-21T16:54:17.793497+0000","last_became_peered":"2023-05-21T16:54:17.793497+0000","last_unstale":"2023-05-21T16:54:19.231112+0000","last_undegraded":"2023-05-21T16:54:19.231112+0000","last_fullsized":"2023-05-21T16:54:19.231112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:32.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010033+0000","last_change":"2023-05-21T16:54:18.172642+0000","last_active":"2023-05-21T16:54:20.010033+0000","last_peered":"2023-05-21T16:54:20.010033+0000","last_clean":"2023-05-21T16:54:20.010033+0000","last_became_active":"2023-05-21T16:54:18.172368+0000","last_became_peered":"2023-05-21T16:54:18.172368+0000","last_unstale":"2023-05-21T16:54:20.010033+0000","last_undegraded":"2023-05-21T16:54:20.010033+0000","last_fullsized":"2023-05-21T16:54:20.010033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956342+0000","last_change":"2023-05-21T16:54:17.786742+0000","last_active":"2023-05-21T16:54:19.956342+0000","last_peered":"2023-05-21T16:54:19.956342+0000","last_clean":"2023-05-21T16:54:19.956342+0000","last_became_active":"2023-05-21T16:54:17.785555+0000","last_became_peered":"2023-05-21T16:54:17.785555+0000","last_unstale":"2023-05-21T16:54:19.956342+0000","last_undegraded":"2023-05-21T16:54:19.956342+0000","last_fullsized":"2023-05-21T16:54:19.956342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:38:19.765945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011595+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:54:20.011595+0000","last_peered":"2023-05-21T16:54:20.011595+0000","last_clean":"2023-05-21T16:54:20.011595+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:54:20.011595+0000","last_undegraded":"2023-05-21T16:54:20.011595+0000","last_fullsized":"2023-05-21T16:54:20.011595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:28.413313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009230+0000","last_change":"2023-05-21T16:54:18.168021+0000","last_active":"2023-05-21T16:54:20.009230+0000","last_peered":"2023-05-21T16:54:20.009230+0000","last_clean":"2023-05-21T16:54:20.009230+0000","last_became_active":"2023-05-21T16:54:18.167737+0000","last_became_peered":"2023-05-21T16:54:18.167737+0000","last_unstale":"2023-05-21T16:54:20.009230+0000","last_undegraded":"2023-05-21T16:54:20.009230+0000","last_fullsized":"2023-05-21T16:54:20.009230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010243+0000","last_change":"2023-05-21T16:54:17.790619+0000","last_active":"2023-05-21T16:54:20.010243+0000","last_peered":"2023-05-21T16:54:20.010243+0000","last_clean":"2023-05-21T16:54:20.010243+0000","last_became_active":"2023-05-21T16:54:17.790299+0000","last_became_peered":"2023-05-21T16:54:17.790299+0000","last_unstale":"2023-05-21T16:54:20.010243+0000","last_undegraded":"2023-05-21T16:54:20.010243+0000","last_fullsized":"2023-05-21T16:54:20.010243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154364+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:54:19.154364+0000","last_peered":"2023-05-21T16:54:19.154364+0000","last_clean":"2023-05-21T16:54:19.154364+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:54:19.154364+0000","last_undegraded":"2023-05-21T16:54:19.154364+0000","last_fullsized":"2023-05-21T16:54:19.154364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:10:31.136089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151575+0000","last_change":"2023-05-21T16:54:18.171071+0000","last_active":"2023-05-21T16:54:19.151575+0000","last_peered":"2023-05-21T16:54:19.151575+0000","last_clean":"2023-05-21T16:54:19.151575+0000","last_became_active":"2023-05-21T16:54:18.170780+0000","last_became_peered":"2023-05-21T16:54:18.170780+0000","last_unstale":"2023-05-21T16:54:19.151575+0000","last_undegraded":"2023-05-21T16:54:19.151575+0000","last_fullsized":"2023-05-21T16:54:19.151575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:58.423811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011773+0000","last_change":"2023-05-21T16:54:17.797231+0000","last_active":"2023-05-21T16:54:20.011773+0000","last_peered":"2023-05-21T16:54:20.011773+0000","last_clean":"2023-05-21T16:54:20.011773+0000","last_became_active":"2023-05-21T16:54:17.796914+0000","last_became_peered":"2023-05-21T16:54:17.796914+0000","last_unstale":"2023-05-21T16:54:20.011773+0000","last_undegraded":"2023-05-21T16:54:20.011773+0000","last_fullsized":"2023-05-21T16:54:20.011773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:56.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010479+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:54:20.010479+0000","last_peered":"2023-05-21T16:54:20.010479+0000","last_clean":"2023-05-21T16:54:20.010479+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:54:20.010479+0000","last_undegraded":"2023-05-21T16:54:20.010479+0000","last_fullsized":"2023-05-21T16:54:20.010479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:05.345954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008889+0000","last_change":"2023-05-21T16:54:18.165428+0000","last_active":"2023-05-21T16:54:20.008889+0000","last_peered":"2023-05-21T16:54:20.008889+0000","last_clean":"2023-05-21T16:54:20.008889+0000","last_became_active":"2023-05-21T16:54:18.164994+0000","last_became_peered":"2023-05-21T16:54:18.164994+0000","last_unstale":"2023-05-21T16:54:20.008889+0000","last_undegraded":"2023-05-21T16:54:20.008889+0000","last_fullsized":"2023-05-21T16:54:20.008889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151685+0000","last_change":"2023-05-21T16:54:17.789570+0000","last_active":"2023-05-21T16:54:19.151685+0000","last_peered":"2023-05-21T16:54:19.151685+0000","last_clean":"2023-05-21T16:54:19.151685+0000","last_became_active":"2023-05-21T16:54:17.789267+0000","last_became_peered":"2023-05-21T16:54:17.789267+0000","last_unstale":"2023-05-21T16:54:19.151685+0000","last_undegraded":"2023-05-21T16:54:19.151685+0000","last_fullsized":"2023-05-21T16:54:19.151685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:26.101781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154723+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:54:19.154723+0000","last_peered":"2023-05-21T16:54:19.154723+0000","last_clean":"2023-05-21T16:54:19.154723+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:54:19.154723+0000","last_undegraded":"2023-05-21T16:54:19.154723+0000","last_fullsized":"2023-05-21T16:54:19.154723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:02.287898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230335+0000","last_change":"2023-05-21T16:54:18.171372+0000","last_active":"2023-05-21T16:54:19.230335+0000","last_peered":"2023-05-21T16:54:19.230335+0000","last_clean":"2023-05-21T16:54:19.230335+0000","last_became_active":"2023-05-21T16:54:18.171041+0000","last_became_peered":"2023-05-21T16:54:18.171041+0000","last_unstale":"2023-05-21T16:54:19.230335+0000","last_undegraded":"2023-05-21T16:54:19.230335+0000","last_fullsized":"2023-05-21T16:54:19.230335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230870+0000","last_change":"2023-05-21T16:54:18.171452+0000","last_active":"2023-05-21T16:54:19.230870+0000","last_peered":"2023-05-21T16:54:19.230870+0000","last_clean":"2023-05-21T16:54:19.230870+0000","last_became_active":"2023-05-21T16:54:18.170959+0000","last_became_peered":"2023-05-21T16:54:18.170959+0000","last_unstale":"2023-05-21T16:54:19.230870+0000","last_undegraded":"2023-05-21T16:54:19.230870+0000","last_fullsized":"2023-05-21T16:54:19.230870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:35.915647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.231346+0000","last_change":"2023-05-21T16:54:17.791905+0000","last_active":"2023-05-21T16:54:19.231346+0000","last_peered":"2023-05-21T16:54:19.231346+0000","last_clean":"2023-05-21T16:54:19.231346+0000","last_became_active":"2023-05-21T16:54:17.791648+0000","last_became_peered":"2023-05-21T16:54:17.791648+0000","last_unstale":"2023-05-21T16:54:19.231346+0000","last_undegraded":"2023-05-21T16:54:19.231346+0000","last_fullsized":"2023-05-21T16:54:19.231346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:40:43.421675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008777+0000","last_change":"2023-05-21T16:54:18.173713+0000","last_active":"2023-05-21T16:54:20.008777+0000","last_peered":"2023-05-21T16:54:20.008777+0000","last_clean":"2023-05-21T16:54:20.008777+0000","last_became_active":"2023-05-21T16:54:18.173426+0000","last_became_peered":"2023-05-21T16:54:18.173426+0000","last_unstale":"2023-05-21T16:54:20.008777+0000","last_undegraded":"2023-05-21T16:54:20.008777+0000","last_fullsized":"2023-05-21T16:54:20.008777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:27.186235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.153630+0000","last_change":"2023-05-21T16:54:17.792289+0000","last_active":"2023-05-21T16:54:19.153630+0000","last_peered":"2023-05-21T16:54:19.153630+0000","last_clean":"2023-05-21T16:54:19.153630+0000","last_became_active":"2023-05-21T16:54:17.791948+0000","last_became_peered":"2023-05-21T16:54:17.791948+0000","last_unstale":"2023-05-21T16:54:19.153630+0000","last_undegraded":"2023-05-21T16:54:19.153630+0000","last_fullsized":"2023-05-21T16:54:19.153630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:07:52.585290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955638+0000","last_change":"2023-05-21T16:54:17.793117+0000","last_active":"2023-05-21T16:54:19.955638+0000","last_peered":"2023-05-21T16:54:19.955638+0000","last_clean":"2023-05-21T16:54:19.955638+0000","last_became_active":"2023-05-21T16:54:17.792787+0000","last_became_peered":"2023-05-21T16:54:17.792787+0000","last_unstale":"2023-05-21T16:54:19.955638+0000","last_undegraded":"2023-05-21T16:54:19.955638+0000","last_fullsized":"2023-05-21T16:54:19.955638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:55:55.401719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.009694+0000","last_change":"2023-05-21T16:54:18.170857+0000","last_active":"2023-05-21T16:54:20.009694+0000","last_peered":"2023-05-21T16:54:20.009694+0000","last_clean":"2023-05-21T16:54:20.009694+0000","last_became_active":"2023-05-21T16:54:18.170581+0000","last_became_peered":"2023-05-21T16:54:18.170581+0000","last_unstale":"2023-05-21T16:54:20.009694+0000","last_undegraded":"2023-05-21T16:54:20.009694+0000","last_fullsized":"2023-05-21T16:54:20.009694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:59:02.368188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151922+0000","last_change":"2023-05-21T16:54:17.786946+0000","last_active":"2023-05-21T16:54:19.151922+0000","last_peered":"2023-05-21T16:54:19.151922+0000","last_clean":"2023-05-21T16:54:19.151922+0000","last_became_active":"2023-05-21T16:54:17.786198+0000","last_became_peered":"2023-05-21T16:54:17.786198+0000","last_unstale":"2023-05-21T16:54:19.151922+0000","last_undegraded":"2023-05-21T16:54:19.151922+0000","last_fullsized":"2023-05-21T16:54:19.151922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:09.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008455+0000","last_change":"2023-05-21T16:54:18.169451+0000","last_active":"2023-05-21T16:54:20.008455+0000","last_peered":"2023-05-21T16:54:20.008455+0000","last_clean":"2023-05-21T16:54:20.008455+0000","last_became_active":"2023-05-21T16:54:18.169174+0000","last_became_peered":"2023-05-21T16:54:18.169174+0000","last_unstale":"2023-05-21T16:54:20.008455+0000","last_undegraded":"2023-05-21T16:54:20.008455+0000","last_fullsized":"2023-05-21T16:54:20.008455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.154470+0000","last_change":"2023-05-21T16:54:18.168251+0000","last_active":"2023-05-21T16:54:19.154470+0000","last_peered":"2023-05-21T16:54:19.154470+0000","last_clean":"2023-05-21T16:54:19.154470+0000","last_became_active":"2023-05-21T16:54:18.167942+0000","last_became_peered":"2023-05-21T16:54:18.167942+0000","last_unstale":"2023-05-21T16:54:19.154470+0000","last_undegraded":"2023-05-21T16:54:19.154470+0000","last_fullsized":"2023-05-21T16:54:19.154470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:49:24.157343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008745+0000","last_change":"2023-05-21T16:54:17.797264+0000","last_active":"2023-05-21T16:54:20.008745+0000","last_peered":"2023-05-21T16:54:20.008745+0000","last_clean":"2023-05-21T16:54:20.008745+0000","last_became_active":"2023-05-21T16:54:17.796966+0000","last_became_peered":"2023-05-21T16:54:17.796966+0000","last_unstale":"2023-05-21T16:54:20.008745+0000","last_undegraded":"2023-05-21T16:54:20.008745+0000","last_fullsized":"2023-05-21T16:54:20.008745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:06.416563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151506+0000","last_change":"2023-05-21T16:54:18.171476+0000","last_active":"2023-05-21T16:54:19.151506+0000","last_peered":"2023-05-21T16:54:19.151506+0000","last_clean":"2023-05-21T16:54:19.151506+0000","last_became_active":"2023-05-21T16:54:18.171200+0000","last_became_peered":"2023-05-21T16:54:18.171200+0000","last_unstale":"2023-05-21T16:54:19.151506+0000","last_undegraded":"2023-05-21T16:54:19.151506+0000","last_fullsized":"2023-05-21T16:54:19.151506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:46.515183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.008926+0000","last_change":"2023-05-21T16:54:17.791998+0000","last_active":"2023-05-21T16:54:20.008926+0000","last_peered":"2023-05-21T16:54:20.008926+0000","last_clean":"2023-05-21T16:54:20.008926+0000","last_became_active":"2023-05-21T16:54:17.791713+0000","last_became_peered":"2023-05-21T16:54:17.791713+0000","last_unstale":"2023-05-21T16:54:20.008926+0000","last_undegraded":"2023-05-21T16:54:20.008926+0000","last_fullsized":"2023-05-21T16:54:20.008926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:23:57.419234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.011837+0000","last_change":"2023-05-21T16:54:18.169485+0000","last_active":"2023-05-21T16:54:20.011837+0000","last_peered":"2023-05-21T16:54:20.011837+0000","last_clean":"2023-05-21T16:54:20.011837+0000","last_became_active":"2023-05-21T16:54:18.169213+0000","last_became_peered":"2023-05-21T16:54:18.169213+0000","last_unstale":"2023-05-21T16:54:20.011837+0000","last_undegraded":"2023-05-21T16:54:20.011837+0000","last_fullsized":"2023-05-21T16:54:20.011837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:15:33.546555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230735+0000","last_change":"2023-05-21T16:54:17.789625+0000","last_active":"2023-05-21T16:54:19.230735+0000","last_peered":"2023-05-21T16:54:19.230735+0000","last_clean":"2023-05-21T16:54:19.230735+0000","last_became_active":"2023-05-21T16:54:17.789405+0000","last_became_peered":"2023-05-21T16:54:17.789405+0000","last_unstale":"2023-05-21T16:54:19.230735+0000","last_undegraded":"2023-05-21T16:54:19.230735+0000","last_fullsized":"2023-05-21T16:54:19.230735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:30:25.892052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.508051+0000","last_change":"2023-05-21T16:54:18.177566+0000","last_active":"2023-05-21T16:54:19.508051+0000","last_peered":"2023-05-21T16:54:19.508051+0000","last_clean":"2023-05-21T16:54:19.508051+0000","last_became_active":"2023-05-21T16:54:18.177265+0000","last_became_peered":"2023-05-21T16:54:18.177265+0000","last_unstale":"2023-05-21T16:54:19.508051+0000","last_undegraded":"2023-05-21T16:54:19.508051+0000","last_fullsized":"2023-05-21T16:54:19.508051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:57:00.430923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151553+0000","last_change":"2023-05-21T16:54:17.789123+0000","last_active":"2023-05-21T16:54:19.151553+0000","last_peered":"2023-05-21T16:54:19.151553+0000","last_clean":"2023-05-21T16:54:19.151553+0000","last_became_active":"2023-05-21T16:54:17.788842+0000","last_became_peered":"2023-05-21T16:54:17.788842+0000","last_unstale":"2023-05-21T16:54:19.151553+0000","last_undegraded":"2023-05-21T16:54:19.151553+0000","last_fullsized":"2023-05-21T16:54:19.151553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:56:26.181658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230869+0000","last_change":"2023-05-21T16:54:18.179233+0000","last_active":"2023-05-21T16:54:19.230869+0000","last_peered":"2023-05-21T16:54:19.230869+0000","last_clean":"2023-05-21T16:54:19.230869+0000","last_became_active":"2023-05-21T16:54:18.178643+0000","last_became_peered":"2023-05-21T16:54:18.178643+0000","last_unstale":"2023-05-21T16:54:19.230869+0000","last_undegraded":"2023-05-21T16:54:19.230869+0000","last_fullsized":"2023-05-21T16:54:19.230869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:08.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.955235+0000","last_change":"2023-05-21T16:54:17.786129+0000","last_active":"2023-05-21T16:54:19.955235+0000","last_peered":"2023-05-21T16:54:19.955235+0000","last_clean":"2023-05-21T16:54:19.955235+0000","last_became_active":"2023-05-21T16:54:17.785487+0000","last_became_peered":"2023-05-21T16:54:17.785487+0000","last_unstale":"2023-05-21T16:54:19.955235+0000","last_undegraded":"2023-05-21T16:54:19.955235+0000","last_fullsized":"2023-05-21T16:54:19.955235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:56:07.348957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.230365+0000","last_change":"2023-05-21T16:54:18.175866+0000","last_active":"2023-05-21T16:54:19.230365+0000","last_peered":"2023-05-21T16:54:19.230365+0000","last_clean":"2023-05-21T16:54:19.230365+0000","last_became_active":"2023-05-21T16:54:18.175140+0000","last_became_peered":"2023-05-21T16:54:18.175140+0000","last_unstale":"2023-05-21T16:54:19.230365+0000","last_undegraded":"2023-05-21T16:54:19.230365+0000","last_fullsized":"2023-05-21T16:54:19.230365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.956206+0000","last_change":"2023-05-21T16:54:17.786929+0000","last_active":"2023-05-21T16:54:19.956206+0000","last_peered":"2023-05-21T16:54:19.956206+0000","last_clean":"2023-05-21T16:54:19.956206+0000","last_became_active":"2023-05-21T16:54:17.786470+0000","last_became_peered":"2023-05-21T16:54:17.786470+0000","last_unstale":"2023-05-21T16:54:19.956206+0000","last_undegraded":"2023-05-21T16:54:19.956206+0000","last_fullsized":"2023-05-21T16:54:19.956206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:42.194752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010107+0000","last_change":"2023-05-21T16:54:18.173334+0000","last_active":"2023-05-21T16:54:20.010107+0000","last_peered":"2023-05-21T16:54:20.010107+0000","last_clean":"2023-05-21T16:54:20.010107+0000","last_became_active":"2023-05-21T16:54:18.173027+0000","last_became_peered":"2023-05-21T16:54:18.173027+0000","last_unstale":"2023-05-21T16:54:20.010107+0000","last_undegraded":"2023-05-21T16:54:20.010107+0000","last_fullsized":"2023-05-21T16:54:20.010107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:27.106358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:20.010797+0000","last_change":"2023-05-21T16:54:17.788520+0000","last_active":"2023-05-21T16:54:20.010797+0000","last_peered":"2023-05-21T16:54:20.010797+0000","last_clean":"2023-05-21T16:54:20.010797+0000","last_became_active":"2023-05-21T16:54:17.788210+0000","last_became_peered":"2023-05-21T16:54:17.788210+0000","last_unstale":"2023-05-21T16:54:20.010797+0000","last_undegraded":"2023-05-21T16:54:20.010797+0000","last_fullsized":"2023-05-21T16:54:20.010797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:07:01.306865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.229927+0000","last_change":"2023-05-21T16:54:18.175394+0000","last_active":"2023-05-21T16:54:19.229927+0000","last_peered":"2023-05-21T16:54:19.229927+0000","last_clean":"2023-05-21T16:54:19.229927+0000","last_became_active":"2023-05-21T16:54:18.174764+0000","last_became_peered":"2023-05-21T16:54:18.174764+0000","last_unstale":"2023-05-21T16:54:19.229927+0000","last_undegraded":"2023-05-21T16:54:19.229927+0000","last_fullsized":"2023-05-21T16:54:19.229927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:17.751458+0000","last_clean_scrub_stamp":"2023-05-21T16:54:17.751458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:45:28.691711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-21T16:54:19.151863+0000","last_change":"2023-05-21T16:54:17.786133+0000","last_active":"2023-05-21T16:54:19.151863+0000","last_peered":"2023-05-21T16:54:19.151863+0000","last_clean":"2023-05-21T16:54:19.151863+0000","last_became_active":"2023-05-21T16:54:17.785810+0000","last_became_peered":"2023-05-21T16:54:17.785810+0000","last_unstale":"2023-05-21T16:54:19.151863+0000","last_undegraded":"2023-05-21T16:54:19.151863+0000","last_fullsized":"2023-05-21T16:54:19.151863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:16.746881+0000","last_clean_scrub_stamp":"2023-05-21T16:54:16.746881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:54:34.911070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12164,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359676,"statfs":{"total":96636764160,"available":96624308224,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12096,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359744,"statfs":{"total":96636764160,"available":96624377856,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12160,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359680,"statfs":{"total":96636764160,"available":96624312320,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13256,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358584,"statfs":{"total":96636764160,"available":96623190016,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:54:26.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-21T16:54:26.285 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-21T16:54:26.285 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-21T16:54:26.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-21T16:54:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.385+0000 7f8d67fff700 1 Processor -- start 2023-05-21T16:54:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.385+0000 7f8d67fff700 1 -- start start 2023-05-21T16:54:26.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.385+0000 7f8d67fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d680ca9a0 0x7f8d68070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d68070b60 0x7f8d68069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68070fb0 con 0x7f8d6806a4c0 2023-05-21T16:54:26.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6815c9c0 con 0x7f8d68070b60 2023-05-21T16:54:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6806af90 con 0x7f8d680ca9a0 2023-05-21T16:54:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d677fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8d6806a4c0 0x7f8d681600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:58058/0 (socket says 172.21.15.46:58058) 2023-05-21T16:54:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d677fe700 1 -- 172.21.15.46:0/170581208 learned_addr learned my addr 172.21.15.46:0/170581208 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d66ffd700 1 --2- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d680ca9a0 0x7f8d68070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d667fc700 1 --2- 172.21.15.46:0/170581208 >> v2:172.21.15.142:3300/0 conn(0x7f8d68070b60 0x7f8d68069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d65ffb700 1 -- 172.21.15.46:0/170581208 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217549752 0 0) 0x7f8d60001490 con 0x7f8d6806a4c0 2023-05-21T16:54:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d667fc700 1 -- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d680ca9a0 msgr2=0x7f8d68070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:26.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d667fc700 1 --2- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d680ca9a0 0x7f8d68070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d667fc700 1 -- 172.21.15.46:0/170581208 >> v1:172.21.15.142:6789/0 conn(0x7f8d6806a4c0 legacy=0x7f8d681600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d667fc700 1 -- 172.21.15.46:0/170581208 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6806acb0 con 0x7f8d68070b60 2023-05-21T16:54:26.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d667fc700 1 --2- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d68070b60 0x7f8d68069f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009850 tx=0x7f8d50009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ffdfecff8dadd6 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d65ffb700 1 -- 172.21.15.46:0/170581208 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50011830 con 0x7f8d68070b60 2023-05-21T16:54:26.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d65ffb700 1 -- 172.21.15.46:0/170581208 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50011990 con 0x7f8d68070b60 2023-05-21T16:54:26.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d65ffb700 1 -- 172.21.15.46:0/170581208 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50011d40 con 0x7f8d68070b60 2023-05-21T16:54:26.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d68070b60 msgr2=0x7f8d68069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 --2- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d68070b60 0x7f8d68069f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009850 tx=0x7f8d50009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:26.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- 172.21.15.46:0/170581208 shutdown_connections 2023-05-21T16:54:26.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 --2- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d68070b60 0x7f8d68069f80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 --2- 172.21.15.46:0/170581208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d680ca9a0 0x7f8d68070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- 172.21.15.46:0/170581208 >> 172.21.15.46:0/170581208 conn(0x7f8d680ce970 msgr2=0x7f8d680ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- 172.21.15.46:0/170581208 shutdown_connections 2023-05-21T16:54:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.389+0000 7f8d67fff700 1 -- 172.21.15.46:0/170581208 wait complete. 2023-05-21T16:54:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 Processor -- start 2023-05-21T16:54:26.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 -- start start 2023-05-21T16:54:26.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 0x7f8d680c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d68070b60 0x7f8d68159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d680ca9a0 0x7f8d68159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6815b5a0 con 0x7f8d6806a4c0 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6815b110 con 0x7f8d680ca9a0 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680c6330 con 0x7f8d68070b60 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 0x7f8d680c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 0x7f8d680c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34780/0 (socket says 172.21.15.46:34780) 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 -- 172.21.15.46:0/3883485364 learned_addr learned my addr 172.21.15.46:0/3883485364 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d667fc700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d68070b60 0x7f8d68159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d677fe700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d680ca9a0 0x7f8d68159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 -- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d68070b60 msgr2=0x7f8d68159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d68070b60 0x7f8d68159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 -- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d680ca9a0 msgr2=0x7f8d68159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d680ca9a0 0x7f8d68159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 -- 172.21.15.46:0/3883485364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500094b0 con 0x7f8d6806a4c0 2023-05-21T16:54:26.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d66ffd700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 0x7f8d680c4eb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800e9b0 tx=0x7f8d5800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58009710 con 0x7f8d6806a4c0 2023-05-21T16:54:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5800ee50 con 0x7f8d6806a4c0 2023-05-21T16:54:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d680abd00 con 0x7f8d6806a4c0 2023-05-21T16:54:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800ca50 con 0x7f8d6806a4c0 2023-05-21T16:54:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.393+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d680aba20 con 0x7f8d6806a4c0 2023-05-21T16:54:26.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.397+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680abfe0 con 0x7f8d6806a4c0 2023-05-21T16:54:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.397+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d5800cbb0 con 0x7f8d6806a4c0 2023-05-21T16:54:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.397+0000 7f8d5f7fe700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d4c0662f0 0x7f8d4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.397+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d58084050 con 0x7f8d6806a4c0 2023-05-21T16:54:26.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.397+0000 7f8d667fc700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d4c0662f0 0x7f8d4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.401+0000 7f8d667fc700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d4c0662f0 0x7f8d4c0687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8d500090b0 tx=0x7f8d5001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.405+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8d58054f60 con 0x7f8d6806a4c0 2023-05-21T16:54:26.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.593+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8d681556c0 con 0x7f8d6806a4c0 2023-05-21T16:54:26.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d5f7fe700 1 -- 172.21.15.46:0/3883485364 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8d58017040 con 0x7f8d6806a4c0 2023-05-21T16:54:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:26.601 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-21T16:54:26.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d4c0662f0 msgr2=0x7f8d4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d4c0662f0 0x7f8d4c0687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8d500090b0 tx=0x7f8d5001c040 comp rx=0 tx=0).stop 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 msgr2=0x7f8d680c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 0x7f8d680c4eb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800e9b0 tx=0x7f8d5800ecc0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 shutdown_connections 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8d4c0662f0 0x7f8d4c0687a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d680ca9a0 0x7f8d68159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d68070b60 0x7f8d68159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 --2- 172.21.15.46:0/3883485364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d6806a4c0 0x7f8d680c4eb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 >> 172.21.15.46:0/3883485364 conn(0x7f8d680ce970 msgr2=0x7f8d68155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:26.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 shutdown_connections 2023-05-21T16:54:26.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.597+0000 7f8d67fff700 1 -- 172.21.15.46:0/3883485364 wait complete. 2023-05-21T16:54:26.614 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-21T16:54:26.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:26.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.713+0000 7ff788e19700 1 Processor -- start 2023-05-21T16:54:26.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.713+0000 7ff788e19700 1 -- start start 2023-05-21T16:54:26.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff784071bb0 0x7ff7840cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7840b3660 0x7ff7840b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff784159160 con 0x7ff78406cfa0 2023-05-21T16:54:26.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78406ef10 con 0x7ff7840b3660 2023-05-21T16:54:26.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840cf0a0 con 0x7ff784071bb0 2023-05-21T16:54:26.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff783fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff78406cfa0 0x7ff78406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33108/0 (socket says 172.21.15.46:33108) 2023-05-21T16:54:26.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff783fff700 1 -- 172.21.15.46:0/2705961975 learned_addr learned my addr 172.21.15.46:0/2705961975 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:26.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff782ffd700 1 --2- 172.21.15.46:0/2705961975 >> v2:172.21.15.142:3300/0 conn(0x7ff7840b3660 0x7ff7840b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7837fe700 1 --2- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff784071bb0 0x7ff7840cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7827fc700 1 -- 172.21.15.46:0/2705961975 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913339620 0 0) 0x7ff784159160 con 0x7ff78406cfa0 2023-05-21T16:54:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7827fc700 1 -- 172.21.15.46:0/2705961975 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff76c0035d0 con 0x7ff78406cfa0 2023-05-21T16:54:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff782ffd700 1 -- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff784071bb0 msgr2=0x7ff7840cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7827fc700 1 -- 172.21.15.46:0/2705961975 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330216022 0 0) 0x7ff76c0035d0 con 0x7ff78406cfa0 2023-05-21T16:54:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff782ffd700 1 --2- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff784071bb0 0x7ff7840cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff782ffd700 1 -- 172.21.15.46:0/2705961975 >> v1:172.21.15.46:6789/0 conn(0x7ff78406cfa0 legacy=0x7ff78406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff782ffd700 1 -- 172.21.15.46:0/2705961975 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7840ae9b0 con 0x7ff7840b3660 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff782ffd700 1 --2- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff7840b3ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff77800a9f0 tx=0x7ff77800ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c3d3c04bf6bb03 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7827fc700 1 -- 172.21.15.46:0/2705961975 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0019f0 con 0x7ff7840b3660 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7827fc700 1 -- 172.21.15.46:0/2705961975 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800ae90 con 0x7ff7840b3660 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff7827fc700 1 -- 172.21.15.46:0/2705961975 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778004250 con 0x7ff7840b3660 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 msgr2=0x7ff7840b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 --2- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff7840b3ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff77800a9f0 tx=0x7ff77800ad00 comp rx=0 tx=0).stop 2023-05-21T16:54:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- 172.21.15.46:0/2705961975 shutdown_connections 2023-05-21T16:54:26.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 --2- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff7840b3ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 --2- 172.21.15.46:0/2705961975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff784071bb0 0x7ff7840cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- 172.21.15.46:0/2705961975 >> 172.21.15.46:0/2705961975 conn(0x7ff7840cca00 msgr2=0x7ff7840cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:26.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- 172.21.15.46:0/2705961975 shutdown_connections 2023-05-21T16:54:26.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.717+0000 7ff788e19700 1 -- 172.21.15.46:0/2705961975 wait complete. 2023-05-21T16:54:26.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 Processor -- start 2023-05-21T16:54:26.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 -- start start 2023-05-21T16:54:26.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff78406cfa0 0x7ff784154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff784159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 0x7ff7841f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415ba60 con 0x7ff784159870 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415bce0 con 0x7ff7840b3660 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff788e19700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415bfc0 con 0x7ff78406cfa0 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 0x7ff7841f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 0x7ff7841f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34788/0 (socket says 172.21.15.46:34788) 2023-05-21T16:54:26.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 -- 172.21.15.46:0/3507492808 learned_addr learned my addr 172.21.15.46:0/3507492808 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:26.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff782ffd700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff784159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff7837fe700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff78406cfa0 0x7ff784154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 -- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff78406cfa0 msgr2=0x7ff784154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff78406cfa0 0x7ff784154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 -- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 msgr2=0x7ff784159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.721+0000 7ff783fff700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff784159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff783fff700 1 -- 172.21.15.46:0/3507492808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77800a650 con 0x7ff784159870 2023-05-21T16:54:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff783fff700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 0x7ff7841f16b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00cc90 tx=0x7ff77c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00aad0 con 0x7ff784159870 2023-05-21T16:54:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c00ac30 con 0x7ff784159870 2023-05-21T16:54:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78406e430 con 0x7ff784159870 2023-05-21T16:54:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0070d0 con 0x7ff784159870 2023-05-21T16:54:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7840cedc0 con 0x7ff784159870 2023-05-21T16:54:26.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78406e710 con 0x7ff784159870 2023-05-21T16:54:26.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff77c007230 con 0x7ff784159870 2023-05-21T16:54:26.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff76bfff700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7700662f0 0x7ff7700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:26.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff77c083a80 con 0x7ff784159870 2023-05-21T16:54:26.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.725+0000 7ff7837fe700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7700662f0 0x7ff7700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:26.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.729+0000 7ff7837fe700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7700662f0 0x7ff7700687a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff774009bf0 tx=0x7ff774009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:26.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.737+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff77c050f90 con 0x7ff784159870 2023-05-21T16:54:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.897+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff784067ac0 con 0x7ff784159870 2023-05-21T16:54:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff76bfff700 1 -- 172.21.15.46:0/3507492808 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7ff77c018090 con 0x7ff784159870 2023-05-21T16:54:26.905 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:26.906 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7700662f0 msgr2=0x7ff7700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7700662f0 0x7ff7700687a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff774009bf0 tx=0x7ff774009240 comp rx=0 tx=0).stop 2023-05-21T16:54:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 msgr2=0x7ff7841f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 0x7ff7841f16b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00cc90 tx=0x7ff77c00a060 comp rx=0 tx=0).stop 2023-05-21T16:54:26.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 shutdown_connections 2023-05-21T16:54:26.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7700662f0 0x7ff7700687a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff784159870 0x7ff7841f16b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7840b3660 0x7ff784159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 --2- 172.21.15.46:0/3507492808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff78406cfa0 0x7ff784154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 >> 172.21.15.46:0/3507492808 conn(0x7ff7840cca00 msgr2=0x7ff7840ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 shutdown_connections 2023-05-21T16:54:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:26.901+0000 7ff788e19700 1 -- 172.21.15.46:0/3507492808 wait complete. 2023-05-21T16:54:26.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:26.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:27.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 Processor -- start 2023-05-21T16:54:27.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- start start 2023-05-21T16:54:27.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca440b8ad0 0x7fca440cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b4910 0x7fca440b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440b8ea0 con 0x7fca440b5ce0 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440b52f0 con 0x7fca440b8ad0 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440d09d0 con 0x7fca440b4910 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca440b8ad0 0x7fca440cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fca440b8ad0 0x7fca440cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34794/0 (socket says 172.21.15.46:34794) 2023-05-21T16:54:27.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 -- 172.21.15.46:0/327631268 learned_addr learned my addr 172.21.15.46:0/327631268 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:27.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca4359e700 1 --2- 172.21.15.46:0/327631268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b4910 0x7fca440b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 -- 172.21.15.46:0/327631268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b4910 msgr2=0x7fca440b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:27.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 --2- 172.21.15.46:0/327631268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b4910 0x7fca440b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 -- 172.21.15.46:0/327631268 >> v1:172.21.15.142:6789/0 conn(0x7fca440b5ce0 legacy=0x7fca4406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 -- 172.21.15.46:0/327631268 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440d0cb0 con 0x7fca440b8ad0 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca42d9d700 1 --2- 172.21.15.46:0/327631268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca440cf310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca34009910 tx=0x7fca34009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dedb0c5085d2f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca4259c700 1 -- 172.21.15.46:0/327631268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34011830 con 0x7fca440b8ad0 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca4259c700 1 -- 172.21.15.46:0/327631268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34011990 con 0x7fca440b8ad0 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca4259c700 1 -- 172.21.15.46:0/327631268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34011d40 con 0x7fca440b8ad0 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- 172.21.15.46:0/327631268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 msgr2=0x7fca440cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 --2- 172.21.15.46:0/327631268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca440cf310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca34009910 tx=0x7fca34009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:27.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- 172.21.15.46:0/327631268 shutdown_connections 2023-05-21T16:54:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 --2- 172.21.15.46:0/327631268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b4910 0x7fca440b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 --2- 172.21.15.46:0/327631268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca440cf310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- 172.21.15.46:0/327631268 >> 172.21.15.46:0/327631268 conn(0x7fca440d3ae0 msgr2=0x7fca440cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- 172.21.15.46:0/327631268 shutdown_connections 2023-05-21T16:54:27.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.033+0000 7fca48865700 1 -- 172.21.15.46:0/327631268 wait complete. 2023-05-21T16:54:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 Processor -- start 2023-05-21T16:54:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 -- start start 2023-05-21T16:54:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca440b4910 0x7fca441f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b5ce0 0x7fca44157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca44160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440cb0f0 con 0x7fca440b8ad0 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f2350 con 0x7fca440b4910 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f2620 con 0x7fca440b5ce0 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca44160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca44160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34808/0 (socket says 172.21.15.46:34808) 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 -- 172.21.15.46:0/2889659616 learned_addr learned my addr 172.21.15.46:0/2889659616 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca42d9d700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca440b4910 0x7fca441f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca3a59c700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b5ce0 0x7fca44157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 -- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b5ce0 msgr2=0x7fca44157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b5ce0 0x7fca44157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 -- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca440b4910 msgr2=0x7fca441f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca440b4910 0x7fca441f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 -- 172.21.15.46:0/2889659616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca34009570 con 0x7fca440b8ad0 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca4359e700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca44160150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00efc0 tx=0x7fca3c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00cb80 con 0x7fca440b8ad0 2023-05-21T16:54:27.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440cd790 con 0x7fca440b8ad0 2023-05-21T16:54:27.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00f040 con 0x7fca440b8ad0 2023-05-21T16:54:27.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c014480 con 0x7fca440b8ad0 2023-05-21T16:54:27.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.037+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca440cd4f0 con 0x7fca440b8ad0 2023-05-21T16:54:27.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.041+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca440cda70 con 0x7fca440b8ad0 2023-05-21T16:54:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.041+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca3c0145e0 con 0x7fca440b8ad0 2023-05-21T16:54:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.041+0000 7fca3bfff700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fca240662f0 0x7fca240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.041+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca3c0845c0 con 0x7fca440b8ad0 2023-05-21T16:54:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.041+0000 7fca42d9d700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fca240662f0 0x7fca240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.041+0000 7fca42d9d700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fca240662f0 0x7fca240687a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca34009c60 tx=0x7fca34008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.049+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fca3c0519c0 con 0x7fca440b8ad0 2023-05-21T16:54:27.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca440733b0 con 0x7fca440b8ad0 2023-05-21T16:54:27.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca3bfff700 1 -- 172.21.15.46:0/2889659616 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca3c054fe0 con 0x7fca440b8ad0 2023-05-21T16:54:27.217 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:27.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fca240662f0 msgr2=0x7fca240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fca240662f0 0x7fca240687a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca34009c60 tx=0x7fca34008030 comp rx=0 tx=0).stop 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 msgr2=0x7fca44160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca44160150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00efc0 tx=0x7fca3c00c0c0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 shutdown_connections 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fca240662f0 0x7fca240687a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca440b8ad0 0x7fca44160150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca440b5ce0 0x7fca44157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 --2- 172.21.15.46:0/2889659616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca440b4910 0x7fca441f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 >> 172.21.15.46:0/2889659616 conn(0x7fca440d3ae0 msgr2=0x7fca440b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 shutdown_connections 2023-05-21T16:54:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.213+0000 7fca48865700 1 -- 172.21.15.46:0/2889659616 wait complete. 2023-05-21T16:54:27.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 Processor -- start 2023-05-21T16:54:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- start start 2023-05-21T16:54:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f275c070250 0x7f275c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f275c070620 0x7f275c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275c15efc0 con 0x7f275c0ccdd0 2023-05-21T16:54:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c06db30 con 0x7f275c070250 2023-05-21T16:54:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c0cb1d0 con 0x7f275c070620 2023-05-21T16:54:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275a7fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f275c0ccdd0 0x7f275c0b39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33112/0 (socket says 172.21.15.46:33112) 2023-05-21T16:54:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f275c070250 0x7f275c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275a7fc700 1 -- 172.21.15.46:0/596898776 learned_addr learned my addr 172.21.15.46:0/596898776 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275b7fe700 1 --2- 172.21.15.46:0/596898776 >> v2:172.21.15.142:3300/0 conn(0x7f275c070620 0x7f275c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275affd700 1 -- 172.21.15.46:0/596898776 >> v2:172.21.15.142:3300/0 conn(0x7f275c070620 msgr2=0x7f275c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275affd700 1 --2- 172.21.15.46:0/596898776 >> v2:172.21.15.142:3300/0 conn(0x7f275c070620 0x7f275c06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275affd700 1 -- 172.21.15.46:0/596898776 >> v1:172.21.15.46:6789/0 conn(0x7f275c0ccdd0 legacy=0x7f275c0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275affd700 1 -- 172.21.15.46:0/596898776 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0cb9a0 con 0x7f275c070250 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275affd700 1 --2- 172.21.15.46:0/596898776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c070250 0x7f275c15ea80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f275c0722f0 tx=0x7f2744009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747de8359a3a3fb3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f2759ffb700 1 -- 172.21.15.46:0/596898776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011830 con 0x7f275c070250 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f2759ffb700 1 -- 172.21.15.46:0/596898776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744011990 con 0x7f275c070250 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f2759ffb700 1 -- 172.21.15.46:0/596898776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011d40 con 0x7f275c070250 2023-05-21T16:54:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- 172.21.15.46:0/596898776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c070250 msgr2=0x7f275c15ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 --2- 172.21.15.46:0/596898776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c070250 0x7f275c15ea80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f275c0722f0 tx=0x7f2744009b30 comp rx=0 tx=0).stop 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- 172.21.15.46:0/596898776 shutdown_connections 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 --2- 172.21.15.46:0/596898776 >> v2:172.21.15.142:3300/0 conn(0x7f275c070620 0x7f275c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 --2- 172.21.15.46:0/596898776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c070250 0x7f275c15ea80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- 172.21.15.46:0/596898776 >> 172.21.15.46:0/596898776 conn(0x7f275c0d0b80 msgr2=0x7f275c0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- 172.21.15.46:0/596898776 shutdown_connections 2023-05-21T16:54:27.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.349+0000 7f275bfff700 1 -- 172.21.15.46:0/596898776 wait complete. 2023-05-21T16:54:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 Processor -- start 2023-05-21T16:54:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 -- start start 2023-05-21T16:54:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f275c070250 0x7f275c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f275c070620 0x7f275c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 0x7f275c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0b5690 con 0x7f275c0ccdd0 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c15b6b0 con 0x7f275c070620 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c15b990 con 0x7f275c070250 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 0x7f275c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 0x7f275c15b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34832/0 (socket says 172.21.15.46:34832) 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 -- 172.21.15.46:0/234763087 learned_addr learned my addr 172.21.15.46:0/234763087 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275a7fc700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f275c070620 0x7f275c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275affd700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f275c070250 0x7f275c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 -- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f275c070250 msgr2=0x7f275c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f275c070250 0x7f275c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 -- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f275c070620 msgr2=0x7f275c15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f275c070620 0x7f275c15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 -- 172.21.15.46:0/234763087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440094b0 con 0x7f275c0ccdd0 2023-05-21T16:54:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275affd700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f275c070250 0x7f275c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275b7fe700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 0x7f275c15b030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f274c00e810 tx=0x7f274c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c013610 con 0x7f275c0ccdd0 2023-05-21T16:54:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c013770 con 0x7f275c0ccdd0 2023-05-21T16:54:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c0cd270 con 0x7f275c0ccdd0 2023-05-21T16:54:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c013b20 con 0x7f275c0ccdd0 2023-05-21T16:54:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.353+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c15a960 con 0x7f275c0ccdd0 2023-05-21T16:54:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.357+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c0cb3e0 con 0x7f275c0ccdd0 2023-05-21T16:54:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.357+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f274c013c80 con 0x7f275c0ccdd0 2023-05-21T16:54:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.357+0000 7f27537fe700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f273c0662f0 0x7f273c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.357+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f274c083950 con 0x7f275c0ccdd0 2023-05-21T16:54:27.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.357+0000 7f275affd700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f273c0662f0 0x7f273c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.361+0000 7f275affd700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f273c0662f0 0x7f273c0687a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27440090b0 tx=0x7f2744008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.365+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f274c054870 con 0x7f275c0ccdd0 2023-05-21T16:54:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.521+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f275c073cb0 con 0x7f275c0ccdd0 2023-05-21T16:54:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.521+0000 7f27537fe700 1 -- 172.21.15.46:0/234763087 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f274c054400 con 0x7f275c0ccdd0 2023-05-21T16:54:27.527 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f273c0662f0 msgr2=0x7f273c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f273c0662f0 0x7f273c0687a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27440090b0 tx=0x7f2744008030 comp rx=0 tx=0).stop 2023-05-21T16:54:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 msgr2=0x7f275c15b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 0x7f275c15b030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f274c00e810 tx=0x7f274c00eb20 comp rx=0 tx=0).stop 2023-05-21T16:54:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 shutdown_connections 2023-05-21T16:54:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f273c0662f0 0x7f273c0687a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0ccdd0 0x7f275c15b030 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f275c070620 0x7f275c15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 --2- 172.21.15.46:0/234763087 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f275c070250 0x7f275c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 >> 172.21.15.46:0/234763087 conn(0x7f275c0d0b80 msgr2=0x7f275c159350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 shutdown_connections 2023-05-21T16:54:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.525+0000 7f275bfff700 1 -- 172.21.15.46:0/234763087 wait complete. 2023-05-21T16:54:27.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:27.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee77fff700 1 Processor -- start 2023-05-21T16:54:27.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee77fff700 1 -- start start 2023-05-21T16:54:27.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee77fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fee78070250 0x7fee7815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee77fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7815efc0 con 0x7fee78070620 2023-05-21T16:54:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee77fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee780cb9a0 con 0x7fee780ccdd0 2023-05-21T16:54:27.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee77fff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7806db30 con 0x7fee78070250 2023-05-21T16:54:27.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee777fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fee78070620 0x7fee7806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33126/0 (socket says 172.21.15.46:33126) 2023-05-21T16:54:27.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee777fe700 1 -- 172.21.15.46:0/3029883189 learned_addr learned my addr 172.21.15.46:0/3029883189 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:27.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee76ffd700 1 --2- 172.21.15.46:0/3029883189 >> v2:172.21.15.46:3300/0 conn(0x7fee78070250 0x7fee7815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938596585 0 0) 0x7fee70001490 con 0x7fee78070620 2023-05-21T16:54:27.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee600035d0 con 0x7fee78070620 2023-05-21T16:54:27.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283654556 0 0) 0x7fee600035d0 con 0x7fee78070620 2023-05-21T16:54:27.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 >> v2:172.21.15.46:3300/0 conn(0x7fee78070250 msgr2=0x7fee7815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:27.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 --2- 172.21.15.46:0/3029883189 >> v2:172.21.15.46:3300/0 conn(0x7fee78070250 0x7fee7815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 >> v1:172.21.15.142:6789/0 conn(0x7fee780ccdd0 legacy=0x7fee780b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7815a960 con 0x7fee78070620 2023-05-21T16:54:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7fee70001b80 con 0x7fee78070620 2023-05-21T16:54:27.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 >> v1:172.21.15.46:6789/0 conn(0x7fee78070620 legacy=0x7fee7806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee60003a20 0x7fee60003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60004870 0x7fee60004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee60005220 0x7fee6000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7806db30 con 0x7fee60004870 2023-05-21T16:54:27.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6000c0a0 con 0x7fee60003a20 2023-05-21T16:54:27.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6000c260 con 0x7fee60005220 2023-05-21T16:54:27.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee76ffd700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee60003a20 0x7fee60003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee767fc700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60004870 0x7fee60004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.657+0000 7fee777fe700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee60005220 0x7fee6000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee76ffd700 1 -- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee60005220 msgr2=0x7fee6000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:27.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee76ffd700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee60005220 0x7fee6000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee76ffd700 1 -- 172.21.15.46:0/3029883189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60004870 msgr2=0x7fee60004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee76ffd700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60004870 0x7fee60004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee76ffd700 1 -- 172.21.15.46:0/3029883189 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600035d0 con 0x7fee60003a20 2023-05-21T16:54:27.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee777fe700 1 -- 172.21.15.46:0/3029883189 reap_dead start 2023-05-21T16:54:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee76ffd700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee60003a20 0x7fee60003e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee68009b70 tx=0x7fee600058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a3280842a5db2cc server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800e6c0 con 0x7fee60003a20 2023-05-21T16:54:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee75ffb700 1 -- 172.21.15.46:0/3029883189 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6800e820 con 0x7fee60003a20 2023-05-21T16:54:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 -- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee60003a20 msgr2=0x7fee60003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee60003a20 0x7fee60003e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee68009b70 tx=0x7fee600058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 -- 172.21.15.46:0/3029883189 shutdown_connections 2023-05-21T16:54:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 --2- 172.21.15.46:0/3029883189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee60003a20 0x7fee60003e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 -- 172.21.15.46:0/3029883189 >> 172.21.15.46:0/3029883189 conn(0x7fee780d0b80 msgr2=0x7fee780d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 -- 172.21.15.46:0/3029883189 shutdown_connections 2023-05-21T16:54:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 -- 172.21.15.46:0/3029883189 wait complete. 2023-05-21T16:54:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 Processor -- start 2023-05-21T16:54:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.661+0000 7fee77fff700 1 -- start start 2023-05-21T16:54:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 0x7fee780c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee780c7c50 0x7fee780c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee78154df0 0x7fee78155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780c9730 con 0x7fee60003a20 2023-05-21T16:54:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee781557a0 con 0x7fee78154df0 2023-05-21T16:54:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780c3f20 con 0x7fee780c7c50 2023-05-21T16:54:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 0x7fee780c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 0x7fee780c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34870/0 (socket says 172.21.15.46:34870) 2023-05-21T16:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 -- 172.21.15.46:0/4184205469 learned_addr learned my addr 172.21.15.46:0/4184205469 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee777fe700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee78154df0 0x7fee78155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee767fc700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee780c7c50 0x7fee780c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 -- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee780c7c50 msgr2=0x7fee780c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee780c7c50 0x7fee780c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 -- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee78154df0 msgr2=0x7fee78155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee78154df0 0x7fee78155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 -- 172.21.15.46:0/4184205469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780cb3e0 con 0x7fee60003a20 2023-05-21T16:54:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee76ffd700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 0x7fee780c91f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee6800efd0 tx=0x7fee680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800e6c0 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee780cd270 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68013d00 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee780cb6c0 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68004260 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.665+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78073cb0 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.669+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee680043c0 con 0x7fee60003a20 2023-05-21T16:54:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.669+0000 7fee5f7fe700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fee640662f0 0x7fee640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.669+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee68084e10 con 0x7fee60003a20 2023-05-21T16:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.669+0000 7fee767fc700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fee640662f0 0x7fee640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.669+0000 7fee767fc700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fee640662f0 0x7fee640687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee78154a50 tx=0x7fee6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.673+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fee680523a0 con 0x7fee60003a20 2023-05-21T16:54:27.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee780c74e0 con 0x7fee60003a20 2023-05-21T16:54:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee5f7fe700 1 -- 172.21.15.46:0/4184205469 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee68017020 con 0x7fee60003a20 2023-05-21T16:54:27.837 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:27.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fee640662f0 msgr2=0x7fee640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fee640662f0 0x7fee640687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee78154a50 tx=0x7fee6c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 msgr2=0x7fee780c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 0x7fee780c91f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee6800efd0 tx=0x7fee680047e0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 shutdown_connections 2023-05-21T16:54:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fee640662f0 0x7fee640687a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee78154df0 0x7fee78155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee780c7c50 0x7fee780c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 --2- 172.21.15.46:0/4184205469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee60003a20 0x7fee780c91f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 >> 172.21.15.46:0/4184205469 conn(0x7fee780d0b80 msgr2=0x7fee781593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 shutdown_connections 2023-05-21T16:54:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.833+0000 7fee77fff700 1 -- 172.21.15.46:0/4184205469 wait complete. 2023-05-21T16:54:27.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:27.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.961+0000 7f829b15a700 1 Processor -- start 2023-05-21T16:54:27.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.961+0000 7f829b15a700 1 -- start start 2023-05-21T16:54:27.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f829415c800 0x7f82940b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8294160cd0 0x7f82940c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829415d1e0 con 0x7f829415c430 2023-05-21T16:54:27.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829415cc60 con 0x7f8294160cd0 2023-05-21T16:54:27.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940b1450 con 0x7f829415c800 2023-05-21T16:54:27.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8294160cd0 0x7f82940c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a158700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f829415c430 0x7f829415d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33142/0 (socket says 172.21.15.46:33142) 2023-05-21T16:54:27.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8294160cd0 0x7f82940c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34880/0 (socket says 172.21.15.46:34880) 2023-05-21T16:54:27.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a158700 1 -- 172.21.15.46:0/2094568675 learned_addr learned my addr 172.21.15.46:0/2094568675 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:27.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f8299957700 1 --2- 172.21.15.46:0/2094568675 >> v2:172.21.15.142:3300/0 conn(0x7f829415c800 0x7f82940b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 -- 172.21.15.46:0/2094568675 >> v2:172.21.15.142:3300/0 conn(0x7f829415c800 msgr2=0x7f82940b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:27.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 --2- 172.21.15.46:0/2094568675 >> v2:172.21.15.142:3300/0 conn(0x7f829415c800 0x7f82940b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 -- 172.21.15.46:0/2094568675 >> v1:172.21.15.46:6789/0 conn(0x7f829415c430 legacy=0x7f829415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 -- 172.21.15.46:0/2094568675 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940b1730 con 0x7f8294160cd0 2023-05-21T16:54:27.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829a959700 1 --2- 172.21.15.46:0/2094568675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f82940c98d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82940aed40 tx=0x7f828c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc12b7d69188c65 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f8299156700 1 -- 172.21.15.46:0/2094568675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00e070 con 0x7f8294160cd0 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f8299156700 1 -- 172.21.15.46:0/2094568675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00bb20 con 0x7f8294160cd0 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f8299156700 1 -- 172.21.15.46:0/2094568675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c012430 con 0x7f8294160cd0 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- 172.21.15.46:0/2094568675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 msgr2=0x7f82940c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 --2- 172.21.15.46:0/2094568675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f82940c98d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82940aed40 tx=0x7f828c00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- 172.21.15.46:0/2094568675 shutdown_connections 2023-05-21T16:54:27.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 --2- 172.21.15.46:0/2094568675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f82940c98d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 --2- 172.21.15.46:0/2094568675 >> v2:172.21.15.142:3300/0 conn(0x7f829415c800 0x7f82940b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- 172.21.15.46:0/2094568675 >> 172.21.15.46:0/2094568675 conn(0x7f82940cbd90 msgr2=0x7f82940cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:27.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- 172.21.15.46:0/2094568675 shutdown_connections 2023-05-21T16:54:27.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.965+0000 7f829b15a700 1 -- 172.21.15.46:0/2094568675 wait complete. 2023-05-21T16:54:27.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 Processor -- start 2023-05-21T16:54:27.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 -- start start 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829415c430 0x7f82940c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829415c800 0x7f82941587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f829415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941f17f0 con 0x7f8294160cd0 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b48e0 con 0x7f829415c430 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b4b60 con 0x7f829415c800 2023-05-21T16:54:27.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f829415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f829415e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34886/0 (socket says 172.21.15.46:34886) 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 -- 172.21.15.46:0/4245458390 learned_addr learned my addr 172.21.15.46:0/4245458390 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a158700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829415c430 0x7f82940c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f8299957700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829415c800 0x7f82941587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 -- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829415c800 msgr2=0x7f82941587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829415c800 0x7f82941587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 -- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829415c430 msgr2=0x7f82940c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:27.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829415c430 0x7f82940c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:27.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 -- 172.21.15.46:0/4245458390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009a70 con 0x7f8294160cd0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829a959700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f829415e6c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f828c014040 tx=0x7f828c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c012430 con 0x7f8294160cd0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c020070 con 0x7f8294160cd0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8294161130 con 0x7f8294160cd0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0098f0 con 0x7f8294160cd0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.969+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829415ce70 con 0x7f8294160cd0 2023-05-21T16:54:27.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.973+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940c9e10 con 0x7f8294160cd0 2023-05-21T16:54:27.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.973+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f828c004040 con 0x7f8294160cd0 2023-05-21T16:54:27.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.973+0000 7f828affd700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82780662f0 0x7f82780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:27.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.973+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f828c022070 con 0x7f8294160cd0 2023-05-21T16:54:27.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.973+0000 7f829a158700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82780662f0 0x7f82780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:27.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.973+0000 7f829a158700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82780662f0 0x7f82780687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8284005930 tx=0x7f8284009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:27.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:27.981+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f828c052d90 con 0x7f8294160cd0 2023-05-21T16:54:28.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82940733b0 con 0x7f8294160cd0 2023-05-21T16:54:28.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f828affd700 1 -- 172.21.15.46:0/4245458390 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f828c02c020 con 0x7f8294160cd0 2023-05-21T16:54:28.150 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:28.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82780662f0 msgr2=0x7f82780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82780662f0 0x7f82780687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8284005930 tx=0x7f8284009040 comp rx=0 tx=0).stop 2023-05-21T16:54:28.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 msgr2=0x7f829415e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f829415e6c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f828c014040 tx=0x7f828c004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 shutdown_connections 2023-05-21T16:54:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82780662f0 0x7f82780687a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8294160cd0 0x7f829415e6c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829415c800 0x7f82941587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 --2- 172.21.15.46:0/4245458390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829415c430 0x7f82940c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 >> 172.21.15.46:0/4245458390 conn(0x7f82940cbd90 msgr2=0x7f829406b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:28.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 shutdown_connections 2023-05-21T16:54:28.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.145+0000 7f829b15a700 1 -- 172.21.15.46:0/4245458390 wait complete. 2023-05-21T16:54:28.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:54:28.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 Processor -- start 2023-05-21T16:54:28.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 -- start start 2023-05-21T16:54:28.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f445015c590 0x7f44500cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44500cdd30 0x7f44500ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44501602b0 con 0x7f44500cc380 2023-05-21T16:54:28.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450160590 con 0x7f44500cdd30 2023-05-21T16:54:28.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450160870 con 0x7f445015c590 2023-05-21T16:54:28.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44500cdd30 0x7f44500ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f445015c590 0x7f44500cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f445015c590 0x7f44500cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:32806/0 (socket says 172.21.15.46:32806) 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 -- 172.21.15.46:0/2651734940 learned_addr learned my addr 172.21.15.46:0/2651734940 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444f7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44500cdd30 0x7f44500ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34894/0 (socket says 172.21.15.46:34894) 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 -- 172.21.15.46:0/2651734940 >> v2:172.21.15.46:3300/0 conn(0x7f44500cdd30 msgr2=0x7f44500ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 --2- 172.21.15.46:0/2651734940 >> v2:172.21.15.46:3300/0 conn(0x7f44500cdd30 0x7f44500ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 -- 172.21.15.46:0/2651734940 >> v1:172.21.15.142:6789/0 conn(0x7f44500cc380 legacy=0x7f44500cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 -- 172.21.15.46:0/2651734940 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450160b50 con 0x7f445015c590 2023-05-21T16:54:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444effd700 1 --2- 172.21.15.46:0/2651734940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445015c590 0x7f44500cacf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4450072560 tx=0x7f4440009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd6732a10ef904a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444e7fc700 1 -- 172.21.15.46:0/2651734940 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011830 con 0x7f445015c590 2023-05-21T16:54:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444e7fc700 1 -- 172.21.15.46:0/2651734940 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440011990 con 0x7f445015c590 2023-05-21T16:54:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.273+0000 7f444e7fc700 1 -- 172.21.15.46:0/2651734940 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011d20 con 0x7f445015c590 2023-05-21T16:54:28.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 -- 172.21.15.46:0/2651734940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445015c590 msgr2=0x7f44500cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 --2- 172.21.15.46:0/2651734940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445015c590 0x7f44500cacf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4450072560 tx=0x7f4440009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 -- 172.21.15.46:0/2651734940 shutdown_connections 2023-05-21T16:54:28.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 --2- 172.21.15.46:0/2651734940 >> v2:172.21.15.46:3300/0 conn(0x7f44500cdd30 0x7f44500ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 --2- 172.21.15.46:0/2651734940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445015c590 0x7f44500cacf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 -- 172.21.15.46:0/2651734940 >> 172.21.15.46:0/2651734940 conn(0x7f445006d8f0 msgr2=0x7f445006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:28.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 -- 172.21.15.46:0/2651734940 shutdown_connections 2023-05-21T16:54:28.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 -- 172.21.15.46:0/2651734940 wait complete. 2023-05-21T16:54:28.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 Processor -- start 2023-05-21T16:54:28.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.277+0000 7f444ffff700 1 -- start start 2023-05-21T16:54:28.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44500cc380 0x7f44500c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44500cdd30 0x7f44501532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 0x7f44500b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44500c5150 con 0x7f445015c590 2023-05-21T16:54:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450153e00 con 0x7f44500cdd30 2023-05-21T16:54:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450153b20 con 0x7f44500cc380 2023-05-21T16:54:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 0x7f44500b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 0x7f44500b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34898/0 (socket says 172.21.15.46:34898) 2023-05-21T16:54:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 -- 172.21.15.46:0/2487803721 learned_addr learned my addr 172.21.15.46:0/2487803721 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f4447fff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44500cdd30 0x7f44501532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444effd700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44500cc380 0x7f44500c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 -- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44500cc380 msgr2=0x7f44500c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44500cc380 0x7f44500c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 -- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44500cdd30 msgr2=0x7f44501532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44500cdd30 0x7f44501532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 -- 172.21.15.46:0/2487803721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440009570 con 0x7f445015c590 2023-05-21T16:54:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444f7fe700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 0x7f44500b3640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f444800efc0 tx=0x7f444800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448009ea0 con 0x7f445015c590 2023-05-21T16:54:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800f040 con 0x7f445015c590 2023-05-21T16:54:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445015c960 con 0x7f445015c590 2023-05-21T16:54:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800ced0 con 0x7f445015c590 2023-05-21T16:54:28.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.281+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4450160e30 con 0x7f445015c590 2023-05-21T16:54:28.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.285+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4448014480 con 0x7f445015c590 2023-05-21T16:54:28.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.285+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44500ca840 con 0x7f445015c590 2023-05-21T16:54:28.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.285+0000 7f44477fe700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f44300662f0 0x7f44300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.285+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4448084600 con 0x7f445015c590 2023-05-21T16:54:28.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.285+0000 7f444effd700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f44300662f0 0x7f44300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.285+0000 7f444effd700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f44300662f0 0x7f44300687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4440000c00 tx=0x7f4440008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.293+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4448051960 con 0x7f445015c590 2023-05-21T16:54:28.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4450067ac0 con 0x7f445015c590 2023-05-21T16:54:28.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f44477fe700 1 -- 172.21.15.46:0/2487803721 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f4448054f80 con 0x7f445015c590 2023-05-21T16:54:28.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:28.493 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:54:28.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f44300662f0 msgr2=0x7f44300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f44300662f0 0x7f44300687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4440000c00 tx=0x7f4440008030 comp rx=0 tx=0).stop 2023-05-21T16:54:28.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 msgr2=0x7f44500b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 0x7f44500b3640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f444800efc0 tx=0x7f444800c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 shutdown_connections 2023-05-21T16:54:28.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f44300662f0 0x7f44300687a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f445015c590 0x7f44500b3640 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44500cdd30 0x7f44501532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 --2- 172.21.15.46:0/2487803721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f44500cc380 0x7f44500c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 >> 172.21.15.46:0/2487803721 conn(0x7f445006d8f0 msgr2=0x7f44500afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 shutdown_connections 2023-05-21T16:54:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.489+0000 7f444ffff700 1 -- 172.21.15.46:0/2487803721 wait complete. 2023-05-21T16:54:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:54:28.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:28.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f2059a700 1 Processor -- start 2023-05-21T16:54:28.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f2059a700 1 -- start start 2023-05-21T16:54:28.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f2059a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 0x7f8f1815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f2059a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1815de00 con 0x7f8f18159370 2023-05-21T16:54:28.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f2059a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1815db20 con 0x7f8f1815cfb0 2023-05-21T16:54:28.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f2059a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f180cb000 con 0x7f8f1806af20 2023-05-21T16:54:28.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1e336700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8f18159370 0x7f8f180cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33152/0 (socket says 172.21.15.46:33152) 2023-05-21T16:54:28.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1e336700 1 -- 172.21.15.46:0/977310317 learned_addr learned my addr 172.21.15.46:0/977310317 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 0x7f8f1815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405831747 0 0) 0x7f8f1815de00 con 0x7f8f18159370 2023-05-21T16:54:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f040035d0 con 0x7f8f18159370 2023-05-21T16:54:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57547075 0 0) 0x7f8f040035d0 con 0x7f8f18159370 2023-05-21T16:54:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 msgr2=0x7f8f1815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 0x7f8f1815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 >> v1:172.21.15.142:6789/0 conn(0x7f8f1815cfb0 legacy=0x7f8f1806a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f180ca940 con 0x7f8f18159370 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f8f14001670 con 0x7f8f18159370 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 >> v1:172.21.15.46:6789/0 conn(0x7f8f18159370 legacy=0x7f8f180cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04003a50 0x7f8f04003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 0x7f8f04004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f04004db0 0x7f8f04005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f180cb000 con 0x7f8f04004db0 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0400bb40 con 0x7f8f04003a50 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0400bd00 con 0x7f8f1806af20 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1db35700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 0x7f8f04004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1e336700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04003a50 0x7f8f04003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.605+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f04004db0 0x7f8f04005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 -- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 msgr2=0x7f8f04004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f1806af20 0x7f8f04004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 -- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04003a50 msgr2=0x7f8f04003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04003a50 0x7f8f04003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 -- 172.21.15.46:0/977310317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040035d0 con 0x7f8f04004db0 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f04004db0 0x7f8f04005220 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009f90 tx=0x7f8f040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf69c748959119b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000ebd0 con 0x7f8f04004db0 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1000f040 con 0x7f8f04004db0 2023-05-21T16:54:28.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1d334700 1 -- 172.21.15.46:0/977310317 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10014480 con 0x7f8f04004db0 2023-05-21T16:54:28.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- 172.21.15.46:0/977310317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f04004db0 msgr2=0x7f8f04005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 --2- 172.21.15.46:0/977310317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f04004db0 0x7f8f04005220 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009f90 tx=0x7f8f040058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1eb37700 1 -- 172.21.15.46:0/977310317 reap_dead start 2023-05-21T16:54:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- 172.21.15.46:0/977310317 shutdown_connections 2023-05-21T16:54:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- 172.21.15.46:0/977310317 >> 172.21.15.46:0/977310317 conn(0x7f8f1806dfc0 msgr2=0x7f8f180b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- 172.21.15.46:0/977310317 shutdown_connections 2023-05-21T16:54:28.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- 172.21.15.46:0/977310317 wait complete. 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 Processor -- start 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- start start 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04004db0 0x7f8f180af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 0x7f8f180ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f18158160 0x7f8f180acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f18158a00 con 0x7f8f18157d10 2023-05-21T16:54:28.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f180ac0e0 con 0x7f8f04004db0 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f2059a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f180afea0 con 0x7f8f18158160 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1db35700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 0x7f8f180ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1db35700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 0x7f8f180ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34916/0 (socket says 172.21.15.46:34916) 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1db35700 1 -- 172.21.15.46:0/2328301030 learned_addr learned my addr 172.21.15.46:0/2328301030 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.609+0000 7f8f1e336700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04004db0 0x7f8f180af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f18158160 0x7f8f180acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1db35700 1 -- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f18158160 msgr2=0x7f8f180acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1db35700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f18158160 0x7f8f180acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1db35700 1 -- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04004db0 msgr2=0x7f8f180af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1db35700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04004db0 0x7f8f180af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1db35700 1 -- 172.21.15.46:0/2328301030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f180720a0 con 0x7f8f18157d10 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1eb37700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f18158160 0x7f8f180acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1db35700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 0x7f8f180ac570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800f820 tx=0x7f8f0800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080052e0 con 0x7f8f18157d10 2023-05-21T16:54:28.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08005440 con 0x7f8f18157d10 2023-05-21T16:54:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f180cac20 con 0x7f8f18157d10 2023-05-21T16:54:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080038c0 con 0x7f8f18157d10 2023-05-21T16:54:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f180cbb30 con 0x7f8f18157d10 2023-05-21T16:54:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f18074200 con 0x7f8f18157d10 2023-05-21T16:54:28.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f08003a20 con 0x7f8f18157d10 2023-05-21T16:54:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f0effd700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8efc0662f0 0x7f8efc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f08083b70 con 0x7f8f18157d10 2023-05-21T16:54:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.613+0000 7f8f1e336700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8efc0662f0 0x7f8efc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.617+0000 7f8f1e336700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8efc0662f0 0x7f8efc0687a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f14001050 tx=0x7f8f14000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.625+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8f08050f60 con 0x7f8f18157d10 2023-05-21T16:54:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.785+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f180cb3c0 con 0x7f8f18157d10 2023-05-21T16:54:28.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.789+0000 7f8f0effd700 1 -- 172.21.15.46:0/2328301030 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f8f08054580 con 0x7f8f18157d10 2023-05-21T16:54:28.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:28.793 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8efc0662f0 msgr2=0x7f8efc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8efc0662f0 0x7f8efc0687a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f14001050 tx=0x7f8f14000f80 comp rx=0 tx=0).stop 2023-05-21T16:54:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 msgr2=0x7f8f180ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 0x7f8f180ac570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800f820 tx=0x7f8f0800fb30 comp rx=0 tx=0).stop 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 shutdown_connections 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8efc0662f0 0x7f8efc0687a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f18158160 0x7f8f180acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f18157d10 0x7f8f180ac570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 --2- 172.21.15.46:0/2328301030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f04004db0 0x7f8f180af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 >> 172.21.15.46:0/2328301030 conn(0x7f8f1806dfc0 msgr2=0x7f8f180b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 shutdown_connections 2023-05-21T16:54:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.793+0000 7f8f2059a700 1 -- 172.21.15.46:0/2328301030 wait complete. 2023-05-21T16:54:28.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:28.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:28.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 Processor -- start 2023-05-21T16:54:28.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 -- start start 2023-05-21T16:54:28.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d440b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d440d1ac0 0x7f6d440b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440d0d00 con 0x7f6d440d1f10 2023-05-21T16:54:28.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d44161520 con 0x7f6d440d1ac0 2023-05-21T16:54:28.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d49085700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440d0fe0 con 0x7f6d440b4800 2023-05-21T16:54:28.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d48884700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6d440d1f10 0x7f6d440b6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33154/0 (socket says 172.21.15.46:33154) 2023-05-21T16:54:28.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d48884700 1 -- 172.21.15.46:0/2675285991 learned_addr learned my addr 172.21.15.46:0/2675285991 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:28.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d43fff700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d440b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d437fe700 1 --2- 172.21.15.46:0/2675285991 >> v2:172.21.15.142:3300/0 conn(0x7f6d440d1ac0 0x7f6d440b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479842287 0 0) 0x7f6d440d0d00 con 0x7f6d440d1f10 2023-05-21T16:54:28.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.925+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d300035d0 con 0x7f6d440d1f10 2023-05-21T16:54:28.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539978410 0 0) 0x7f6d300035d0 con 0x7f6d440d1f10 2023-05-21T16:54:28.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 msgr2=0x7f6d440b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d440b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 >> v2:172.21.15.142:3300/0 conn(0x7f6d440d1ac0 msgr2=0x7f6d440b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 --2- 172.21.15.46:0/2675285991 >> v2:172.21.15.142:3300/0 conn(0x7f6d440d1ac0 0x7f6d440b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440d12c0 con 0x7f6d440d1f10 2023-05-21T16:54:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f6d3c0019f0 con 0x7f6d440d1f10 2023-05-21T16:54:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d440b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d437fe700 1 --2- 172.21.15.46:0/2675285991 >> v2:172.21.15.142:3300/0 conn(0x7f6d440d1ac0 0x7f6d440b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 >> v1:172.21.15.46:6789/0 conn(0x7f6d440d1f10 legacy=0x7f6d440b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d30003a20 0x7f6d30003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30004450 0x7f6d30004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d30004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440d0fe0 con 0x7f6d30003a20 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300056e0 con 0x7f6d30004450 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3000ba60 con 0x7f6d440b4800 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d30003a20 0x7f6d30003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d437fe700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30004450 0x7f6d30004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d48884700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d30004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 -- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 msgr2=0x7f6d30004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440b4800 0x7f6d30004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 -- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30004450 msgr2=0x7f6d30004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30004450 0x7f6d30004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 -- 172.21.15.46:0/2675285991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340094b0 con 0x7f6d30003a20 2023-05-21T16:54:28.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d43fff700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d30003a20 0x7f6d30003e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009d40 tx=0x7f6d300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b84eecadaa03bbe server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34009e90 con 0x7f6d30003a20 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3400e940 con 0x7f6d30003a20 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d42ffd700 1 -- 172.21.15.46:0/2675285991 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3400ecb0 con 0x7f6d30003a20 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d49085700 1 -- 172.21.15.46:0/2675285991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d30003a20 msgr2=0x7f6d30003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d49085700 1 --2- 172.21.15.46:0/2675285991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d30003a20 0x7f6d30003e30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009d40 tx=0x7f6d300058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d48884700 1 -- 172.21.15.46:0/2675285991 reap_dead start 2023-05-21T16:54:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d49085700 1 -- 172.21.15.46:0/2675285991 shutdown_connections 2023-05-21T16:54:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d49085700 1 -- 172.21.15.46:0/2675285991 >> 172.21.15.46:0/2675285991 conn(0x7f6d4406c170 msgr2=0x7f6d4406c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d49085700 1 -- 172.21.15.46:0/2675285991 shutdown_connections 2023-05-21T16:54:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.929+0000 7f6d49085700 1 -- 172.21.15.46:0/2675285991 wait complete. 2023-05-21T16:54:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 Processor -- start 2023-05-21T16:54:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 -- start start 2023-05-21T16:54:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30003a20 0x7f6d4415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440ccab0 0x7f6d440cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 0x7f6d440cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44071410 con 0x7f6d440b8470 2023-05-21T16:54:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4415d290 con 0x7f6d30003a20 2023-05-21T16:54:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d49085700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4415d570 con 0x7f6d440ccab0 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 0x7f6d440cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30003a20 0x7f6d4415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 0x7f6d440cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34932/0 (socket says 172.21.15.46:34932) 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 -- 172.21.15.46:0/1465020055 learned_addr learned my addr 172.21.15.46:0/1465020055 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d437fe700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440ccab0 0x7f6d440cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 -- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440ccab0 msgr2=0x7f6d440cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440ccab0 0x7f6d440cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 -- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30003a20 msgr2=0x7f6d4415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30003a20 0x7f6d4415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 -- 172.21.15.46:0/1465020055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440b2480 con 0x7f6d440b8470 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.933+0000 7f6d48884700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 0x7f6d440cc3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d440d24e0 tx=0x7f6d3c007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c017070 con 0x7f6d440b8470 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00e8f0 con 0x7f6d440b8470 2023-05-21T16:54:28.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00eaa0 con 0x7f6d440b8470 2023-05-21T16:54:28.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440d15a0 con 0x7f6d440b8470 2023-05-21T16:54:28.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d440b2610 con 0x7f6d440b8470 2023-05-21T16:54:28.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4415d700 con 0x7f6d440b8470 2023-05-21T16:54:28.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d3c00ec00 con 0x7f6d440b8470 2023-05-21T16:54:28.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d40ff9700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d240662f0 0x7f6d240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:28.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d3c0836f0 con 0x7f6d440b8470 2023-05-21T16:54:28.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.937+0000 7f6d43fff700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d240662f0 0x7f6d240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:28.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.941+0000 7f6d43fff700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d240662f0 0x7f6d240687a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d340090b0 tx=0x7f6d3401e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:28.945+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6d3c050ad0 con 0x7f6d440b8470 2023-05-21T16:54:29.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.109+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d44073cb0 con 0x7f6d440b8470 2023-05-21T16:54:29.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.109+0000 7f6d40ff9700 1 -- 172.21.15.46:0/1465020055 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d3c0540f0 con 0x7f6d440b8470 2023-05-21T16:54:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d240662f0 msgr2=0x7f6d240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d240662f0 0x7f6d240687a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d340090b0 tx=0x7f6d3401e040 comp rx=0 tx=0).stop 2023-05-21T16:54:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 msgr2=0x7f6d440cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 0x7f6d440cc3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d440d24e0 tx=0x7f6d3c007cb0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 shutdown_connections 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d240662f0 0x7f6d240687a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d440b8470 0x7f6d440cc3a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d440ccab0 0x7f6d440cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 --2- 172.21.15.46:0/1465020055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d30003a20 0x7f6d4415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 >> 172.21.15.46:0/1465020055 conn(0x7f6d4406c170 msgr2=0x7f6d4406c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 shutdown_connections 2023-05-21T16:54:29.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.113+0000 7f6d49085700 1 -- 172.21.15.46:0/1465020055 wait complete. 2023-05-21T16:54:29.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.237+0000 7f9dd172f700 1 Processor -- start 2023-05-21T16:54:29.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.237+0000 7f9dd172f700 1 -- start start 2023-05-21T16:54:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9dcc0b5ce0 0x7f9dcc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b4910 0x7f9dcc0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc0b8ea0 con 0x7f9dcc0b8ad0 2023-05-21T16:54:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc0b52f0 con 0x7f9dcc0b5ce0 2023-05-21T16:54:29.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0d09d0 con 0x7f9dcc0b4910 2023-05-21T16:54:29.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9dcc0b5ce0 0x7f9dcc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9dcc0b5ce0 0x7f9dcc0cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34938/0 (socket says 172.21.15.46:34938) 2023-05-21T16:54:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd0f2e700 1 --2- 172.21.15.46:0/1974726457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b4910 0x7f9dcc0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 -- 172.21.15.46:0/1974726457 learned_addr learned my addr 172.21.15.46:0/1974726457 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 -- 172.21.15.46:0/1974726457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b4910 msgr2=0x7f9dcc0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 --2- 172.21.15.46:0/1974726457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b4910 0x7f9dcc0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 -- 172.21.15.46:0/1974726457 >> v1:172.21.15.142:6789/0 conn(0x7f9dcc0b8ad0 legacy=0x7f9dcc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 -- 172.21.15.46:0/1974726457 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0d0cb0 con 0x7f9dcc0b5ce0 2023-05-21T16:54:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcb7fe700 1 --2- 172.21.15.46:0/1974726457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc0cf310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009910 tx=0x7f9db4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1abbfdfded82c40 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcaffd700 1 -- 172.21.15.46:0/1974726457 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4011830 con 0x7f9dcc0b5ce0 2023-05-21T16:54:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcaffd700 1 -- 172.21.15.46:0/1974726457 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4011990 con 0x7f9dcc0b5ce0 2023-05-21T16:54:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dcaffd700 1 -- 172.21.15.46:0/1974726457 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4011d40 con 0x7f9dcc0b5ce0 2023-05-21T16:54:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- 172.21.15.46:0/1974726457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 msgr2=0x7f9dcc0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 --2- 172.21.15.46:0/1974726457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc0cf310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009910 tx=0x7f9db4009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- 172.21.15.46:0/1974726457 shutdown_connections 2023-05-21T16:54:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 --2- 172.21.15.46:0/1974726457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b4910 0x7f9dcc0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 --2- 172.21.15.46:0/1974726457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc0cf310 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- 172.21.15.46:0/1974726457 >> 172.21.15.46:0/1974726457 conn(0x7f9dcc0d3ae0 msgr2=0x7f9dcc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:29.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- 172.21.15.46:0/1974726457 shutdown_connections 2023-05-21T16:54:29.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.241+0000 7f9dd172f700 1 -- 172.21.15.46:0/1974726457 wait complete. 2023-05-21T16:54:29.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 Processor -- start 2023-05-21T16:54:29.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 -- start start 2023-05-21T16:54:29.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dcc0b4910 0x7f9dcc1f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b8ad0 0x7f9dcc06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15d270 con 0x7f9dcc0b5ce0 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15df30 con 0x7f9dcc0b4910 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd172f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15e210 con 0x7f9dcc0b8ad0 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dcc0b4910 0x7f9dcc1f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc1f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34954/0 (socket says 172.21.15.46:34954) 2023-05-21T16:54:29.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dcb7fe700 1 -- 172.21.15.46:0/3893255582 learned_addr learned my addr 172.21.15.46:0/3893255582 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:29.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.245+0000 7f9dd0f2e700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b8ad0 0x7f9dcc06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcbfff700 1 -- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b8ad0 msgr2=0x7f9dcc06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcbfff700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b8ad0 0x7f9dcc06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcbfff700 1 -- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 msgr2=0x7f9dcc1f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcbfff700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc1f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcbfff700 1 -- 172.21.15.46:0/3893255582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4009570 con 0x7f9dcc0b4910 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcbfff700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dcc0b4910 0x7f9dcc1f16e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c480 tx=0x7f9dc400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40052d0 con 0x7f9dcc0b4910 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc4005430 con 0x7f9dcc0b4910 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc0cd790 con 0x7f9dcc0b4910 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40055a0 con 0x7f9dcc0b4910 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc0cd4f0 con 0x7f9dcc0b4910 2023-05-21T16:54:29.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0cda70 con 0x7f9dcc0b4910 2023-05-21T16:54:29.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9dc40038e0 con 0x7f9dcc0b4910 2023-05-21T16:54:29.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dc8ff9700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9dac0662f0 0x7f9dac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dc4083040 con 0x7f9dcc0b4910 2023-05-21T16:54:29.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.249+0000 7f9dcb7fe700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9dac0662f0 0x7f9dac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.253+0000 7f9dcb7fe700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9dac0662f0 0x7f9dac0687a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc15a700 tx=0x7f9db4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.261+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9dc4050440 con 0x7f9dcc0b4910 2023-05-21T16:54:29.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.421+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9dcc15e070 con 0x7f9dcc0b4910 2023-05-21T16:54:29.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.421+0000 7f9dc8ff9700 1 -- 172.21.15.46:0/3893255582 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9dcc15e070 con 0x7f9dcc0b4910 2023-05-21T16:54:29.428 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:29.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9dac0662f0 msgr2=0x7f9dac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9dac0662f0 0x7f9dac0687a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc15a700 tx=0x7f9db4008030 comp rx=0 tx=0).stop 2023-05-21T16:54:29.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dcc0b4910 msgr2=0x7f9dcc1f16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dcc0b4910 0x7f9dcc1f16e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c480 tx=0x7f9dc400c790 comp rx=0 tx=0).stop 2023-05-21T16:54:29.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 shutdown_connections 2023-05-21T16:54:29.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9dac0662f0 0x7f9dac0687a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dcc0b8ad0 0x7f9dcc06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dcc0b5ce0 0x7f9dcc1f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 --2- 172.21.15.46:0/3893255582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dcc0b4910 0x7f9dcc1f16e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.425+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 >> 172.21.15.46:0/3893255582 conn(0x7f9dcc0d3ae0 msgr2=0x7f9dcc0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.429+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 shutdown_connections 2023-05-21T16:54:29.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.429+0000 7f9dd172f700 1 -- 172.21.15.46:0/3893255582 wait complete. 2023-05-21T16:54:29.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:29.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 Processor -- start 2023-05-21T16:54:29.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 -- start start 2023-05-21T16:54:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff51015d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5100cb3c0 0x7ff5100cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff510159ab0 con 0x7ff5100aeaf0 2023-05-21T16:54:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100caee0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff516aa9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100ce820 con 0x7ff5100ce080 2023-05-21T16:54:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff5152a6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff51015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff5162a8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5100cb3c0 0x7ff5100cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff515aa7700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff5100aeaf0 0x7ff51015d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:58108/0 (socket says 172.21.15.46:58108) 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff515aa7700 1 -- 172.21.15.46:0/947131133 learned_addr learned my addr 172.21.15.46:0/947131133 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff514aa5700 1 -- 172.21.15.46:0/947131133 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254834803 0 0) 0x7ff510159ab0 con 0x7ff5100aeaf0 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.569+0000 7ff514aa5700 1 -- 172.21.15.46:0/947131133 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f80035d0 con 0x7ff5100aeaf0 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff5162a8700 1 -- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 msgr2=0x7ff51015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff5162a8700 1 --2- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff51015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff5162a8700 1 -- 172.21.15.46:0/947131133 >> v1:172.21.15.142:6789/0 conn(0x7ff5100aeaf0 legacy=0x7ff51015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff5162a8700 1 -- 172.21.15.46:0/947131133 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100ceb00 con 0x7ff5100cb3c0 2023-05-21T16:54:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff5152a6700 1 --2- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff51015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff5162a8700 1 --2- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cb3c0 0x7ff5100cb840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff500009850 tx=0x7ff500009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603e7e5bccbc0a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff514aa5700 1 -- 172.21.15.46:0/947131133 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500011830 con 0x7ff5100cb3c0 2023-05-21T16:54:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff514aa5700 1 -- 172.21.15.46:0/947131133 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500011990 con 0x7ff5100cb3c0 2023-05-21T16:54:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff514aa5700 1 -- 172.21.15.46:0/947131133 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500011d00 con 0x7ff5100cb3c0 2023-05-21T16:54:29.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 -- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cb3c0 msgr2=0x7ff5100cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 --2- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cb3c0 0x7ff5100cb840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff500009850 tx=0x7ff500009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 -- 172.21.15.46:0/947131133 shutdown_connections 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 --2- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff51015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 --2- 172.21.15.46:0/947131133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100cb3c0 0x7ff5100cb840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 -- 172.21.15.46:0/947131133 >> 172.21.15.46:0/947131133 conn(0x7ff51006d930 msgr2=0x7ff51006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 -- 172.21.15.46:0/947131133 shutdown_connections 2023-05-21T16:54:29.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.573+0000 7ff516aa9700 1 -- 172.21.15.46:0/947131133 wait complete. 2023-05-21T16:54:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 Processor -- start 2023-05-21T16:54:29.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 -- start start 2023-05-21T16:54:29.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100aeaf0 0x7ff5101521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 0x7ff5100b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff5100c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b4ca0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b4ef0 con 0x7ff5100aeaf0 2023-05-21T16:54:29.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff516aa9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b51d0 con 0x7ff5100ce080 2023-05-21T16:54:29.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff5152a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 0x7ff5100b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff5152a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 0x7ff5100b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34968/0 (socket says 172.21.15.46:34968) 2023-05-21T16:54:29.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff5152a6700 1 -- 172.21.15.46:0/859425583 learned_addr learned my addr 172.21.15.46:0/859425583 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:29.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff515aa7700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100aeaf0 0x7ff5101521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.577+0000 7ff5162a8700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff5100c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff5152a6700 1 -- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 msgr2=0x7ff5100c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff5152a6700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff5100c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff5152a6700 1 -- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100aeaf0 msgr2=0x7ff5101521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff5152a6700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100aeaf0 0x7ff5101521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff5152a6700 1 -- 172.21.15.46:0/859425583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040094b0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff5152a6700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 0x7ff5100b4760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff50400ebe0 tx=0x7ff50400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400c850 con 0x7ff5100cb3c0 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400c9b0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000094b0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400cd40 con 0x7ff5100cb3c0 2023-05-21T16:54:29.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5100cf0c0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.581+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5100ce4d0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.585+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff504013470 con 0x7ff5100cb3c0 2023-05-21T16:54:29.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.585+0000 7ff50e7fc700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4fc0662f0 0x7ff4fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.585+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff504083ce0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.585+0000 7ff515aa7700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4fc0662f0 0x7ff4fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.585+0000 7ff515aa7700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4fc0662f0 0x7ff4fc0687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff508001560 tx=0x7ff5080019f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.589+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff5040511f0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.757+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5100ced90 con 0x7ff5100cb3c0 2023-05-21T16:54:29.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.757+0000 7ff50e7fc700 1 -- 172.21.15.46:0/859425583 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff50400cea0 con 0x7ff5100cb3c0 2023-05-21T16:54:29.763 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:29.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4fc0662f0 msgr2=0x7ff4fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4fc0662f0 0x7ff4fc0687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff508001560 tx=0x7ff5080019f0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 msgr2=0x7ff5100b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 0x7ff5100b4760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff50400ebe0 tx=0x7ff50400eef0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 shutdown_connections 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff4fc0662f0 0x7ff4fc0687a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5100ce080 0x7ff5100c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5100cb3c0 0x7ff5100b4760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 --2- 172.21.15.46:0/859425583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5100aeaf0 0x7ff5101521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 >> 172.21.15.46:0/859425583 conn(0x7ff51006d930 msgr2=0x7ff51006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 shutdown_connections 2023-05-21T16:54:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.761+0000 7ff516aa9700 1 -- 172.21.15.46:0/859425583 wait complete. 2023-05-21T16:54:29.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 Processor -- start 2023-05-21T16:54:29.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 -- start start 2023-05-21T16:54:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8a80d1ac0 0x7fd8a80b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8a80b6110 0x7fd8a81607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80d0d00 con 0x7fd8a80b4800 2023-05-21T16:54:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a8161520 con 0x7fd8a80b6110 2023-05-21T16:54:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80d0fe0 con 0x7fd8a80d1ac0 2023-05-21T16:54:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8a80b6110 0x7fd8a81607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8a80b6110 0x7fd8a81607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34982/0 (socket says 172.21.15.46:34982) 2023-05-21T16:54:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 -- 172.21.15.46:0/952406883 learned_addr learned my addr 172.21.15.46:0/952406883 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd89dd9b700 1 --2- 172.21.15.46:0/952406883 >> v2:172.21.15.142:3300/0 conn(0x7fd8a80d1ac0 0x7fd8a80b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 -- 172.21.15.46:0/952406883 >> v2:172.21.15.142:3300/0 conn(0x7fd8a80d1ac0 msgr2=0x7fd8a80b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 --2- 172.21.15.46:0/952406883 >> v2:172.21.15.142:3300/0 conn(0x7fd8a80d1ac0 0x7fd8a80b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 -- 172.21.15.46:0/952406883 >> v1:172.21.15.142:6789/0 conn(0x7fd8a80b4800 legacy=0x7fd8a80b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.893+0000 7fd8a6d9d700 1 -- 172.21.15.46:0/952406883 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80d12c0 con 0x7fd8a80b6110 2023-05-21T16:54:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a6d9d700 1 --2- 172.21.15.46:0/952406883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b6110 0x7fd8a81607b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80ce8f0 tx=0x7fd8a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa870cb9e68f97e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a5d9b700 1 -- 172.21.15.46:0/952406883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000e070 con 0x7fd8a80b6110 2023-05-21T16:54:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a5d9b700 1 -- 172.21.15.46:0/952406883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000b910 con 0x7fd8a80b6110 2023-05-21T16:54:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a5d9b700 1 -- 172.21.15.46:0/952406883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000bcc0 con 0x7fd8a80b6110 2023-05-21T16:54:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- 172.21.15.46:0/952406883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b6110 msgr2=0x7fd8a81607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 --2- 172.21.15.46:0/952406883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b6110 0x7fd8a81607b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80ce8f0 tx=0x7fd8a000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- 172.21.15.46:0/952406883 shutdown_connections 2023-05-21T16:54:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 --2- 172.21.15.46:0/952406883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b6110 0x7fd8a81607b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 --2- 172.21.15.46:0/952406883 >> v2:172.21.15.142:3300/0 conn(0x7fd8a80d1ac0 0x7fd8a80b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- 172.21.15.46:0/952406883 >> 172.21.15.46:0/952406883 conn(0x7fd8a806c170 msgr2=0x7fd8a806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- 172.21.15.46:0/952406883 shutdown_connections 2023-05-21T16:54:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- 172.21.15.46:0/952406883 wait complete. 2023-05-21T16:54:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 Processor -- start 2023-05-21T16:54:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- start start 2023-05-21T16:54:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 0x7fd8a8157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8a80b6110 0x7fd8a806a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8a80d1ac0 0x7fd8a815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a806ac90 con 0x7fd8a80b4800 2023-05-21T16:54:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80c6d00 con 0x7fd8a80d1ac0 2023-05-21T16:54:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80c6fe0 con 0x7fd8a80b6110 2023-05-21T16:54:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 0x7fd8a8157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 0x7fd8a8157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34992/0 (socket says 172.21.15.46:34992) 2023-05-21T16:54:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.897+0000 7fd8a659c700 1 -- 172.21.15.46:0/908742816 learned_addr learned my addr 172.21.15.46:0/908742816 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a6d9d700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8a80d1ac0 0x7fd8a815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd89dd9b700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8a80b6110 0x7fd8a806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a659c700 1 -- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8a80b6110 msgr2=0x7fd8a806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a659c700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8a80b6110 0x7fd8a806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a659c700 1 -- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8a80d1ac0 msgr2=0x7fd8a815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a659c700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8a80d1ac0 0x7fd8a815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a659c700 1 -- 172.21.15.46:0/908742816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a0009b30 con 0x7fd8a80b4800 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a6d9d700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8a80d1ac0 0x7fd8a815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a659c700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 0x7fd8a8157870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c500 tx=0x7fd89800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980052d0 con 0x7fd8a80b4800 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898005430 con 0x7fd8a80b4800 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a80b6590 con 0x7fd8a80b4800 2023-05-21T16:54:29.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8980055a0 con 0x7fd8a80b4800 2023-05-21T16:54:29.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a80d15a0 con 0x7fd8a80b4800 2023-05-21T16:54:29.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a80b2480 con 0x7fd8a80b4800 2023-05-21T16:54:29.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.901+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8980038e0 con 0x7fd8a80b4800 2023-05-21T16:54:29.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.905+0000 7fd89f7fe700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd888066320 0x7fd8880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:29.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.905+0000 7fd89dd9b700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd888066320 0x7fd8880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:29.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.905+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd898083160 con 0x7fd8a80b4800 2023-05-21T16:54:29.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.905+0000 7fd89dd9b700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd888066320 0x7fd8880687d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8a815fd70 tx=0x7fd890008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:29.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:29.909+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd8980505d0 con 0x7fd8a80b4800 2023-05-21T16:54:30.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8a8157db0 con 0x7fd8a80b4800 2023-05-21T16:54:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd89f7fe700 1 -- 172.21.15.46:0/908742816 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd898053bf0 con 0x7fd8a80b4800 2023-05-21T16:54:30.078 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd888066320 msgr2=0x7fd8880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd888066320 0x7fd8880687d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8a815fd70 tx=0x7fd890008040 comp rx=0 tx=0).stop 2023-05-21T16:54:30.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 msgr2=0x7fd8a8157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 0x7fd8a8157870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c500 tx=0x7fd89800c8c0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 shutdown_connections 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd888066320 0x7fd8880687d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8a80d1ac0 0x7fd8a815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8a80b6110 0x7fd8a806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 --2- 172.21.15.46:0/908742816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8a80b4800 0x7fd8a8157870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 >> 172.21.15.46:0/908742816 conn(0x7fd8a806c170 msgr2=0x7fd8a80b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 shutdown_connections 2023-05-21T16:54:30.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.073+0000 7fd8a759e700 1 -- 172.21.15.46:0/908742816 wait complete. 2023-05-21T16:54:30.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:54:30.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 Processor -- start 2023-05-21T16:54:30.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 -- start start 2023-05-21T16:54:30.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815e630 0x7f590815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59080ccf10 0x7f590815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59080702c0 0x7f5908070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5908070ca0 con 0x7f59080702c0 2023-05-21T16:54:30.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590806db30 con 0x7f59080ccf10 2023-05-21T16:54:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.197+0000 7f590e776700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080cd4a0 con 0x7f590815e630 2023-05-21T16:54:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59080702c0 0x7f5908070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59080702c0 0x7f5908070760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34994/0 (socket says 172.21.15.46:34994) 2023-05-21T16:54:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 -- 172.21.15.46:0/66590741 learned_addr learned my addr 172.21.15.46:0/66590741 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590cf73700 1 --2- 172.21.15.46:0/66590741 >> v2:172.21.15.142:3300/0 conn(0x7f59080ccf10 0x7f590815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590d774700 1 --2- 172.21.15.46:0/66590741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815e630 0x7f590815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 -- 172.21.15.46:0/66590741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815e630 msgr2=0x7f590815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 --2- 172.21.15.46:0/66590741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815e630 0x7f590815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 -- 172.21.15.46:0/66590741 >> v2:172.21.15.142:3300/0 conn(0x7f59080ccf10 msgr2=0x7f590815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 --2- 172.21.15.46:0/66590741 >> v2:172.21.15.142:3300/0 conn(0x7f59080ccf10 0x7f590815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 -- 172.21.15.46:0/66590741 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080cb2d0 con 0x7f59080702c0 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590df75700 1 --2- 172.21.15.46:0/66590741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f5908070760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f59080ce9b0 tx=0x7f590000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab969811a962100 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f58fffff700 1 -- 172.21.15.46:0/66590741 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000e070 con 0x7f59080702c0 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f58fffff700 1 -- 172.21.15.46:0/66590741 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590000b910 con 0x7f59080702c0 2023-05-21T16:54:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f58fffff700 1 -- 172.21.15.46:0/66590741 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000bcc0 con 0x7f59080702c0 2023-05-21T16:54:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 -- 172.21.15.46:0/66590741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 msgr2=0x7f5908070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 --2- 172.21.15.46:0/66590741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f5908070760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f59080ce9b0 tx=0x7f590000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 -- 172.21.15.46:0/66590741 shutdown_connections 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 --2- 172.21.15.46:0/66590741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f5908070760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 --2- 172.21.15.46:0/66590741 >> v2:172.21.15.142:3300/0 conn(0x7f59080ccf10 0x7f590815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 --2- 172.21.15.46:0/66590741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815e630 0x7f590815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 -- 172.21.15.46:0/66590741 >> 172.21.15.46:0/66590741 conn(0x7f59080cd6f0 msgr2=0x7f59080cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 -- 172.21.15.46:0/66590741 shutdown_connections 2023-05-21T16:54:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.201+0000 7f590e776700 1 -- 172.21.15.46:0/66590741 wait complete. 2023-05-21T16:54:30.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 Processor -- start 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 -- start start 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f59080ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59080ccf10 0x7f59081f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f590815e630 0x7f59081f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59081f5a70 con 0x7f59080702c0 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59081f2cd0 con 0x7f590815e630 2023-05-21T16:54:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59081f2fb0 con 0x7f59080ccf10 2023-05-21T16:54:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f59080ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f59080ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35006/0 (socket says 172.21.15.46:35006) 2023-05-21T16:54:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 -- 172.21.15.46:0/1091057229 learned_addr learned my addr 172.21.15.46:0/1091057229 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590cf73700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59080ccf10 0x7f59081f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590df75700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f590815e630 0x7f59081f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 -- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59080ccf10 msgr2=0x7f59081f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59080ccf10 0x7f59081f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 -- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f590815e630 msgr2=0x7f59081f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f590815e630 0x7f59081f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 -- 172.21.15.46:0/1091057229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900009b30 con 0x7f59080702c0 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590d774700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f59080ca6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58f800e870 tx=0x7f58f800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80095c0 con 0x7f59080702c0 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8013680 con 0x7f59080702c0 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8013a10 con 0x7f59080702c0 2023-05-21T16:54:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080cb890 con 0x7f59080702c0 2023-05-21T16:54:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.205+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59080cb5b0 con 0x7f59080702c0 2023-05-21T16:54:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.209+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59080d0930 con 0x7f59080702c0 2023-05-21T16:54:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.209+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58f8013b70 con 0x7f59080702c0 2023-05-21T16:54:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.209+0000 7f58fdffb700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f58ec0662f0 0x7f58ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.209+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58f8083a90 con 0x7f59080702c0 2023-05-21T16:54:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.209+0000 7f590cf73700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f58ec0662f0 0x7f58ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.213+0000 7f590cf73700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f58ec0662f0 0x7f58ec0687a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f59081f59d0 tx=0x7f5904009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.221+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f58f8054a30 con 0x7f59080702c0 2023-05-21T16:54:30.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59080733b0 con 0x7f59080702c0 2023-05-21T16:54:30.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f58fdffb700 1 -- 172.21.15.46:0/1091057229 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f58f80545c0 con 0x7f59080702c0 2023-05-21T16:54:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:30.417 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:54:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f58ec0662f0 msgr2=0x7f58ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f58ec0662f0 0x7f58ec0687a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f59081f59d0 tx=0x7f5904009240 comp rx=0 tx=0).stop 2023-05-21T16:54:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 msgr2=0x7f59080ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f59080ca6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58f800e870 tx=0x7f58f800eb80 comp rx=0 tx=0).stop 2023-05-21T16:54:30.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 shutdown_connections 2023-05-21T16:54:30.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f58ec0662f0 0x7f58ec0687a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f590815e630 0x7f59081f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59080ccf10 0x7f59081f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 --2- 172.21.15.46:0/1091057229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59080702c0 0x7f59080ca6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 >> 172.21.15.46:0/1091057229 conn(0x7f59080cd6f0 msgr2=0x7f59080b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 shutdown_connections 2023-05-21T16:54:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.413+0000 7f590e776700 1 -- 172.21.15.46:0/1091057229 wait complete. 2023-05-21T16:54:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:54:30.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:30.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.541+0000 7fe06b2b5700 1 Processor -- start 2023-05-21T16:54:30.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.541+0000 7fe06b2b5700 1 -- start start 2023-05-21T16:54:30.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe0640b5ce0 0x7fe0640cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0640b8ea0 con 0x7fe0640b4910 2023-05-21T16:54:30.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0640d09d0 con 0x7fe0640b8ad0 2023-05-21T16:54:30.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640d0cb0 con 0x7fe0640b5ce0 2023-05-21T16:54:30.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06aab4700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe0640b4910 0x7fe0640d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33166/0 (socket says 172.21.15.46:33166) 2023-05-21T16:54:30.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06aab4700 1 -- 172.21.15.46:0/485581080 learned_addr learned my addr 172.21.15.46:0/485581080 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:30.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe069ab2700 1 --2- 172.21.15.46:0/485581080 >> v2:172.21.15.142:3300/0 conn(0x7fe0640b5ce0 0x7fe0640cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe0692b1700 1 -- 172.21.15.46:0/485581080 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118226432 0 0) 0x7fe0640b8ea0 con 0x7fe0640b4910 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe0692b1700 1 -- 172.21.15.46:0/485581080 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0500035d0 con 0x7fe0640b4910 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe069ab2700 1 -- 172.21.15.46:0/485581080 >> v1:172.21.15.142:6789/0 conn(0x7fe0640b8ad0 legacy=0x7fe06406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe069ab2700 1 -- 172.21.15.46:0/485581080 >> v1:172.21.15.46:6789/0 conn(0x7fe0640b4910 legacy=0x7fe0640d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe069ab2700 1 -- 172.21.15.46:0/485581080 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640cd4f0 con 0x7fe0640b5ce0 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe069ab2700 1 --2- 172.21.15.46:0/485581080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b5ce0 0x7fe0640cf310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe060009850 tx=0x7fe060009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1b00075cd44249 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe0692b1700 1 -- 172.21.15.46:0/485581080 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060011830 con 0x7fe0640b5ce0 2023-05-21T16:54:30.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe0692b1700 1 -- 172.21.15.46:0/485581080 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe060011990 con 0x7fe0640b5ce0 2023-05-21T16:54:30.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe0692b1700 1 -- 172.21.15.46:0/485581080 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060011d40 con 0x7fe0640b5ce0 2023-05-21T16:54:30.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- 172.21.15.46:0/485581080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b5ce0 msgr2=0x7fe0640cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/485581080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b5ce0 0x7fe0640cf310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe060009850 tx=0x7fe060009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:30.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- 172.21.15.46:0/485581080 shutdown_connections 2023-05-21T16:54:30.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/485581080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b5ce0 0x7fe0640cf310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- 172.21.15.46:0/485581080 >> 172.21.15.46:0/485581080 conn(0x7fe0640d3ae0 msgr2=0x7fe0640cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:30.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- 172.21.15.46:0/485581080 shutdown_connections 2023-05-21T16:54:30.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.545+0000 7fe06b2b5700 1 -- 172.21.15.46:0/485581080 wait complete. 2023-05-21T16:54:30.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 Processor -- start 2023-05-21T16:54:30.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 -- start start 2023-05-21T16:54:30.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 0x7fe064159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0640b5ce0 0x7fe06415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b8ad0 0x7fe06415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064159e40 con 0x7fe0640b4910 2023-05-21T16:54:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06415ce50 con 0x7fe0640b8ad0 2023-05-21T16:54:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06b2b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06415d130 con 0x7fe0640b5ce0 2023-05-21T16:54:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06a2b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 0x7fe064159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06a2b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 0x7fe064159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35012/0 (socket says 172.21.15.46:35012) 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.549+0000 7fe06a2b3700 1 -- 172.21.15.46:0/2303125132 learned_addr learned my addr 172.21.15.46:0/2303125132 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe069ab2700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0640b5ce0 0x7fe06415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06aab4700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b8ad0 0x7fe06415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06a2b3700 1 -- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0640b5ce0 msgr2=0x7fe06415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06a2b3700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0640b5ce0 0x7fe06415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06a2b3700 1 -- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b8ad0 msgr2=0x7fe06415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06a2b3700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b8ad0 0x7fe06415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06a2b3700 1 -- 172.21.15.46:0/2303125132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600094b0 con 0x7fe0640b4910 2023-05-21T16:54:30.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06a2b3700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 0x7fe064159450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c500 tx=0x7fe05800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580052d0 con 0x7fe0640b4910 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058005430 con 0x7fe0640b4910 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580055a0 con 0x7fe0640b4910 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0640cda70 con 0x7fe0640b4910 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0640cd790 con 0x7fe0640b4910 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.553+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0640b4db0 con 0x7fe0640b4910 2023-05-21T16:54:30.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.557+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0580038e0 con 0x7fe0640b4910 2023-05-21T16:54:30.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.557+0000 7fe056ffd700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe0480662f0 0x7fe0480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.557+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe058082f30 con 0x7fe0640b4910 2023-05-21T16:54:30.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.557+0000 7fe069ab2700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe0480662f0 0x7fe0480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.557+0000 7fe069ab2700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe0480662f0 0x7fe0480687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0600090b0 tx=0x7fe060008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.565+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe058050440 con 0x7fe0640b4910 2023-05-21T16:54:30.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.729+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0640733b0 con 0x7fe0640b4910 2023-05-21T16:54:30.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.729+0000 7fe056ffd700 1 -- 172.21.15.46:0/2303125132 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fe058053a60 con 0x7fe0640b4910 2023-05-21T16:54:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:30.736 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:30.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe0480662f0 msgr2=0x7fe0480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe0480662f0 0x7fe0480687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0600090b0 tx=0x7fe060008030 comp rx=0 tx=0).stop 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 msgr2=0x7fe064159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 0x7fe064159450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c500 tx=0x7fe05800c810 comp rx=0 tx=0).stop 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 shutdown_connections 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe0480662f0 0x7fe0480687a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0640b8ad0 0x7fe06415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0640b5ce0 0x7fe06415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 --2- 172.21.15.46:0/2303125132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0640b4910 0x7fe064159450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 >> 172.21.15.46:0/2303125132 conn(0x7fe0640d3ae0 msgr2=0x7fe0640cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:30.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 shutdown_connections 2023-05-21T16:54:30.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.733+0000 7fe06b2b5700 1 -- 172.21.15.46:0/2303125132 wait complete. 2023-05-21T16:54:30.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:54:30.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe53c94b700 1 Processor -- start 2023-05-21T16:54:30.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe53c94b700 1 -- start start 2023-05-21T16:54:30.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe53c94b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe53806a420 0x7fe5380c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe53c94b700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5380ade30 con 0x7fe538160be0 2023-05-21T16:54:30.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe53c94b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5380cd210 con 0x7fe538069f80 2023-05-21T16:54:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe53c94b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5380cc970 con 0x7fe53806a420 2023-05-21T16:54:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe5377fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe538160be0 0x7fe5381651c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33180/0 (socket says 172.21.15.46:33180) 2023-05-21T16:54:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe5377fe700 1 -- 172.21.15.46:0/3444983339 learned_addr learned my addr 172.21.15.46:0/3444983339 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe537fff700 1 --2- 172.21.15.46:0/3444983339 >> v2:172.21.15.142:3300/0 conn(0x7fe53806a420 0x7fe5380c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe5367fc700 1 -- 172.21.15.46:0/3444983339 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849100642 0 0) 0x7fe5380ade30 con 0x7fe538160be0 2023-05-21T16:54:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe5367fc700 1 -- 172.21.15.46:0/3444983339 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5200035d0 con 0x7fe538160be0 2023-05-21T16:54:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe537fff700 1 -- 172.21.15.46:0/3444983339 >> v1:172.21.15.142:6789/0 conn(0x7fe538069f80 legacy=0x7fe538070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe537fff700 1 -- 172.21.15.46:0/3444983339 >> v1:172.21.15.46:6789/0 conn(0x7fe538160be0 legacy=0x7fe5381651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe5367fc700 1 -- 172.21.15.46:0/3444983339 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2594998024 0 0) 0x7fe5200035d0 con 0x7fe538160be0 2023-05-21T16:54:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe537fff700 1 -- 172.21.15.46:0/3444983339 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380ccc50 con 0x7fe53806a420 2023-05-21T16:54:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.857+0000 7fe537fff700 1 --2- 172.21.15.46:0/3444983339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe53806a420 0x7fe5380c18a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe530009dc0 tx=0x7fe53000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1788ccd9ce932d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe5367fc700 1 -- 172.21.15.46:0/3444983339 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000e070 con 0x7fe53806a420 2023-05-21T16:54:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe5367fc700 1 -- 172.21.15.46:0/3444983339 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000bae0 con 0x7fe53806a420 2023-05-21T16:54:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe5367fc700 1 -- 172.21.15.46:0/3444983339 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000be90 con 0x7fe53806a420 2023-05-21T16:54:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 -- 172.21.15.46:0/3444983339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe53806a420 msgr2=0x7fe5380c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3444983339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe53806a420 0x7fe5380c18a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe530009dc0 tx=0x7fe53000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 -- 172.21.15.46:0/3444983339 shutdown_connections 2023-05-21T16:54:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3444983339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe53806a420 0x7fe5380c18a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 -- 172.21.15.46:0/3444983339 >> 172.21.15.46:0/3444983339 conn(0x7fe5380cf720 msgr2=0x7fe5380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 -- 172.21.15.46:0/3444983339 shutdown_connections 2023-05-21T16:54:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 -- 172.21.15.46:0/3444983339 wait complete. 2023-05-21T16:54:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.861+0000 7fe53c94b700 1 Processor -- start 2023-05-21T16:54:30.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 -- start start 2023-05-21T16:54:30.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe538069f80 0x7fe5380c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 0x7fe538161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe538160be0 0x7fe5381f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538162390 con 0x7fe53806a420 2023-05-21T16:54:30.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380c2850 con 0x7fe538069f80 2023-05-21T16:54:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe538162580 con 0x7fe538160be0 2023-05-21T16:54:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 0x7fe538161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 0x7fe538161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35028/0 (socket says 172.21.15.46:35028) 2023-05-21T16:54:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 -- 172.21.15.46:0/3767443341 learned_addr learned my addr 172.21.15.46:0/3767443341 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe5377fe700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe538069f80 0x7fe5380c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe537fff700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe538160be0 0x7fe5381f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 -- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe538160be0 msgr2=0x7fe5381f9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe538160be0 0x7fe5381f9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 -- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe538069f80 msgr2=0x7fe5380c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe538069f80 0x7fe5380c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 -- 172.21.15.46:0/3767443341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009a70 con 0x7fe53806a420 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe536ffd700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 0x7fe538161e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe52800c500 tx=0x7fe52800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280052d0 con 0x7fe53806a420 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528005430 con 0x7fe53806a420 2023-05-21T16:54:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe538070730 con 0x7fe53806a420 2023-05-21T16:54:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280055a0 con 0x7fe53806a420 2023-05-21T16:54:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.865+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5380ccf30 con 0x7fe53806a420 2023-05-21T16:54:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.869+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380ae1a0 con 0x7fe53806a420 2023-05-21T16:54:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.869+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5280038e0 con 0x7fe53806a420 2023-05-21T16:54:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.869+0000 7fe51ffff700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5240662f0 0x7fe5240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.869+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5280830a0 con 0x7fe53806a420 2023-05-21T16:54:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.869+0000 7fe5377fe700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5240662f0 0x7fe5240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.869+0000 7fe5377fe700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5240662f0 0x7fe5240687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe52c007fd0 tx=0x7fe52c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:30.877+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe528050520 con 0x7fe53806a420 2023-05-21T16:54:31.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.081+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe538164580 con 0x7fe53806a420 2023-05-21T16:54:31.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.081+0000 7fe51ffff700 1 -- 172.21.15.46:0/3767443341 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fe528053b40 con 0x7fe53806a420 2023-05-21T16:54:31.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:31.086 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:54:31.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5240662f0 msgr2=0x7fe5240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5240662f0 0x7fe5240687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe52c007fd0 tx=0x7fe52c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:31.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 msgr2=0x7fe538161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 0x7fe538161e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe52800c500 tx=0x7fe52800c810 comp rx=0 tx=0).stop 2023-05-21T16:54:31.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 shutdown_connections 2023-05-21T16:54:31.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe5240662f0 0x7fe5240687a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe538160be0 0x7fe5381f9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe53806a420 0x7fe538161e50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 --2- 172.21.15.46:0/3767443341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe538069f80 0x7fe5380c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 >> 172.21.15.46:0/3767443341 conn(0x7fe5380cf720 msgr2=0x7fe53815eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 shutdown_connections 2023-05-21T16:54:31.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.085+0000 7fe53c94b700 1 -- 172.21.15.46:0/3767443341 wait complete. 2023-05-21T16:54:31.092 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:54:31.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-21T16:54:18.140172+0000', 'modified': '2023-05-21T16:54:20.777200+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6837/364820067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 364820067}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 364820067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-21T16:54:31.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-21T16:54:31.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-21T16:54:31.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.629+0000 7f4a9ee9a700 1 Processor -- start 2023-05-21T16:54:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.629+0000 7f4a9ee9a700 1 -- start start 2023-05-21T16:54:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4a9815c610 0x7f4a980ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a980b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a980cebf0 con 0x7f4a980ce630 2023-05-21T16:54:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9806aeb0 con 0x7f4a9815c610 2023-05-21T16:54:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980ca190 con 0x7f4a9815c9e0 2023-05-21T16:54:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9de98700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4a9815c610 0x7f4a980ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9d697700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a980b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9e699700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4a980ce630 0x7f4a98160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:58140/0 (socket says 172.21.15.46:58140) 2023-05-21T16:54:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9e699700 1 -- 172.21.15.46:0/931939952 learned_addr learned my addr 172.21.15.46:0/931939952 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9d697700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a980b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37934/0 (socket says 172.21.15.46:37934) 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9de98700 1 -- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 msgr2=0x7f4a980b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9de98700 1 --2- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a980b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9de98700 1 -- 172.21.15.46:0/931939952 >> v1:172.21.15.142:6789/0 conn(0x7f4a980ce630 legacy=0x7f4a98160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9de98700 1 -- 172.21.15.46:0/931939952 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980cee40 con 0x7f4a9815c610 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9d697700 1 --2- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a980b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:31.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9de98700 1 --2- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a9815c610 0x7f4a980ce0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009850 tx=0x7f4a8c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b31a54c2408976 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ce96700 1 -- 172.21.15.46:0/931939952 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c004230 con 0x7f4a9815c610 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ce96700 1 -- 172.21.15.46:0/931939952 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c004390 con 0x7f4a9815c610 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ce96700 1 -- 172.21.15.46:0/931939952 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0036c0 con 0x7f4a9815c610 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a9815c610 msgr2=0x7f4a980ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a9815c610 0x7f4a980ce0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009850 tx=0x7f4a8c009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/931939952 shutdown_connections 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a980b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/931939952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a9815c610 0x7f4a980ce0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/931939952 >> 172.21.15.46:0/931939952 conn(0x7f4a980cfbd0 msgr2=0x7f4a980cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/931939952 shutdown_connections 2023-05-21T16:54:31.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.633+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/931939952 wait complete. 2023-05-21T16:54:31.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 Processor -- start 2023-05-21T16:54:31.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 -- start start 2023-05-21T16:54:31.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a980ce630 0x7f4a98155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 0x7f4a980c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a9815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980c7c40 con 0x7f4a9815c610 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980c8340 con 0x7f4a980ce630 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9ee9a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980c8620 con 0x7f4a9815c9e0 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 0x7f4a980c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 0x7f4a980c3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35036/0 (socket says 172.21.15.46:35036) 2023-05-21T16:54:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 -- 172.21.15.46:0/2450988768 learned_addr learned my addr 172.21.15.46:0/2450988768 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9e699700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a9815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9de98700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a980ce630 0x7f4a98155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 -- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 msgr2=0x7f4a9815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a9815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 -- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a980ce630 msgr2=0x7f4a98155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a980ce630 0x7f4a98155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 -- 172.21.15.46:0/2450988768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a88009a70 con 0x7f4a9815c610 2023-05-21T16:54:31.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a9d697700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 0x7f4a980c3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800efc0 tx=0x7f4a8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.637+0000 7f4a967fc700 1 -- 172.21.15.46:0/2450988768 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800cd10 con 0x7f4a9815c610 2023-05-21T16:54:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a967fc700 1 -- 172.21.15.46:0/2450988768 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8800f040 con 0x7f4a9815c610 2023-05-21T16:54:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c0094b0 con 0x7f4a9815c610 2023-05-21T16:54:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a967fc700 1 -- 172.21.15.46:0/2450988768 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a880146c0 con 0x7f4a9815c610 2023-05-21T16:54:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a980cf400 con 0x7f4a9815c610 2023-05-21T16:54:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a967fc700 1 -- 172.21.15.46:0/2450988768 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a88014820 con 0x7f4a9815c610 2023-05-21T16:54:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a967fc700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a840662f0 0x7f4a840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a967fc700 1 -- 172.21.15.46:0/2450988768 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a88084610 con 0x7f4a9815c610 2023-05-21T16:54:31.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a9de98700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a840662f0 0x7f4a840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.641+0000 7f4a9de98700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a840662f0 0x7f4a840687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009850 tx=0x7f4a8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.645+0000 7f4aa337b740 1 Processor -- start 2023-05-21T16:54:31.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.645+0000 7f4aa337b740 1 -- start start 2023-05-21T16:54:31.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x28e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x27b7b30 con 0x262aae0 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x280a710 con 0x27fb4f0 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x2803970 con 0x262aeb0 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35048/0 (socket says 172.21.15.46:35048) 2023-05-21T16:54:31.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 -- 172.21.15.46:0/2477658289 learned_addr learned my addr 172.21.15.46:0/2477658289 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9d697700 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x28e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9de98700 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 -- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 msgr2=0x28e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x28e38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 -- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 msgr2=0x28e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 -- 172.21.15.46:0/2477658289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27c9a10 con 0x262aae0 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9de98700 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a9e699700 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28ac9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a90004f20 tx=0x7f4a90007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b28fd247369f2e server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a7f7fe700 1 -- 172.21.15.46:0/2477658289 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90004a70 con 0x262aae0 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a7f7fe700 1 -- 172.21.15.46:0/2477658289 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90001620 con 0x262aae0 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4a7f7fe700 1 -- 172.21.15.46:0/2477658289 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900019d0 con 0x262aae0 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- 172.21.15.46:0/2477658289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 msgr2=0x28ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28ac9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a90004f20 tx=0x7f4a90007340 comp rx=0 tx=0).stop 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- 172.21.15.46:0/2477658289 shutdown_connections 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28ac9c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x28e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- 172.21.15.46:0/2477658289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- 172.21.15.46:0/2477658289 >> 172.21.15.46:0/2477658289 conn(0x2894310 msgr2=0x28c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- 172.21.15.46:0/2477658289 shutdown_connections 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- 172.21.15.46:0/2477658289 wait complete. 2023-05-21T16:54:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 -- start start 2023-05-21T16:54:31.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 Processor -- start 2023-05-21T16:54:31.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28df310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x289d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.649+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x27a1b00 con 0x262aae0 2023-05-21T16:54:31.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c6d60 con 0x27fb4f0 2023-05-21T16:54:31.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x26afb20 con 0x262aeb0 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 10 client.0 _ll_register_callbacks cb 0x27fd210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28df310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35056/0 (socket says 172.21.15.46:35056) 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 -- 172.21.15.46:0/1035567700 learned_addr learned my addr 172.21.15.46:0/1035567700 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9e699700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9d697700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x289d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 -- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 msgr2=0x289d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x289d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 -- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 msgr2=0x28992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 -- 172.21.15.46:0/1035567700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a90004bd0 con 0x262aae0 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9de98700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28df310 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c004000 tx=0x7f4a8c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb284a89b7d9463 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 1 -- 172.21.15.46:0/1035567700 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c02e070 con 0x262aae0 2023-05-21T16:54:31.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 1 -- 172.21.15.46:0/1035567700 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a8c034c30 con 0x262aae0 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27fc950 con 0x262aae0 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 1 -- 172.21.15.46:0/1035567700 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a8c020070 con 0x262aae0 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 10 client.4689 fetch_fsmap learned FSMap version 7 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x26769e0 con 0x262aae0 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 1 -- 172.21.15.46:0/1035567700 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27fc950 con 0x262aae0 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 1 -- 172.21.15.46:0/1035567700 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4a8c011630 con 0x262aae0 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 10 client.4689 fetch_fsmap finished waiting for FSMap version 7 2023-05-21T16:54:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 10 client.4689 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 20 client.4689 populate_metadata read hostname 'smithi046' 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x262a710 0x28e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 4 client.4689 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 --> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27be830 con 0x262a710 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9d697700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x262a710 0x28e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a7cff9700 10 client.4689 ms_handle_connect on v2:172.21.15.46:6836/364820067 2023-05-21T16:54:31.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.653+0000 7f4a9d697700 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x262a710 0x28e9b40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6542e4a580587874 server_cookie=f373e2d2ac951434 in_seq=0 out_seq=0 2023-05-21T16:54:31.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4a7cff9700 1 -- 172.21.15.46:0/1035567700 <== mds.0 v2:172.21.15.46:6836/364820067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x27be830 con 0x262a710 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4a7cff9700 10 client.4689 handle_command_reply: tid=0 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 client.4689 shutdown 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 msgr2=0x28df310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28df310 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c004000 tx=0x7f4a8c0047e0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 shutdown_connections 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x262a710 0x28e9b40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aeb0 0x289d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 --2- 172.21.15.46:0/1035567700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28df310 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4a7cff9700 0 client.4689 ms_handle_reset on v2:172.21.15.46:6836/364820067 2023-05-21T16:54:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 >> 172.21.15.46:0/1035567700 conn(0x2894310 msgr2=0x289deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 shutdown_connections 2023-05-21T16:54:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 1 -- 172.21.15.46:0/1035567700 wait complete. 2023-05-21T16:54:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.657+0000 7f4aa337b740 20 client.4689 trim_cache size 0 max 16384 2023-05-21T16:54:31.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 Processor -- start 2023-05-21T16:54:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 -- start start 2023-05-21T16:54:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aae0 0x28e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 0x28c2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x2807970 con 0x262aeb0 2023-05-21T16:54:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x27a4850 con 0x27fb4f0 2023-05-21T16:54:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x27fdc70 con 0x262aae0 2023-05-21T16:54:31.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4a9d697700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 0x28c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4a9d697700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 0x28c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35072/0 (socket says 172.21.15.46:35072) 2023-05-21T16:54:31.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4a9d697700 1 -- 172.21.15.46:0/647704620 learned_addr learned my addr 172.21.15.46:0/647704620 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:31.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4a9e699700 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.677+0000 7f4a9de98700 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aae0 0x28e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a9d697700 1 -- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aae0 msgr2=0x28e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a9d697700 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aae0 0x28e82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a9d697700 1 -- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 msgr2=0x28c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a9d697700 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a9d697700 1 -- 172.21.15.46:0/647704620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9815ac80 con 0x262aeb0 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a9d697700 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 0x28c2190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a880598e0 tx=0x7f4a88016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6515c178da4c4643 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a7ffff700 1 -- 172.21.15.46:0/647704620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8806e070 con 0x262aeb0 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a7ffff700 1 -- 172.21.15.46:0/647704620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a88082af0 con 0x262aeb0 2023-05-21T16:54:31.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4a7ffff700 1 -- 172.21.15.46:0/647704620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a880538a0 con 0x262aeb0 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 -- 172.21.15.46:0/647704620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 msgr2=0x28c2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 0x28c2190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4a880598e0 tx=0x7f4a88016040 comp rx=0 tx=0).stop 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 -- 172.21.15.46:0/647704620 shutdown_connections 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x27fb4f0 0x28c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aeb0 0x28c2190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 --2- 172.21.15.46:0/647704620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x262aae0 0x28e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 -- 172.21.15.46:0/647704620 >> 172.21.15.46:0/647704620 conn(0x2894310 msgr2=0x28c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 -- 172.21.15.46:0/647704620 shutdown_connections 2023-05-21T16:54:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.681+0000 7f4aa337b740 1 -- 172.21.15.46:0/647704620 wait complete. 2023-05-21T16:54:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 -- start start 2023-05-21T16:54:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 Processor -- start 2023-05-21T16:54:31.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28e6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x262aeb0 0x2899090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x27fb4f0 0x28e7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d95f0 con 0x262aae0 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x2800d70 con 0x262aeb0 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x28c2ac0 con 0x27fb4f0 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4aa337b740 10 client.0 _ll_register_callbacks cb 0x7f4a90004950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-21T16:54:31.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28e6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35078/0 (socket says 172.21.15.46:35078) 2023-05-21T16:54:31.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 -- 172.21.15.46:0/3373913533 learned_addr learned my addr 172.21.15.46:0/3373913533 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:31.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9d697700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x262aeb0 0x2899090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9e699700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x27fb4f0 0x28e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 -- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x27fb4f0 msgr2=0x28e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x27fb4f0 0x28e7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 -- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x262aeb0 msgr2=0x2899090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x262aeb0 0x2899090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 -- 172.21.15.46:0/3373913533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a980cf400 con 0x262aae0 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a9de98700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28e6170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c004000 tx=0x7f4a8c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ff4a8c92f4e029 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.685+0000 7f4a7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 1 -- 172.21.15.46:0/3373913533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c020040 con 0x262aae0 2023-05-21T16:54:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 1 -- 172.21.15.46:0/3373913533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a8c03de30 con 0x262aae0 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a90001620 con 0x262aae0 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 1 -- 172.21.15.46:0/3373913533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a8c003c10 con 0x262aae0 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 10 client.4695 fetch_fsmap learned FSMap version 7 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x27afe40 con 0x262aae0 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 1 -- 172.21.15.46:0/3373913533 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90001620 con 0x262aae0 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 1 -- 172.21.15.46:0/3373913533 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4a8c011630 con 0x262aae0 2023-05-21T16:54:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 10 client.4695 fetch_fsmap finished waiting for FSMap version 7 2023-05-21T16:54:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 10 client.4695 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-21T16:54:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 20 client.4695 populate_metadata read hostname 'smithi046' 2023-05-21T16:54:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x2675790 0x28e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 4 client.4695 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-05-21T16:54:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 --> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] -- command(tid 0: {"prefix": "status"}) v1 -- 0x26824e0 con 0x2675790 2023-05-21T16:54:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a9d697700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x2675790 0x28e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 10 client.4695 ms_handle_connect on v2:172.21.15.46:6836/364820067 2023-05-21T16:54:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a9d697700 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x2675790 0x28e5760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c6123648937c2a server_cookie=da00aba35c09b7de in_seq=0 out_seq=0 2023-05-21T16:54:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 1 -- 172.21.15.46:0/3373913533 <== mds.0 v2:172.21.15.46:6836/364820067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x26824e0 con 0x2675790 2023-05-21T16:54:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 10 client.4695 handle_command_reply: tid=0 2023-05-21T16:54:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 client.4695 shutdown 2023-05-21T16:54:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 msgr2=0x28e6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28e6170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c004000 tx=0x7f4a8c009240 comp rx=0 tx=0).stop 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 shutdown_connections 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:6836/364820067,v1:172.21.15.46:6837/364820067] conn(0x2675790 0x28e5760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x27fb4f0 0x28e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4a7cff9700 0 client.4695 ms_handle_reset on v2:172.21.15.46:6836/364820067 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x262aeb0 0x2899090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 --2- 172.21.15.46:0/3373913533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x262aae0 0x28e6170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 >> 172.21.15.46:0/3373913533 conn(0x2894310 msgr2=0x28c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 shutdown_connections 2023-05-21T16:54:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 1 -- 172.21.15.46:0/3373913533 wait complete. 2023-05-21T16:54:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.689+0000 7f4aa337b740 20 client.4695 trim_cache size 0 max 16384 2023-05-21T16:54:31.700 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-21T16:54:31.700 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "88c6000c-747d-47ed-bada-4d7002233c90", 2023-05-21T16:54:31.700 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4302, 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 13.550589921, 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 7, 2023-05-21T16:54:31.701 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 24, 2023-05-21T16:54:31.702 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 24, 2023-05-21T16:54:31.702 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 17.962086534000001 2023-05-21T16:54:31.702 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a840662f0 msgr2=0x7f4a840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a840662f0 0x7f4a840687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009850 tx=0x7f4a8c008030 comp rx=0 tx=0).stop 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 msgr2=0x7f4a980c3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 0x7f4a980c3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800efc0 tx=0x7f4a8800c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 shutdown_connections 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a840662f0 0x7f4a840687a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a9815c9e0 0x7f4a9815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a9815c610 0x7f4a980c3670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 --2- 172.21.15.46:0/2450988768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a980ce630 0x7f4a98155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 >> 172.21.15.46:0/2450988768 conn(0x7f4a980cfbd0 msgr2=0x7f4a980cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 shutdown_connections 2023-05-21T16:54:31.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:31.693+0000 7f4a9ee9a700 1 -- 172.21.15.46:0/2450988768 wait complete. 2023-05-21T16:54:31.714 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-21T16:54:31.800 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-21T16:54:31.801 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-21T16:54:31.801 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-21T16:54:31.801 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-21T16:54:31.802 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:31.802 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-21T16:54:31.802 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-21T16:54:31.802 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:31.803 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-21T16:54:31.803 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-21T16:54:31.803 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:31.803 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-21T16:54:31.803 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-21T16:54:31.804 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:31.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:31.804 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-05-21T16:54:31.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:31.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-05-21T16:54:31.876 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-05-21T16:54:31.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:54:31.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:31.878 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-05-21T16:54:31.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:31.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-05-21T16:54:31.905 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-05-21T16:54:31.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T16:54:31.907 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-21T16:54:31.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-21T16:54:32.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa3160700 1 Processor -- start 2023-05-21T16:54:32.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa3160700 1 -- start start 2023-05-21T16:54:32.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa3160700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c06c760 0x7ffa9c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:32.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa3160700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c06b9d0 con 0x7ffa9c0c9cd0 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa3160700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c06b450 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa3160700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c159a90 con 0x7ffa9c06c760 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa295f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffa9c0c9cd0 0x7ffa9c0ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33188/0 (socket says 172.21.15.46:33188) 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa295f700 1 -- 172.21.15.46:0/3551879682 learned_addr learned my addr 172.21.15.46:0/3551879682 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa215e700 1 --2- 172.21.15.46:0/3551879682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c06c760 0x7ffa9c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa115c700 1 -- 172.21.15.46:0/3551879682 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878673824 0 0) 0x7ffa9c06b9d0 con 0x7ffa9c0c9cd0 2023-05-21T16:54:32.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.025+0000 7ffaa115c700 1 -- 172.21.15.46:0/3551879682 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa880035d0 con 0x7ffa9c0c9cd0 2023-05-21T16:54:32.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa215e700 1 -- 172.21.15.46:0/3551879682 >> v1:172.21.15.142:6789/0 conn(0x7ffa9c15dbb0 legacy=0x7ffa9c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa115c700 1 -- 172.21.15.46:0/3551879682 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508180820 0 0) 0x7ffa9c06b450 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa215e700 1 -- 172.21.15.46:0/3551879682 >> v1:172.21.15.46:6789/0 conn(0x7ffa9c0c9cd0 legacy=0x7ffa9c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa215e700 1 -- 172.21.15.46:0/3551879682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c06b6f0 con 0x7ffa9c06c760 2023-05-21T16:54:32.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa215e700 1 --2- 172.21.15.46:0/3551879682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c06c760 0x7ffa9c15a830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009880 tx=0x7ffa8c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f60ef38ec93fca server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:32.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa115c700 1 -- 172.21.15.46:0/3551879682 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94001670 con 0x7ffa9c06c760 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa115c700 1 -- 172.21.15.46:0/3551879682 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c010590 con 0x7ffa9c06c760 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa115c700 1 -- 172.21.15.46:0/3551879682 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c010940 con 0x7ffa9c06c760 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 -- 172.21.15.46:0/3551879682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c06c760 msgr2=0x7ffa9c15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3551879682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c06c760 0x7ffa9c15a830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009880 tx=0x7ffa8c009b90 comp rx=0 tx=0).stop 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 -- 172.21.15.46:0/3551879682 shutdown_connections 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3551879682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c06c760 0x7ffa9c15a830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 -- 172.21.15.46:0/3551879682 >> 172.21.15.46:0/3551879682 conn(0x7ffa9c0cf720 msgr2=0x7ffa9c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 -- 172.21.15.46:0/3551879682 shutdown_connections 2023-05-21T16:54:32.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 -- 172.21.15.46:0/3551879682 wait complete. 2023-05-21T16:54:32.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 Processor -- start 2023-05-21T16:54:32.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.029+0000 7ffaa3160700 1 -- start start 2023-05-21T16:54:32.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa9c0c9cd0 0x7ffa9c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:32.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 0x7ffa9c14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:32.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c15a830 0x7ffa9c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:32.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c15bf00 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c14b620 con 0x7ffa9c0c9cd0 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c15b2f0 con 0x7ffa9c15a830 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 0x7ffa9c14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 0x7ffa9c14b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35084/0 (socket says 172.21.15.46:35084) 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa295f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c15a830 0x7ffa9c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 -- 172.21.15.46:0/3062133462 learned_addr learned my addr 172.21.15.46:0/3062133462 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa215e700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa9c0c9cd0 0x7ffa9c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 -- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c15a830 msgr2=0x7ffa9c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c15a830 0x7ffa9c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 -- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa9c0c9cd0 msgr2=0x7ffa9c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa9c0c9cd0 0x7ffa9c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 -- 172.21.15.46:0/3062133462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0094b0 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa195d700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 0x7ffa9c14b0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800cc50 tx=0x7ffa9800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98003e50 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9800a6c0 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c15a030 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800aa70 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c159d50 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.033+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c15a310 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.037+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa9800abd0 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.037+0000 7ffa92ffd700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffa80066320 0x7ffa800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.037+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa98083720 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.037+0000 7ffaa215e700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffa80066320 0x7ffa800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:32.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.037+0000 7ffaa215e700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffa80066320 0x7ffa800687d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c06f490 tx=0x7ffa8c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:32.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.045+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffa98050ba0 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa9c0733b0 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffa92ffd700 1 -- 172.21.15.46:0/3062133462 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffa980541c0 con 0x7ffa9c15dbb0 2023-05-21T16:54:32.253 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-21T16:54:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffa80066320 msgr2=0x7ffa800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffa80066320 0x7ffa800687d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c06f490 tx=0x7ffa8c010000 comp rx=0 tx=0).stop 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 msgr2=0x7ffa9c14b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 0x7ffa9c14b0e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800cc50 tx=0x7ffa9800cf60 comp rx=0 tx=0).stop 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 shutdown_connections 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffa80066320 0x7ffa800687d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa9c15a830 0x7ffa9c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c15dbb0 0x7ffa9c14b0e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 --2- 172.21.15.46:0/3062133462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa9c0c9cd0 0x7ffa9c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:32.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 >> 172.21.15.46:0/3062133462 conn(0x7ffa9c0cf720 msgr2=0x7ffa9c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:32.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 shutdown_connections 2023-05-21T16:54:32.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:32.249+0000 7ffaa3160700 1 -- 172.21.15.46:0/3062133462 wait complete. 2023-05-21T16:54:32.269 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-21T16:54:32.269 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-21T16:54:32.269 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-05-21T16:54:32.269 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-21T16:54:32.269 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:32.270 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-21T16:54:32.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-21T16:54:32.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-21T16:54:32.270 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-21T16:54:32.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.271 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-05-21T16:54:32.278 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:32.278 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:32.278 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:32.279 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42601sec preferred_lft 42601sec 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:32.280 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:32.281 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:32.281 INFO:teuthology.orchestra.run.smithi046.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-21T16:54:32.281 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 02:42:3f:7c:3c:7d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:32.281 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-21T16:54:32.281 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:32.282 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-21T16:54:32.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.282 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:32.283 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:32.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2023-05-21T16:54:32.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2023-05-21T16:54:32.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2023-05-21T16:54:32.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-21T16:54:32.284 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:32.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.365 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-21T16:54:32.374 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-05-21T16:54:32.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.376 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-05-21T16:54:32.406 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-05-21T16:54:32.406 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-21T16:54:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-21T16:54:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-21T16:54:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-21T16:54:32.407 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-21T16:54:32.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:32.408 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:32.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-21T16:54:32.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-21T16:54:32.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-21T16:54:32.409 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:32.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.445 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-05-21T16:54:32.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.495 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-05-21T16:54:32.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.503 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:32.503 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:32.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-21T16:54:32.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-21T16:54:32.503 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:32.535 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-21T16:54:32.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:32.536 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:32.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-21T16:54:32.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-21T16:54:32.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-21T16:54:32.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-21T16:54:32.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-21T16:54:32.538 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:32.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.646 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:32.646 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:32.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-05-21T16:54:32.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2023-05-21T16:54:32.647 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:32.675 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-21T16:54:32.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:32.675 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:32.681 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-21T16:54:32.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:32.682 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:32.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:54:32.747 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:32.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:32.762 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:32.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.763 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:54:32.810 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-21T16:54:32.810 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-21T16:54:32.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:54:32.829 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:32.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:32.843 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:32.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:32.844 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:54:32.916 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2023-05-21T16:54:32.913+0000 7f453177d640 -1 init, newargv = 0x5647631a1270 newargc=15 2023-05-21T16:54:32.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[41557]: starting ceph client 2023-05-21T16:54:32.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[41557]: starting fuse 2023-05-21T16:54:33.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:54:33.969 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:33.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:34.027 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:34.028 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:34.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.029 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:54:34.036 INFO:teuthology.orchestra.run.smithi046.stdout:52 2023-05-21T16:54:34.037 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-05-21T16:54:34.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-21T16:54:34.037 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2023-05-21T16:54:34.038 DEBUG:teuthology.orchestra.run.smithi046:> import re 2023-05-21T16:54:34.038 DEBUG:teuthology.orchestra.run.smithi046:> import os 2023-05-21T16:54:34.038 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2023-05-21T16:54:34.038 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:34.039 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2023-05-21T16:54:34.039 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-21T16:54:34.039 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2023-05-21T16:54:34.039 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-21T16:54:34.040 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:34.040 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2023-05-21T16:54:34.040 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2023-05-21T16:54:34.040 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2023-05-21T16:54:34.041 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2023-05-21T16:54:34.041 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:34.041 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2023-05-21T16:54:34.041 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-21T16:54:34.042 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-21T16:54:34.042 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-21T16:54:34.042 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2023-05-21T16:54:34.042 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2023-05-21T16:54:34.042 DEBUG:teuthology.orchestra.run.smithi046:> return f 2023-05-21T16:54:34.043 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-21T16:54:34.043 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:34.043 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2023-05-21T16:54:34.043 DEBUG:teuthology.orchestra.run.smithi046:> ' 2023-05-21T16:54:34.128 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.41557.asok 2023-05-21T16:54:34.311 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41557.asok 2023-05-21T16:54:34.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41557.asok status 2023-05-21T16:54:34.456 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-21T16:54:34.456 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2023-05-21T16:54:34.456 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1", 2023-05-21T16:54:34.456 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.0.0-3996-g5ca1fdcf (5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1) reef (dev)", 2023-05-21T16:54:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2023-05-21T16:54:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2023-05-21T16:54:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-21T16:54:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "41557", 2023-05-21T16:54:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2023-05-21T16:54:34.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4704, 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4704 2023-05-21T16:54:34.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:34.459 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-05-21T16:54:34.459 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-05-21T16:54:34.459 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-05-21T16:54:34.459 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1127072074 2023-05-21T16:54:34.459 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:54:34.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-05-21T16:54:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-05-21T16:54:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-05-21T16:54:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1127072074 2023-05-21T16:54:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4704 192.168.0.1:0/1127072074", 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/1127072074", 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 7, 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 24, 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2023-05-21T16:54:34.461 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-21T16:54:34.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-21T16:54:34.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f3785820700 1 Processor -- start 2023-05-21T16:54:34.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f3785820700 1 -- start start 2023-05-21T16:54:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f3785820700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378015c590 0x7f37800cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f3785820700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37801602b0 con 0x7f37800cdd30 2023-05-21T16:54:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f3785820700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3780160590 con 0x7f37800cc380 2023-05-21T16:54:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f3785820700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3780160870 con 0x7f378015c590 2023-05-21T16:54:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f378501f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f37800cdd30 0x7f37800ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33830/0 (socket says 172.21.15.46:33830) 2023-05-21T16:54:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f378501f700 1 -- 172.21.15.46:0/2096596248 learned_addr learned my addr 172.21.15.46:0/2096596248 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:34.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.573+0000 7f378481e700 1 --2- 172.21.15.46:0/2096596248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378015c590 0x7f37800cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031461316 0 0) 0x7f37801602b0 con 0x7f37800cdd30 2023-05-21T16:54:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37680035d0 con 0x7f37800cdd30 2023-05-21T16:54:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875953690 0 0) 0x7f3780160590 con 0x7f37800cc380 2023-05-21T16:54:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37801602b0 con 0x7f37800cc380 2023-05-21T16:54:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f378481e700 1 -- 172.21.15.46:0/2096596248 >> v1:172.21.15.142:6789/0 conn(0x7f37800cc380 legacy=0x7f37800cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f378481e700 1 -- 172.21.15.46:0/2096596248 >> v1:172.21.15.46:6789/0 conn(0x7f37800cdd30 legacy=0x7f37800ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f378481e700 1 -- 172.21.15.46:0/2096596248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780160b50 con 0x7f378015c590 2023-05-21T16:54:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f378481e700 1 --2- 172.21.15.46:0/2096596248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378015c590 0x7f37800cacf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3770009880 tx=0x7f3770009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20079e6b287fa7f server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011830 con 0x7f378015c590 2023-05-21T16:54:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770011990 con 0x7f378015c590 2023-05-21T16:54:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f377f7fe700 1 -- 172.21.15.46:0/2096596248 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011d20 con 0x7f378015c590 2023-05-21T16:54:34.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 -- 172.21.15.46:0/2096596248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378015c590 msgr2=0x7f37800cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 --2- 172.21.15.46:0/2096596248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378015c590 0x7f37800cacf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3770009880 tx=0x7f3770009b90 comp rx=0 tx=0).stop 2023-05-21T16:54:34.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 -- 172.21.15.46:0/2096596248 shutdown_connections 2023-05-21T16:54:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 --2- 172.21.15.46:0/2096596248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f378015c590 0x7f37800cacf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 -- 172.21.15.46:0/2096596248 >> 172.21.15.46:0/2096596248 conn(0x7f378006d8f0 msgr2=0x7f378006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 -- 172.21.15.46:0/2096596248 shutdown_connections 2023-05-21T16:54:34.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.577+0000 7f3785820700 1 -- 172.21.15.46:0/2096596248 wait complete. 2023-05-21T16:54:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 Processor -- start 2023-05-21T16:54:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 -- start start 2023-05-21T16:54:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800cc380 0x7f3780159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 0x7f37800ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378015c590 0x7f37800b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ad5a0 con 0x7f37800cdd30 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ad7b0 con 0x7f378015c590 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f3785820700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ada90 con 0x7f37800cc380 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f377ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 0x7f37800ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f377ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 0x7f37800ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40418/0 (socket says 172.21.15.46:40418) 2023-05-21T16:54:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f377ffff700 1 -- 172.21.15.46:0/4187903947 learned_addr learned my addr 172.21.15.46:0/4187903947 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f378481e700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800cc380 0x7f3780159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.581+0000 7f378501f700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378015c590 0x7f37800b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377ffff700 1 -- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800cc380 msgr2=0x7f3780159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377ffff700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800cc380 0x7f3780159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377ffff700 1 -- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378015c590 msgr2=0x7f37800b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377ffff700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378015c590 0x7f37800b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377ffff700 1 -- 172.21.15.46:0/4187903947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700094b0 con 0x7f37800cdd30 2023-05-21T16:54:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377ffff700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 0x7f37800ad060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f377400c730 tx=0x7f377400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740052d0 con 0x7f37800cdd30 2023-05-21T16:54:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774005450 con 0x7f37800cdd30 2023-05-21T16:54:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740038e0 con 0x7f37800cdd30 2023-05-21T16:54:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378015c960 con 0x7f37800cdd30 2023-05-21T16:54:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3780160e30 con 0x7f37800cdd30 2023-05-21T16:54:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37800ca840 con 0x7f37800cdd30 2023-05-21T16:54:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.585+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3774003a40 con 0x7f37800cdd30 2023-05-21T16:54:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.589+0000 7f377d7fa700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f376c0662f0 0x7f376c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.589+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3774083200 con 0x7f37800cdd30 2023-05-21T16:54:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.589+0000 7f378481e700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f376c0662f0 0x7f376c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.589+0000 7f378481e700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f376c0662f0 0x7f376c0687a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37700090b0 tx=0x7f377001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.597+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3774050560 con 0x7f37800cdd30 2023-05-21T16:54:34.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.793+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3780067ac0 con 0x7f37800cdd30 2023-05-21T16:54:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.793+0000 7f377d7fa700 1 -- 172.21.15.46:0/4187903947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3774053b80 con 0x7f37800cdd30 2023-05-21T16:54:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-21T16:54:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f376c0662f0 msgr2=0x7f376c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f376c0662f0 0x7f376c0687a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37700090b0 tx=0x7f377001c040 comp rx=0 tx=0).stop 2023-05-21T16:54:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 msgr2=0x7f37800ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 0x7f37800ad060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f377400c730 tx=0x7f377400ca40 comp rx=0 tx=0).stop 2023-05-21T16:54:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 shutdown_connections 2023-05-21T16:54:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f376c0662f0 0x7f376c0687a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378015c590 0x7f37800b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37800cdd30 0x7f37800ad060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 --2- 172.21.15.46:0/4187903947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37800cc380 0x7f3780159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:34.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 >> 172.21.15.46:0/4187903947 conn(0x7f378006d8f0 msgr2=0x7f37800cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 shutdown_connections 2023-05-21T16:54:34.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:34.797+0000 7f3785820700 1 -- 172.21.15.46:0/4187903947 wait complete. 2023-05-21T16:54:34.816 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-21T16:54:34.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-21T16:54:34.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-05-21T16:54:34.817 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-21T16:54:34.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:34.817 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-21T16:54:34.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-21T16:54:34.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-21T16:54:34.818 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-21T16:54:34.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.818 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-05-21T16:54:34.824 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:34.825 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42599sec preferred_lft 42599sec 2023-05-21T16:54:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 02:42:3f:7c:3c:7d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-21T16:54:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.828 INFO:teuthology.orchestra.run.smithi046.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:54:34.828 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether b6:73:ea:bd:05:00 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:34.828 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-21T16:54:34.828 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.829 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::3c45:97ff:feb4:fb6e/64 scope link 2023-05-21T16:54:34.829 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.829 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-21T16:54:34.830 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether b6:73:ea:bd:05:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-21T16:54:34.830 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::b473:eaff:febd:500/64 scope link 2023-05-21T16:54:34.830 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:34.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.831 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-21T16:54:34.846 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-05-21T16:54:34.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.848 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-05-21T16:54:34.900 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-05-21T16:54:34.900 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-21T16:54:34.900 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-21T16:54:34.900 INFO:teuthology.orchestra.run.smithi046.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-21T16:54:34.901 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-21T16:54:34.901 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-21T16:54:34.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:34.902 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:34.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-21T16:54:34.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-21T16:54:34.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-21T16:54:34.904 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:34.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.943 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-05-21T16:54:34.949 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-21T16:54:34.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.950 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-05-21T16:54:34.998 INFO:teuthology.orchestra.run.smithi046.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-21T16:54:34.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:34.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:35.000 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:35.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-21T16:54:35.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-21T16:54:35.000 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:35.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:35.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-21T16:54:35.044 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:35.045 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:35.045 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:35.045 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.045 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:35.045 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.046 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:54:35.046 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 6a:1a:69:b0:9e:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-21T16:54:35.046 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-21T16:54:35.046 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.046 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::681a:69ff:feb0:9e6d/64 scope link 2023-05-21T16:54:35.046 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:35.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-21T16:54:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:35.064 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:35.064 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 6a:1a:69:b0:9e:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-21T16:54:35.065 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.066 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::681a:69ff:feb0:9e6d/64 scope link 2023-05-21T16:54:35.066 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:35.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-21T16:54:35.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:35.067 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:35.068 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:35.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-21T16:54:35.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-21T16:54:35.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-21T16:54:35.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-21T16:54:35.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-21T16:54:35.069 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:35.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:35.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:54:35.162 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:54:35.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.1 up 2023-05-21T16:54:35.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.1 master ceph-brx 2023-05-21T16:54:35.162 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:54:35.190 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-21T16:54:35.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:35.191 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:35.196 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-21T16:54:35.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:35.197 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:35.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:54:35.260 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:35.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:35.272 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:35.273 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:35.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:35.274 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:54:35.280 INFO:teuthology.orchestra.run.smithi046.stdout:52 2023-05-21T16:54:35.280 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-05-21T16:54:35.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-21T16:54:35.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:54:35.342 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:35.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:35.354 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:35.355 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:35.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:35.357 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:54:35.364 INFO:teuthology.orchestra.run.smithi046.stdout:52 2023-05-21T16:54:35.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi046.stderr:2023-05-21T16:54:35.413+0000 7f86af3c0640 -1 init, newargv = 0x560e757b11f0 newargc=15 2023-05-21T16:54:35.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi046.stderr:ceph-fuse[41698]: starting ceph client 2023-05-21T16:54:35.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi046.stderr:ceph-fuse[41698]: starting fuse 2023-05-21T16:54:36.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:54:36.485 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:36.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:36.541 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:36.542 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:36.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:36.543 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:54:36.549 INFO:teuthology.orchestra.run.smithi046.stdout:52 2023-05-21T16:54:36.550 INFO:teuthology.orchestra.run.smithi046.stdout:53 2023-05-21T16:54:36.550 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-05-21T16:54:36.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-21T16:54:36.551 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2023-05-21T16:54:36.551 DEBUG:teuthology.orchestra.run.smithi046:> import re 2023-05-21T16:54:36.551 DEBUG:teuthology.orchestra.run.smithi046:> import os 2023-05-21T16:54:36.551 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2023-05-21T16:54:36.552 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:36.552 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2023-05-21T16:54:36.552 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-21T16:54:36.553 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2023-05-21T16:54:36.553 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-21T16:54:36.553 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:36.553 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2023-05-21T16:54:36.554 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2023-05-21T16:54:36.554 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2023-05-21T16:54:36.554 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2023-05-21T16:54:36.554 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:36.554 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2023-05-21T16:54:36.555 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-21T16:54:36.555 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-21T16:54:36.555 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-21T16:54:36.555 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2023-05-21T16:54:36.556 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2023-05-21T16:54:36.556 DEBUG:teuthology.orchestra.run.smithi046:> return f 2023-05-21T16:54:36.556 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-21T16:54:36.557 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:54:36.557 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.2")) 2023-05-21T16:54:36.557 DEBUG:teuthology.orchestra.run.smithi046:> ' 2023-05-21T16:54:36.640 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.2.41698.asok 2023-05-21T16:54:36.824 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.41698.asok 2023-05-21T16:54:36.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:36.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.41698.asok status 2023-05-21T16:54:36.974 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-21T16:54:36.974 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1", 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.0.0-3996-g5ca1fdcf (5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1) reef (dev)", 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "2", 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "41698", 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2023-05-21T16:54:36.975 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2023-05-21T16:54:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2023-05-21T16:54:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4716, 2023-05-21T16:54:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2023-05-21T16:54:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2023-05-21T16:54:36.976 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4716 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.2:0", 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 600277677 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:54:36.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.2:0", 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 600277677 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4716 192.168.0.2:0/600277677", 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.2:0/600277677", 2023-05-21T16:54:36.978 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2023-05-21T16:54:36.979 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 7, 2023-05-21T16:54:36.979 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 24, 2023-05-21T16:54:36.979 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2023-05-21T16:54:36.979 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2023-05-21T16:54:36.979 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2023-05-21T16:54:36.979 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-21T16:54:36.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-21T16:54:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.093+0000 7fde52a25700 1 Processor -- start 2023-05-21T16:54:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.093+0000 7fde52a25700 1 -- start start 2023-05-21T16:54:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.093+0000 7fde52a25700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde4c0cc540 0x7fde4c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.093+0000 7fde52a25700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c0cced0 con 0x7fde4c1591a0 2023-05-21T16:54:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.093+0000 7fde52a25700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c0cee30 con 0x7fde4c06c040 2023-05-21T16:54:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.093+0000 7fde52a25700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c0ce260 con 0x7fde4c0cc540 2023-05-21T16:54:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51a23700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fde4c1591a0 0x7fde4c0ae770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33834/0 (socket says 172.21.15.46:33834) 2023-05-21T16:54:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51a23700 1 -- 172.21.15.46:0/3047052188 learned_addr learned my addr 172.21.15.46:0/3047052188 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51222700 1 --2- 172.21.15.46:0/3047052188 >> v2:172.21.15.142:3300/0 conn(0x7fde4c0cc540 0x7fde4c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde50a21700 1 -- 172.21.15.46:0/3047052188 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050253984 0 0) 0x7fde3c001110 con 0x7fde4c1591a0 2023-05-21T16:54:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde50a21700 1 -- 172.21.15.46:0/3047052188 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde380035d0 con 0x7fde4c1591a0 2023-05-21T16:54:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde50a21700 1 -- 172.21.15.46:0/3047052188 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526104197 0 0) 0x7fde4c0cee30 con 0x7fde4c06c040 2023-05-21T16:54:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51222700 1 -- 172.21.15.46:0/3047052188 >> v1:172.21.15.142:6789/0 conn(0x7fde4c06c040 legacy=0x7fde4c06c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51222700 1 -- 172.21.15.46:0/3047052188 >> v1:172.21.15.46:6789/0 conn(0x7fde4c1591a0 legacy=0x7fde4c0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51222700 1 -- 172.21.15.46:0/3047052188 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0ce500 con 0x7fde4c0cc540 2023-05-21T16:54:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde51222700 1 --2- 172.21.15.46:0/3047052188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c0cc540 0x7fde4c0cc990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde48009850 tx=0x7fde48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b6617c689eac89 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde50a21700 1 -- 172.21.15.46:0/3047052188 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c001800 con 0x7fde4c0cc540 2023-05-21T16:54:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde50a21700 1 -- 172.21.15.46:0/3047052188 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48010590 con 0x7fde4c0cc540 2023-05-21T16:54:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde50a21700 1 -- 172.21.15.46:0/3047052188 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48010940 con 0x7fde4c0cc540 2023-05-21T16:54:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 -- 172.21.15.46:0/3047052188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c0cc540 msgr2=0x7fde4c0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 --2- 172.21.15.46:0/3047052188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c0cc540 0x7fde4c0cc990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde48009850 tx=0x7fde48009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 -- 172.21.15.46:0/3047052188 shutdown_connections 2023-05-21T16:54:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 --2- 172.21.15.46:0/3047052188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c0cc540 0x7fde4c0cc990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 -- 172.21.15.46:0/3047052188 >> 172.21.15.46:0/3047052188 conn(0x7fde4c06d8f0 msgr2=0x7fde4c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 -- 172.21.15.46:0/3047052188 shutdown_connections 2023-05-21T16:54:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.097+0000 7fde52a25700 1 -- 172.21.15.46:0/3047052188 wait complete. 2023-05-21T16:54:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 Processor -- start 2023-05-21T16:54:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 -- start start 2023-05-21T16:54:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 0x7fde4c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4c0cc540 0x7fde4c0a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c1591a0 0x7fde4c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0a7a20 con 0x7fde4c06c040 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c1f5840 con 0x7fde4c1591a0 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0b1470 con 0x7fde4c0cc540 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 0x7fde4c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 0x7fde4c0b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40432/0 (socket says 172.21.15.46:40432) 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 -- 172.21.15.46:0/363216371 learned_addr learned my addr 172.21.15.46:0/363216371 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51222700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4c0cc540 0x7fde4c0a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52224700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c1591a0 0x7fde4c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 -- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4c0cc540 msgr2=0x7fde4c0a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4c0cc540 0x7fde4c0a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 -- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c1591a0 msgr2=0x7fde4c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c1591a0 0x7fde4c0b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 -- 172.21.15.46:0/363216371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480094b0 con 0x7fde4c06c040 2023-05-21T16:54:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde51a23700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 0x7fde4c0b0e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fde3c001930 tx=0x7fde3c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c004ca0 con 0x7fde4c06c040 2023-05-21T16:54:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c0ceac0 con 0x7fde4c06c040 2023-05-21T16:54:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c004e00 con 0x7fde4c06c040 2023-05-21T16:54:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c0ce7e0 con 0x7fde4c06c040 2023-05-21T16:54:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.101+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0072d0 con 0x7fde4c06c040 2023-05-21T16:54:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.105+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c15dce0 con 0x7fde4c06c040 2023-05-21T16:54:37.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.105+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde3c007430 con 0x7fde4c06c040 2023-05-21T16:54:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.105+0000 7fde427fc700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fde300662f0 0x7fde300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.105+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde3c0837b0 con 0x7fde4c06c040 2023-05-21T16:54:37.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.105+0000 7fde51222700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fde300662f0 0x7fde300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:37.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.109+0000 7fde51222700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fde300662f0 0x7fde300687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde48013040 tx=0x7fde48008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:37.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.113+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fde3c050bb0 con 0x7fde4c06c040 2023-05-21T16:54:37.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.313+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde4c067ac0 con 0x7fde4c06c040 2023-05-21T16:54:37.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.313+0000 7fde427fc700 1 -- 172.21.15.46:0/363216371 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde3c0541d0 con 0x7fde4c06c040 2023-05-21T16:54:37.318 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-21T16:54:37.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.313+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fde300662f0 msgr2=0x7fde300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.313+0000 7fde52a25700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fde300662f0 0x7fde300687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde48013040 tx=0x7fde48008000 comp rx=0 tx=0).stop 2023-05-21T16:54:37.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.313+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 msgr2=0x7fde4c0b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:37.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.313+0000 7fde52a25700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 0x7fde4c0b0e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fde3c001930 tx=0x7fde3c00ca30 comp rx=0 tx=0).stop 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 shutdown_connections 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fde300662f0 0x7fde300687a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4c1591a0 0x7fde4c0b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4c0cc540 0x7fde4c0a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 --2- 172.21.15.46:0/363216371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde4c06c040 0x7fde4c0b0e40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 >> 172.21.15.46:0/363216371 conn(0x7fde4c06d8f0 msgr2=0x7fde4c0b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:37.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 shutdown_connections 2023-05-21T16:54:37.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:37.317+0000 7fde52a25700 1 -- 172.21.15.46:0/363216371 wait complete. 2023-05-21T16:54:37.332 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-21T16:54:37.332 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-21T16:54:37.332 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-05-21T16:54:37.332 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-21T16:54:37.332 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:37.333 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-21T16:54:37.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-21T16:54:37.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-21T16:54:37.333 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-21T16:54:37.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.334 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-05-21T16:54:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42575sec preferred_lft 42575sec 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-21T16:54:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 02:42:97:9d:e2:0c brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-21T16:54:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:37.345 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-21T16:54:37.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.345 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:37.345 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:37.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-05-21T16:54:37.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-05-21T16:54:37.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-05-21T16:54:37.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-21T16:54:37.347 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:37.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.434 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-21T16:54:37.445 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-05-21T16:54:37.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.446 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-05-21T16:54:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-05-21T16:54:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-21T16:54:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-21T16:54:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-21T16:54:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-21T16:54:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-05-21T16:54:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-21T16:54:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-21T16:54:37.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.465 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:37.465 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:37.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-21T16:54:37.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-21T16:54:37.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-21T16:54:37.466 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:37.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.503 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-05-21T16:54:37.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.551 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-05-21T16:54:37.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.559 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:37.559 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:37.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-21T16:54:37.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-21T16:54:37.560 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:37.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-21T16:54:37.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.591 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:37.591 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:37.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-21T16:54:37.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-21T16:54:37.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-21T16:54:37.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-21T16:54:37.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-21T16:54:37.593 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:37.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.660 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:37.661 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:37.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-05-21T16:54:37.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-05-21T16:54:37.661 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:37.686 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-21T16:54:37.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:37.687 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:37.692 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-21T16:54:37.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:37.693 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:37.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-05-21T16:54:37.712 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:37.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:37.775 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:37.777 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:37.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.778 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-05-21T16:54:37.784 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-21T16:54:37.785 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-21T16:54:37.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-05-21T16:54:37.802 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:37.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:37.862 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:37.863 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:37.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:37.864 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-05-21T16:54:37.893 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:2023-05-21T16:54:37.888+0000 7f01afe7a640 -1 init, newargv = 0x55d98eed0450 newargc=15 2023-05-21T16:54:37.893 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[40603]: starting ceph client 2023-05-21T16:54:37.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[40603]: starting fuse 2023-05-21T16:54:38.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-05-21T16:54:38.989 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:38.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:39.047 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:39.048 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:39.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.049 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-05-21T16:54:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:52 2023-05-21T16:54:39.054 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-05-21T16:54:39.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-21T16:54:39.055 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2023-05-21T16:54:39.055 DEBUG:teuthology.orchestra.run.smithi142:> import re 2023-05-21T16:54:39.055 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-05-21T16:54:39.055 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-05-21T16:54:39.055 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:39.056 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2023-05-21T16:54:39.056 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-21T16:54:39.056 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2023-05-21T16:54:39.056 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-21T16:54:39.057 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:39.057 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2023-05-21T16:54:39.057 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2023-05-21T16:54:39.057 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2023-05-21T16:54:39.058 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2023-05-21T16:54:39.058 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:39.058 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2023-05-21T16:54:39.058 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-21T16:54:39.058 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-21T16:54:39.059 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-21T16:54:39.059 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2023-05-21T16:54:39.059 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2023-05-21T16:54:39.059 DEBUG:teuthology.orchestra.run.smithi142:> return f 2023-05-21T16:54:39.060 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-21T16:54:39.060 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:39.060 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.1")) 2023-05-21T16:54:39.060 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-05-21T16:54:39.145 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.1.40603.asok 2023-05-21T16:54:39.329 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.40603.asok 2023-05-21T16:54:39.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.40603.asok status 2023-05-21T16:54:39.434 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-05-21T16:54:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2023-05-21T16:54:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1", 2023-05-21T16:54:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.0.0-3996-g5ca1fdcf (5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1) reef (dev)", 2023-05-21T16:54:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "1", 2023-05-21T16:54:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "40603", 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2023-05-21T16:54:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4747, 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4747 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-05-21T16:54:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 2353828389 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 2353828389 2023-05-21T16:54:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4747 192.168.0.1:0/2353828389", 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.1:0/2353828389", 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 7, 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 24, 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2023-05-21T16:54:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2023-05-21T16:54:39.439 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2023-05-21T16:54:39.439 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-05-21T16:54:39.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-21T16:54:39.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb27fff700 1 Processor -- start 2023-05-21T16:54:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb27fff700 1 -- start start 2023-05-21T16:54:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb27fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb280b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb27fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2806db30 con 0x7ffb280ccf10 2023-05-21T16:54:39.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb27fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280cd4a0 con 0x7ffb2815e630 2023-05-21T16:54:39.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb27fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280cb2d0 con 0x7ffb280709d0 2023-05-21T16:54:39.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb267fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffb280ccf10 0x7ffb280702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33848/0 (socket says 172.21.15.46:33848) 2023-05-21T16:54:39.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb267fc700 1 -- 172.21.15.46:0/2357985572 learned_addr learned my addr 172.21.15.46:0/2357985572 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb280b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631973001 0 0) 0x7ffb2806db30 con 0x7ffb280ccf10 2023-05-21T16:54:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb100035d0 con 0x7ffb280ccf10 2023-05-21T16:54:39.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534927482 0 0) 0x7ffb280cd4a0 con 0x7ffb2815e630 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb2806db30 con 0x7ffb2815e630 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236507134 0 0) 0x7ffb100035d0 con 0x7ffb280ccf10 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 msgr2=0x7ffb280b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb280b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 >> v1:172.21.15.142:6789/0 conn(0x7ffb2815e630 legacy=0x7ffb2815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280cb5b0 con 0x7ffb280ccf10 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7ffb18001690 con 0x7ffb280ccf10 2023-05-21T16:54:39.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 >> v1:172.21.15.46:6789/0 conn(0x7ffb280ccf10 legacy=0x7ffb280702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb10003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004140 0x7ffb10004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb10004db0 0x7ffb10005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280cb2d0 con 0x7ffb10004db0 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1000bae0 con 0x7ffb10004140 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1000bca0 con 0x7ffb280709d0 2023-05-21T16:54:39.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb10004db0 0x7ffb10005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb26ffd700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb10003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb267fc700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004140 0x7ffb10004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 -- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 msgr2=0x7ffb10003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb10003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 -- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004140 msgr2=0x7ffb10004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004140 0x7ffb10004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb277fe700 1 -- 172.21.15.46:0/2357985572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100035d0 con 0x7ffb10004db0 2023-05-21T16:54:39.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.560+0000 7ffb26ffd700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280709d0 0x7ffb10003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb277fe700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb10004db0 0x7ffb10005220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb280cb1e0 tx=0x7ffb100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cd704c85dc5f2f server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:39.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000eba0 con 0x7ffb10004db0 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2000f040 con 0x7ffb10004db0 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb25ffb700 1 -- 172.21.15.46:0/2357985572 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20014480 con 0x7ffb10004db0 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb27fff700 1 -- 172.21.15.46:0/2357985572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb10004db0 msgr2=0x7ffb10005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb27fff700 1 --2- 172.21.15.46:0/2357985572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb10004db0 0x7ffb10005220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb280cb1e0 tx=0x7ffb100058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb277fe700 1 -- 172.21.15.46:0/2357985572 reap_dead start 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb27fff700 1 -- 172.21.15.46:0/2357985572 shutdown_connections 2023-05-21T16:54:39.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb27fff700 1 -- 172.21.15.46:0/2357985572 >> 172.21.15.46:0/2357985572 conn(0x7ffb280cd6f0 msgr2=0x7ffb280cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:39.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb27fff700 1 -- 172.21.15.46:0/2357985572 shutdown_connections 2023-05-21T16:54:39.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.564+0000 7ffb27fff700 1 -- 172.21.15.46:0/2357985572 wait complete. 2023-05-21T16:54:39.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 Processor -- start 2023-05-21T16:54:39.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 -- start start 2023-05-21T16:54:39.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004db0 0x7ffb28156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 0x7ffb280c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280c6ed0 0x7ffb280b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280c6c80 con 0x7ffb280b5bf0 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280b3520 con 0x7ffb10004db0 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28155870 con 0x7ffb280c6ed0 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 0x7ffb280c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 0x7ffb280c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40456/0 (socket says 172.21.15.46:40456) 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb26ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004db0 0x7ffb28156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 -- 172.21.15.46:0/1278791629 learned_addr learned my addr 172.21.15.46:0/1278791629 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb277fe700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280c6ed0 0x7ffb280b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 -- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280c6ed0 msgr2=0x7ffb280b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280c6ed0 0x7ffb280b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 -- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004db0 msgr2=0x7ffb28156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004db0 0x7ffb28156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 -- 172.21.15.46:0/1278791629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280d0930 con 0x7ffb280b5bf0 2023-05-21T16:54:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb267fc700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 0x7ffb280c6740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffb18007340 tx=0x7ffb18007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180115b0 con 0x7ffb280b5bf0 2023-05-21T16:54:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb18011730 con 0x7ffb280b5bf0 2023-05-21T16:54:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280cb890 con 0x7ffb280b5bf0 2023-05-21T16:54:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18011ae0 con 0x7ffb280b5bf0 2023-05-21T16:54:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.568+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2815f110 con 0x7ffb280b5bf0 2023-05-21T16:54:39.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.572+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28155d30 con 0x7ffb280b5bf0 2023-05-21T16:54:39.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.572+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb18011c40 con 0x7ffb280b5bf0 2023-05-21T16:54:39.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.572+0000 7ffb0ffff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb140662f0 0x7ffb140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:39.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.572+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb18083d60 con 0x7ffb280b5bf0 2023-05-21T16:54:39.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.572+0000 7ffb26ffd700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb140662f0 0x7ffb140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:39.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.572+0000 7ffb26ffd700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb140662f0 0x7ffb140687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c001580 tx=0x7ffb1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:39.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.580+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffb18051150 con 0x7ffb280b5bf0 2023-05-21T16:54:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.780+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb280733b0 con 0x7ffb280b5bf0 2023-05-21T16:54:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.780+0000 7ffb0ffff700 1 -- 172.21.15.46:0/1278791629 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb18054770 con 0x7ffb280b5bf0 2023-05-21T16:54:39.787 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-21T16:54:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb140662f0 msgr2=0x7ffb140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb140662f0 0x7ffb140687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c001580 tx=0x7ffb1c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:39.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 msgr2=0x7ffb280c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:39.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 0x7ffb280c6740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffb18007340 tx=0x7ffb18007650 comp rx=0 tx=0).stop 2023-05-21T16:54:39.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 shutdown_connections 2023-05-21T16:54:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb140662f0 0x7ffb140687a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb280c6ed0 0x7ffb280b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb280b5bf0 0x7ffb280c6740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 --2- 172.21.15.46:0/1278791629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb10004db0 0x7ffb28156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 >> 172.21.15.46:0/1278791629 conn(0x7ffb280cd6f0 msgr2=0x7ffb280afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:39.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 shutdown_connections 2023-05-21T16:54:39.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:39.784+0000 7ffb27fff700 1 -- 172.21.15.46:0/1278791629 wait complete. 2023-05-21T16:54:39.802 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-21T16:54:39.802 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-21T16:54:39.802 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-05-21T16:54:39.802 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-21T16:54:39.802 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:39.803 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-21T16:54:39.803 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-21T16:54:39.803 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-21T16:54:39.803 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-21T16:54:39.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.804 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-05-21T16:54:39.811 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:39.812 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42573sec preferred_lft 42573sec 2023-05-21T16:54:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 02:42:97:9d:e2:0c brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:54:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0a:d5:90:50:12:1d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::8090:b3ff:fe0d:2ad4/64 scope link 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0a:d5:90:50:12:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::8d5:90ff:fe50:121d/64 scope link 2023-05-21T16:54:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:39.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.817 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-21T16:54:39.875 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-05-21T16:54:39.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.877 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-05-21T16:54:39.886 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-05-21T16:54:39.886 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-21T16:54:39.886 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-21T16:54:39.886 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-21T16:54:39.886 INFO:teuthology.orchestra.run.smithi142.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-21T16:54:39.887 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-05-21T16:54:39.887 INFO:teuthology.orchestra.run.smithi142.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-21T16:54:39.887 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-21T16:54:39.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.888 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:39.888 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:39.888 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-21T16:54:39.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-21T16:54:39.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-21T16:54:39.889 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:39.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.932 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-05-21T16:54:39.939 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-21T16:54:39.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.940 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-05-21T16:54:39.986 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-21T16:54:39.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:39.987 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:39.988 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:39.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-21T16:54:39.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-21T16:54:39.989 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:40.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:40.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-21T16:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:40.033 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 92:f3:0f:13:45:a1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-21T16:54:40.034 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-21T16:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::90f3:fff:fe13:45a1/64 scope link 2023-05-21T16:54:40.035 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:40.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-21T16:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:54:40.093 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 92:f3:0f:13:45:a1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.094 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::90f3:fff:fe13:45a1/64 scope link 2023-05-21T16:54:40.095 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:54:40.095 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-21T16:54:40.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:40.096 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:40.096 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:40.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-21T16:54:40.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-21T16:54:40.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-21T16:54:40.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-21T16:54:40.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-21T16:54:40.098 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:40.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:40.154 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-05-21T16:54:40.154 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-05-21T16:54:40.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2023-05-21T16:54:40.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2023-05-21T16:54:40.155 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-05-21T16:54:40.183 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-21T16:54:40.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:40.183 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:40.190 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-21T16:54:40.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:54:40.191 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:40.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-05-21T16:54:40.254 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:40.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:40.269 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:40.270 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:40.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:40.271 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-05-21T16:54:40.278 INFO:teuthology.orchestra.run.smithi142.stdout:52 2023-05-21T16:54:40.278 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-05-21T16:54:40.279 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-21T16:54:40.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-05-21T16:54:40.340 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:40.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:40.350 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:40.351 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:40.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:40.352 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-05-21T16:54:40.358 INFO:teuthology.orchestra.run.smithi142.stdout:52 2023-05-21T16:54:40.415 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:2023-05-21T16:54:40.408+0000 7fc74d975640 -1 init, newargv = 0x55aff5ed2300 newargc=15 2023-05-21T16:54:40.415 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:ceph-fuse[40718]: starting ceph client 2023-05-21T16:54:40.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:ceph-fuse[40718]: starting fuse 2023-05-21T16:54:41.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-05-21T16:54:41.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:54:41.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:54:41.487 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:54:41.488 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:54:41.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:41.489 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-05-21T16:54:41.538 INFO:teuthology.orchestra.run.smithi142.stdout:52 2023-05-21T16:54:41.539 INFO:teuthology.orchestra.run.smithi142.stdout:53 2023-05-21T16:54:41.539 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-05-21T16:54:41.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-21T16:54:41.540 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2023-05-21T16:54:41.540 DEBUG:teuthology.orchestra.run.smithi142:> import re 2023-05-21T16:54:41.540 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-05-21T16:54:41.540 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-05-21T16:54:41.541 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:41.541 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2023-05-21T16:54:41.541 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-21T16:54:41.541 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2023-05-21T16:54:41.541 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-21T16:54:41.542 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:41.542 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2023-05-21T16:54:41.542 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2023-05-21T16:54:41.542 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2023-05-21T16:54:41.543 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2023-05-21T16:54:41.543 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:41.543 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2023-05-21T16:54:41.543 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-21T16:54:41.543 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-21T16:54:41.544 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-21T16:54:41.544 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2023-05-21T16:54:41.544 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2023-05-21T16:54:41.544 DEBUG:teuthology.orchestra.run.smithi142:> return f 2023-05-21T16:54:41.545 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-21T16:54:41.545 DEBUG:teuthology.orchestra.run.smithi142:> 2023-05-21T16:54:41.545 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.3")) 2023-05-21T16:54:41.545 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-05-21T16:54:41.625 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.3.40718.asok 2023-05-21T16:54:41.809 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.40718.asok 2023-05-21T16:54:41.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:41.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.40718.asok status 2023-05-21T16:54:41.907 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-05-21T16:54:41.908 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2023-05-21T16:54:41.908 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1", 2023-05-21T16:54:41.908 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.0.0-3996-g5ca1fdcf (5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1) reef (dev)", 2023-05-21T16:54:41.908 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "3", 2023-05-21T16:54:41.908 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2023-05-21T16:54:41.908 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "40718", 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4610, 2023-05-21T16:54:41.909 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4610 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.2:0", 2023-05-21T16:54:41.910 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3973997127 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.2:0", 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3973997127 2023-05-21T16:54:41.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4610 192.168.0.2:0/3973997127", 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.2:0/3973997127", 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 7, 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 24, 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2023-05-21T16:54:41.912 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2023-05-21T16:54:41.913 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-05-21T16:54:41.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:41.917 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2023-05-21T16:54:41.917 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:41.926 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2023-05-21T16:54:41.926 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:41.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:41.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:41.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:41.947 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2023-05-21T16:54:41.947 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:41.954 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2023-05-21T16:54:41.954 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:41.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:41.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-21T16:54:42.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:42.018 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2023-05-21T16:54:42.018 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:42.026 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2023-05-21T16:54:42.026 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:42.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:42.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:42.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:42.039 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2023-05-21T16:54:42.039 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:42.044 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2023-05-21T16:54:42.045 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:42.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:42.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-21T16:54:42.055 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-21T16:54:42.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 Processor -- start 2023-05-21T16:54:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- start start 2023-05-21T16:54:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9d58070a60 0x7f9d580cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580cecb0 con 0x7f9d580b1300 2023-05-21T16:54:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d580cd470 con 0x7f9d58070a60 2023-05-21T16:54:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580cb2b0 con 0x7f9d5815c5d0 2023-05-21T16:54:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5d201700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9d580b1300 0x7f9d58070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33850/0 (socket says 172.21.15.46:33850) 2023-05-21T16:54:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5d201700 1 -- 172.21.15.46:0/3357312778 learned_addr learned my addr 172.21.15.46:0/3357312778 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5da02700 1 --2- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5e203700 1 --2- 172.21.15.46:0/3357312778 >> v2:172.21.15.142:3300/0 conn(0x7f9d58070a60 0x7f9d580cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ca00700 1 -- 172.21.15.46:0/3357312778 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732324420 0 0) 0x7f9d580cecb0 con 0x7f9d580b1300 2023-05-21T16:54:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ca00700 1 -- 172.21.15.46:0/3357312778 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d440035d0 con 0x7f9d580b1300 2023-05-21T16:54:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5e203700 1 -- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 msgr2=0x7f9d580b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5e203700 1 --2- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5e203700 1 -- 172.21.15.46:0/3357312778 >> v1:172.21.15.46:6789/0 conn(0x7f9d580b1300 legacy=0x7f9d58070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5e203700 1 -- 172.21.15.46:0/3357312778 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580cb590 con 0x7f9d58070a60 2023-05-21T16:54:42.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5e203700 1 --2- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d58070a60 0x7f9d580cf140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009d90 tx=0x7f9d5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51a417d191a07166 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ca00700 1 -- 172.21.15.46:0/3357312778 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000e070 con 0x7f9d58070a60 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ca00700 1 -- 172.21.15.46:0/3357312778 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5000bb20 con 0x7f9d58070a60 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ca00700 1 -- 172.21.15.46:0/3357312778 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000be90 con 0x7f9d58070a60 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d58070a60 msgr2=0x7f9d580cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d58070a60 0x7f9d580cf140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009d90 tx=0x7f9d5000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3357312778 shutdown_connections 2023-05-21T16:54:42.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d58070a60 0x7f9d580cf140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3357312778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3357312778 >> 172.21.15.46:0/3357312778 conn(0x7f9d580d0c60 msgr2=0x7f9d580d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3357312778 shutdown_connections 2023-05-21T16:54:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.268+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3357312778 wait complete. 2023-05-21T16:54:42.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.272+0000 7f9d5ea04700 1 Processor -- start 2023-05-21T16:54:42.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.272+0000 7f9d5ea04700 1 -- start start 2023-05-21T16:54:42.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.272+0000 7f9d5ea04700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 0x7f9d581568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.272+0000 7f9d5ea04700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d580b1300 0x7f9d580c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.272+0000 7f9d5ea04700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.272+0000 7f9d5ea04700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c5c60 con 0x7f9d58070a60 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5ea04700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c7a10 con 0x7f9d580b1300 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5ea04700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c4cd0 con 0x7f9d5815c5d0 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 0x7f9d581568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 0x7f9d581568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40462/0 (socket says 172.21.15.46:40462) 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 -- 172.21.15.46:0/3906232852 learned_addr learned my addr 172.21.15.46:0/3906232852 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5d201700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d580b1300 0x7f9d580c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5e203700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 -- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 msgr2=0x7f9d580c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 -- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d580b1300 msgr2=0x7f9d580c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d580b1300 0x7f9d580c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 -- 172.21.15.46:0/3906232852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d50009a70 con 0x7f9d58070a60 2023-05-21T16:54:42.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5e203700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:42.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5da02700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 0x7f9d581568a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400e840 tx=0x7f9d5400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540095a0 con 0x7f9d58070a60 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54013680 con 0x7f9d58070a60 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d580ce940 con 0x7f9d58070a60 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540139f0 con 0x7f9d58070a60 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580cb870 con 0x7f9d58070a60 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d580cbb50 con 0x7f9d58070a60 2023-05-21T16:54:42.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.276+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d54013b50 con 0x7f9d58070a60 2023-05-21T16:54:42.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.280+0000 7f9d4e7fc700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9d3c066320 0x7f9d3c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.280+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d54083b80 con 0x7f9d58070a60 2023-05-21T16:54:42.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.280+0000 7f9d5d201700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9d3c066320 0x7f9d3c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.280+0000 7f9d5d201700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9d3c066320 0x7f9d3c0687d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d5815ab60 tx=0x7f9d48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.284+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9d54054b20 con 0x7f9d58070a60 2023-05-21T16:54:42.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.448+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d58067ac0 con 0x7f9d58070a60 2023-05-21T16:54:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.452+0000 7f9d4e7fc700 1 -- 172.21.15.46:0/3906232852 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f9d540546b0 con 0x7f9d58070a60 2023-05-21T16:54:42.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:42.460 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:42.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9d3c066320 msgr2=0x7f9d3c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9d3c066320 0x7f9d3c0687d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d5815ab60 tx=0x7f9d48009040 comp rx=0 tx=0).stop 2023-05-21T16:54:42.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 msgr2=0x7f9d581568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 0x7f9d581568a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400e840 tx=0x7f9d5400eb50 comp rx=0 tx=0).stop 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 shutdown_connections 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9d3c066320 0x7f9d3c0687d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5815c5d0 0x7f9d580c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d580b1300 0x7f9d580c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 --2- 172.21.15.46:0/3906232852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d58070a60 0x7f9d581568a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 >> 172.21.15.46:0/3906232852 conn(0x7f9d580d0c60 msgr2=0x7f9d5806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:42.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 shutdown_connections 2023-05-21T16:54:42.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.456+0000 7f9d5ea04700 1 -- 172.21.15.46:0/3906232852 wait complete. 2023-05-21T16:54:42.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:42.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 Processor -- start 2023-05-21T16:54:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 -- start start 2023-05-21T16:54:42.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b3c0b8ad0 0x7f0b3c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b4910 0x7f0b3c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0b8ea0 con 0x7f0b3c0b5ce0 2023-05-21T16:54:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c0b52f0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0d09d0 con 0x7f0b3c0b4910 2023-05-21T16:54:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b3a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b3c0b8ad0 0x7f0b3c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b39d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0b3c0b5ce0 0x7f0b3c06a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33858/0 (socket says 172.21.15.46:33858) 2023-05-21T16:54:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.588+0000 7f0b39d9b700 1 -- 172.21.15.46:0/979077419 learned_addr learned my addr 172.21.15.46:0/979077419 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3ad9d700 1 --2- 172.21.15.46:0/979077419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b4910 0x7f0b3c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3a59c700 1 -- 172.21.15.46:0/979077419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b4910 msgr2=0x7f0b3c0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3a59c700 1 --2- 172.21.15.46:0/979077419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b4910 0x7f0b3c0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3a59c700 1 -- 172.21.15.46:0/979077419 >> v1:172.21.15.46:6789/0 conn(0x7f0b3c0b5ce0 legacy=0x7f0b3c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3a59c700 1 -- 172.21.15.46:0/979077419 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c0d0cb0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3a59c700 1 --2- 172.21.15.46:0/979077419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c0cf310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009850 tx=0x7f0b2c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcae610f063a150 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3959a700 1 -- 172.21.15.46:0/979077419 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c011830 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3959a700 1 -- 172.21.15.46:0/979077419 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c011990 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3959a700 1 -- 172.21.15.46:0/979077419 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c011d40 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 -- 172.21.15.46:0/979077419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 msgr2=0x7f0b3c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/979077419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c0cf310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009850 tx=0x7f0b2c009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 -- 172.21.15.46:0/979077419 shutdown_connections 2023-05-21T16:54:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/979077419 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b4910 0x7f0b3c0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/979077419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c0cf310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 -- 172.21.15.46:0/979077419 >> 172.21.15.46:0/979077419 conn(0x7f0b3c0d3ae0 msgr2=0x7f0b3c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 -- 172.21.15.46:0/979077419 shutdown_connections 2023-05-21T16:54:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.592+0000 7f0b3b59e700 1 -- 172.21.15.46:0/979077419 wait complete. 2023-05-21T16:54:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 Processor -- start 2023-05-21T16:54:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- start start 2023-05-21T16:54:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b3c0b4910 0x7f0b3c1f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b5ce0 0x7f0b3c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0cb0f0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c1f2350 con 0x7f0b3c0b4910 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c1f2620 con 0x7f0b3c0b5ce0 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40476/0 (socket says 172.21.15.46:40476) 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 -- 172.21.15.46:0/174640520 learned_addr learned my addr 172.21.15.46:0/174640520 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b39d9b700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b5ce0 0x7f0b3c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3a59c700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b3c0b4910 0x7f0b3c1f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 -- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b5ce0 msgr2=0x7f0b3c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b5ce0 0x7f0b3c157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 -- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b3c0b4910 msgr2=0x7f0b3c1f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b3c0b4910 0x7f0b3c1f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 -- 172.21.15.46:0/174640520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0094b0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3a59c700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b3c0b4910 0x7f0b3c1f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3ad9d700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c160150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400efc0 tx=0x7f0b3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34009ba0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3400f040 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c0cd790 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34014480 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c0cd4f0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.596+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c0cda70 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.600+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b340145e0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.600+0000 7f0b2affd700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0b1c0662f0 0x7f0b1c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.600+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b34084660 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.600+0000 7f0b3a59c700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0b1c0662f0 0x7f0b1c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.600+0000 7f0b3a59c700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0b1c0662f0 0x7f0b1c0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009ba0 tx=0x7f0b2c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.604+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0b34051a40 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.768+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b3c0733e0 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.768+0000 7f0b2affd700 1 -- 172.21.15.46:0/174640520 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b34055060 con 0x7f0b3c0b8ad0 2023-05-21T16:54:42.776 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:42.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0b1c0662f0 msgr2=0x7f0b1c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0b1c0662f0 0x7f0b1c0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009ba0 tx=0x7f0b2c008030 comp rx=0 tx=0).stop 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 msgr2=0x7f0b3c160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c160150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400efc0 tx=0x7f0b3400c3a0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 shutdown_connections 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0b1c0662f0 0x7f0b1c0687a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b3c0b8ad0 0x7f0b3c160150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b3c0b5ce0 0x7f0b3c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 --2- 172.21.15.46:0/174640520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b3c0b4910 0x7f0b3c1f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 >> 172.21.15.46:0/174640520 conn(0x7f0b3c0d3ae0 msgr2=0x7f0b3c0b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:42.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 shutdown_connections 2023-05-21T16:54:42.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.772+0000 7f0b3b59e700 1 -- 172.21.15.46:0/174640520 wait complete. 2023-05-21T16:54:42.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.908+0000 7f78c2560700 1 Processor -- start 2023-05-21T16:54:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.908+0000 7f78c2560700 1 -- start start 2023-05-21T16:54:42.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78b4036320 0x7f78b40e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b4039d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78b4038980 0x7f78b4038e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b4039360 con 0x7f78b4036320 2023-05-21T16:54:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b40e5260 con 0x7f78b4038980 2023-05-21T16:54:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4053500 con 0x7f78b40514c0 2023-05-21T16:54:42.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c155e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78b4036320 0x7f78b40e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c155e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78b4036320 0x7f78b40e4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40480/0 (socket says 172.21.15.46:40480) 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c155e700 1 -- 172.21.15.46:0/131648259 learned_addr learned my addr 172.21.15.46:0/131648259 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 --2- 172.21.15.46:0/131648259 >> v2:172.21.15.142:3300/0 conn(0x7f78b4038980 0x7f78b4038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c0d5d700 1 --2- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b4039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 -- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 msgr2=0x7f78b4039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 --2- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b4039d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 -- 172.21.15.46:0/131648259 >> v2:172.21.15.46:3300/0 conn(0x7f78b4036320 msgr2=0x7f78b40e4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 --2- 172.21.15.46:0/131648259 >> v2:172.21.15.46:3300/0 conn(0x7f78b4036320 0x7f78b40e4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 -- 172.21.15.46:0/131648259 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4051950 con 0x7f78b4038980 2023-05-21T16:54:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c1d5f700 1 --2- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b4038e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0695d0 tx=0x7f78bc04eb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39ec13708c5b3ec server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78affff700 1 -- 172.21.15.46:0/131648259 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc072490 con 0x7f78b4038980 2023-05-21T16:54:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78affff700 1 -- 172.21.15.46:0/131648259 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc0725f0 con 0x7f78b4038980 2023-05-21T16:54:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78affff700 1 -- 172.21.15.46:0/131648259 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc073a80 con 0x7f78b4038980 2023-05-21T16:54:42.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 msgr2=0x7f78b4038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b4038e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0695d0 tx=0x7f78bc04eb10 comp rx=0 tx=0).stop 2023-05-21T16:54:42.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- 172.21.15.46:0/131648259 shutdown_connections 2023-05-21T16:54:42.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b4038e20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- 172.21.15.46:0/131648259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b4039d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 --2- 172.21.15.46:0/131648259 >> v2:172.21.15.46:3300/0 conn(0x7f78b4036320 0x7f78b40e4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- 172.21.15.46:0/131648259 >> 172.21.15.46:0/131648259 conn(0x7f78b4057b90 msgr2=0x7f78b4053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:42.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- 172.21.15.46:0/131648259 shutdown_connections 2023-05-21T16:54:42.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.912+0000 7f78c2560700 1 -- 172.21.15.46:0/131648259 wait complete. 2023-05-21T16:54:42.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 Processor -- start 2023-05-21T16:54:42.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 -- start start 2023-05-21T16:54:42.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 0x7f78b40dc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b404c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b404df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b403ad80 con 0x7f78b4036320 2023-05-21T16:54:42.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40dca50 con 0x7f78b4038980 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c2560700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b403bba0 con 0x7f78b40514c0 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c155e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 0x7f78b40dc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c155e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 0x7f78b40dc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40484/0 (socket says 172.21.15.46:40484) 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c155e700 1 -- 172.21.15.46:0/3011856264 learned_addr learned my addr 172.21.15.46:0/3011856264 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c1d5f700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b404df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c0d5d700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b404c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.916+0000 7f78c155e700 1 -- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 msgr2=0x7f78b404df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c155e700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b404df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c155e700 1 -- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 msgr2=0x7f78b404c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:42.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c155e700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b404c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:42.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c155e700 1 -- 172.21.15.46:0/3011856264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4054e50 con 0x7f78b4036320 2023-05-21T16:54:42.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c155e700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 0x7f78b40dc510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78b800e8b0 tx=0x7f78b800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8013680 con 0x7f78b4036320 2023-05-21T16:54:42.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b4054b70 con 0x7f78b4036320 2023-05-21T16:54:42.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b80137e0 con 0x7f78b4036320 2023-05-21T16:54:42.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8013b50 con 0x7f78b4036320 2023-05-21T16:54:42.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b4055130 con 0x7f78b4036320 2023-05-21T16:54:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b40059c0 con 0x7f78b4036320 2023-05-21T16:54:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78b8013cb0 con 0x7f78b4036320 2023-05-21T16:54:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.920+0000 7f78adffb700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78a00662f0 0x7f78a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:42.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.924+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78b8083bd0 con 0x7f78b4036320 2023-05-21T16:54:42.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.924+0000 7f78c0d5d700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78a00662f0 0x7f78a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:42.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.924+0000 7f78c0d5d700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78a00662f0 0x7f78a00687a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78b40504f0 tx=0x7f78b0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:42.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:42.932+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78b8054a60 con 0x7f78b4036320 2023-05-21T16:54:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78b40543a0 con 0x7f78b4036320 2023-05-21T16:54:43.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78adffb700 1 -- 172.21.15.46:0/3011856264 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78b80545f0 con 0x7f78b4036320 2023-05-21T16:54:43.097 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78a00662f0 msgr2=0x7f78a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78a00662f0 0x7f78a00687a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78b40504f0 tx=0x7f78b0009240 comp rx=0 tx=0).stop 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 msgr2=0x7f78b40dc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 0x7f78b40dc510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78b800e8b0 tx=0x7f78b800ebc0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 shutdown_connections 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78a00662f0 0x7f78a00687a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78b40514c0 0x7f78b404df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b4038980 0x7f78b404c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 --2- 172.21.15.46:0/3011856264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4036320 0x7f78b40dc510 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 >> 172.21.15.46:0/3011856264 conn(0x7f78b4057b90 msgr2=0x7f78b4038070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:43.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 shutdown_connections 2023-05-21T16:54:43.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.092+0000 7f78c2560700 1 -- 172.21.15.46:0/3011856264 wait complete. 2023-05-21T16:54:43.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:43.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 Processor -- start 2023-05-21T16:54:43.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 -- start start 2023-05-21T16:54:43.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d4c0512b0 0x7f3d4c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d4c036cb0 0x7f3d4c052de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0370f0 con 0x7f3d4c0e6e60 2023-05-21T16:54:43.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0486b0 con 0x7f3d4c0512b0 2023-05-21T16:54:43.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5907f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c04fa50 con 0x7f3d4c036cb0 2023-05-21T16:54:43.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3d4c0e6e60 0x7f3d4c04f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33864/0 (socket says 172.21.15.46:33864) 2023-05-21T16:54:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d537fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d4c0512b0 0x7f3d4c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 -- 172.21.15.46:0/4135552589 learned_addr learned my addr 172.21.15.46:0/4135552589 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5887e700 1 --2- 172.21.15.46:0/4135552589 >> v2:172.21.15.142:3300/0 conn(0x7f3d4c036cb0 0x7f3d4c052de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474624942 0 0) 0x7f3d4c0370f0 con 0x7f3d4c0e6e60 2023-05-21T16:54:43.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d440035d0 con 0x7f3d4c0e6e60 2023-05-21T16:54:43.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308706214 0 0) 0x7f3d440035d0 con 0x7f3d4c0e6e60 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 >> v2:172.21.15.142:3300/0 conn(0x7f3d4c036cb0 msgr2=0x7f3d4c052de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 --2- 172.21.15.46:0/4135552589 >> v2:172.21.15.142:3300/0 conn(0x7f3d4c036cb0 0x7f3d4c052de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 >> v2:172.21.15.46:3300/0 conn(0x7f3d4c0512b0 msgr2=0x7f3d4c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 --2- 172.21.15.46:0/4135552589 >> v2:172.21.15.46:3300/0 conn(0x7f3d4c0512b0 0x7f3d4c036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c033a80 con 0x7f3d4c0e6e60 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f3d40001670 con 0x7f3d4c0e6e60 2023-05-21T16:54:43.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 >> v1:172.21.15.46:6789/0 conn(0x7f3d4c0e6e60 legacy=0x7f3d4c04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d44003a20 0x7f3d44003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d44004870 0x7f3d44004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d44005220 0x7f3d4400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0486b0 con 0x7f3d44003a20 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c04fa50 con 0x7f3d44005220 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4400bfa0 con 0x7f3d44004870 2023-05-21T16:54:43.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d537fe700 1 --2- 172.21.15.46:0/4135552589 >> v2:172.21.15.46:3300/0 conn(0x7f3d4c0512b0 0x7f3d4c036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d44003a20 0x7f3d44003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5887e700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d44005220 0x7f3d4400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d537fe700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d44004870 0x7f3d44004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 -- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d44004870 msgr2=0x7f3d44004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d44004870 0x7f3d44004ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 -- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d44005220 msgr2=0x7f3d4400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d44005220 0x7f3d4400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 -- 172.21.15.46:0/4135552589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440035d0 con 0x7f3d44003a20 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5887e700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d44005220 0x7f3d4400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d5887e700 1 -- 172.21.15.46:0/4135552589 reap_dead start 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d53fff700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d44003a20 0x7f3d44003e30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c320 tx=0x7f3d440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8f2555ab7ce15e server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000ce60 con 0x7f3d44003a20 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40005980 con 0x7f3d44003a20 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.228+0000 7f3d52ffd700 1 -- 172.21.15.46:0/4135552589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40005d30 con 0x7f3d44003a20 2023-05-21T16:54:43.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 -- 172.21.15.46:0/4135552589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d44003a20 msgr2=0x7f3d44003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d44003a20 0x7f3d44003e30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c320 tx=0x7f3d440058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 -- 172.21.15.46:0/4135552589 shutdown_connections 2023-05-21T16:54:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 --2- 172.21.15.46:0/4135552589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d44003a20 0x7f3d44003e30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 -- 172.21.15.46:0/4135552589 >> 172.21.15.46:0/4135552589 conn(0x7f3d4c051770 msgr2=0x7f3d4c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 -- 172.21.15.46:0/4135552589 shutdown_connections 2023-05-21T16:54:43.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 -- 172.21.15.46:0/4135552589 wait complete. 2023-05-21T16:54:43.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 Processor -- start 2023-05-21T16:54:43.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 -- start start 2023-05-21T16:54:43.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0dc390 0x7f3d4c049200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.232+0000 7f3d5907f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 0x7f3d4c0df410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d4c04a010 0x7f3d4c04a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0e9180 con 0x7f3d4c0defa0 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0df950 con 0x7f3d4c04a010 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0dc760 con 0x7f3d4c0dc390 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 0x7f3d4c0df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 0x7f3d4c0df410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40528/0 (socket says 172.21.15.46:40528) 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 -- 172.21.15.46:0/807805345 learned_addr learned my addr 172.21.15.46:0/807805345 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:43.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5887e700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d4c04a010 0x7f3d4c04a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d53fff700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0dc390 0x7f3d4c049200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 -- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0dc390 msgr2=0x7f3d4c049200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0dc390 0x7f3d4c049200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 -- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d4c04a010 msgr2=0x7f3d4c04a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d4c04a010 0x7f3d4c04a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 -- 172.21.15.46:0/807805345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c034040 con 0x7f3d4c0defa0 2023-05-21T16:54:43.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d537fe700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 0x7f3d4c0df410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d48010a20 tx=0x7f3d48010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4800ead0 con 0x7f3d4c0defa0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4800ec30 con 0x7f3d4c0defa0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c033d60 con 0x7f3d4c0defa0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4801c400 con 0x7f3d4c0defa0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c034320 con 0x7f3d4c0defa0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c005570 con 0x7f3d4c0defa0 2023-05-21T16:54:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.236+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d4801c560 con 0x7f3d4c0defa0 2023-05-21T16:54:43.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.240+0000 7f3d50ff9700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d380662f0 0x7f3d380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.240+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d48084120 con 0x7f3d4c0defa0 2023-05-21T16:54:43.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.240+0000 7f3d53fff700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d380662f0 0x7f3d380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.240+0000 7f3d53fff700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d380662f0 0x7f3d380687a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c004030 tx=0x7f3d4000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.244+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3d48051630 con 0x7f3d4c0defa0 2023-05-21T16:54:43.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.404+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d4c047cd0 con 0x7f3d4c0defa0 2023-05-21T16:54:43.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d50ff9700 1 -- 172.21.15.46:0/807805345 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d48054c50 con 0x7f3d4c0defa0 2023-05-21T16:54:43.412 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:43.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d380662f0 msgr2=0x7f3d380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d380662f0 0x7f3d380687a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c004030 tx=0x7f3d4000a000 comp rx=0 tx=0).stop 2023-05-21T16:54:43.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 msgr2=0x7f3d4c0df410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 0x7f3d4c0df410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d48010a20 tx=0x7f3d48010de0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 shutdown_connections 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3d380662f0 0x7f3d380687a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d4c04a010 0x7f3d4c04a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d4c0defa0 0x7f3d4c0df410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 --2- 172.21.15.46:0/807805345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d4c0dc390 0x7f3d4c049200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 >> 172.21.15.46:0/807805345 conn(0x7f3d4c051770 msgr2=0x7f3d4c052c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 shutdown_connections 2023-05-21T16:54:43.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.408+0000 7f3d5907f700 1 -- 172.21.15.46:0/807805345 wait complete. 2023-05-21T16:54:43.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:43.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 Processor -- start 2023-05-21T16:54:43.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 -- start start 2023-05-21T16:54:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17940b4910 0x7f17940b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17940b8ea0 con 0x7f17940b8ad0 2023-05-21T16:54:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17940b52f0 con 0x7f17940b4910 2023-05-21T16:54:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179b1de700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17940d09d0 con 0x7f17940b5ce0 2023-05-21T16:54:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a1dc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f17940b8ad0 0x7f179406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33878/0 (socket says 172.21.15.46:33878) 2023-05-21T16:54:43.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a1dc700 1 -- 172.21.15.46:0/1157459726 learned_addr learned my addr 172.21.15.46:0/1157459726 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a9dd700 1 --2- 172.21.15.46:0/1157459726 >> v2:172.21.15.142:3300/0 conn(0x7f17940b4910 0x7f17940b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f17999db700 1 --2- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f17991da700 1 -- 172.21.15.46:0/1157459726 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077954880 0 0) 0x7f17940b8ea0 con 0x7f17940b8ad0 2023-05-21T16:54:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f17991da700 1 -- 172.21.15.46:0/1157459726 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17800035d0 con 0x7f17940b8ad0 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a9dd700 1 -- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 msgr2=0x7f17940cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a9dd700 1 --2- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a9dd700 1 -- 172.21.15.46:0/1157459726 >> v1:172.21.15.46:6789/0 conn(0x7f17940b8ad0 legacy=0x7f179406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.540+0000 7f179a9dd700 1 -- 172.21.15.46:0/1157459726 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940d0cb0 con 0x7f17940b4910 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179a9dd700 1 --2- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b4910 0x7f17940b4db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e54a16d73140fb1 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f17991da700 1 -- 172.21.15.46:0/1157459726 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c00e070 con 0x7f17940b4910 2023-05-21T16:54:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f17991da700 1 -- 172.21.15.46:0/1157459726 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c00bb20 con 0x7f17940b4910 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f17991da700 1 -- 172.21.15.46:0/1157459726 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c012430 con 0x7f17940b4910 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b4910 msgr2=0x7f17940b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 --2- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b4910 0x7f17940b4db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- 172.21.15.46:0/1157459726 shutdown_connections 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 --2- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b4910 0x7f17940b4db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 --2- 172.21.15.46:0/1157459726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- 172.21.15.46:0/1157459726 >> 172.21.15.46:0/1157459726 conn(0x7f17940d3ae0 msgr2=0x7f17940cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- 172.21.15.46:0/1157459726 shutdown_connections 2023-05-21T16:54:43.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- 172.21.15.46:0/1157459726 wait complete. 2023-05-21T16:54:43.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 Processor -- start 2023-05-21T16:54:43.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- start start 2023-05-21T16:54:43.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 0x7f179415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b8ad0 0x7f17940b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17941601f0 con 0x7f17940b4910 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179406bee0 con 0x7f17940b8ad0 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179b1de700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17941f1970 con 0x7f17940b5ce0 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179a1dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 0x7f179415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179a1dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 0x7f179415b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40530/0 (socket says 172.21.15.46:40530) 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179a1dc700 1 -- 172.21.15.46:0/382520559 learned_addr learned my addr 172.21.15.46:0/382520559 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f17999db700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.544+0000 7f179a9dd700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b8ad0 0x7f17940b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179a1dc700 1 -- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 msgr2=0x7f17940a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179a1dc700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179a1dc700 1 -- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b8ad0 msgr2=0x7f17940b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179a1dc700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b8ad0 0x7f17940b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179a1dc700 1 -- 172.21.15.46:0/382520559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009a70 con 0x7f17940b4910 2023-05-21T16:54:43.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179a1dc700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 0x7f179415b3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f179000c700 tx=0x7f179000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790005d90 con 0x7f17940b4910 2023-05-21T16:54:43.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17900070d0 con 0x7f17940b4910 2023-05-21T16:54:43.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17940cd790 con 0x7f17940b4910 2023-05-21T16:54:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790007480 con 0x7f17940b4910 2023-05-21T16:54:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17940cd4f0 con 0x7f17940b4910 2023-05-21T16:54:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17940cda70 con 0x7f17940b4910 2023-05-21T16:54:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.548+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17900075e0 con 0x7f17940b4910 2023-05-21T16:54:43.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.552+0000 7f178affd700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f17780662f0 0x7f17780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.552+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1790082e50 con 0x7f17940b4910 2023-05-21T16:54:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.552+0000 7f17999db700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f17780662f0 0x7f17780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.552+0000 7f17999db700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f17780662f0 0x7f17780687a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17940cf9e0 tx=0x7f1784009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.560+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1790088060 con 0x7f17940b4910 2023-05-21T16:54:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.724+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17941f1b30 con 0x7f17940b4910 2023-05-21T16:54:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.724+0000 7f178affd700 1 -- 172.21.15.46:0/382520559 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17900880a0 con 0x7f17940b4910 2023-05-21T16:54:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f17780662f0 msgr2=0x7f17780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f17780662f0 0x7f17780687a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17940cf9e0 tx=0x7f1784009240 comp rx=0 tx=0).stop 2023-05-21T16:54:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 msgr2=0x7f179415b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 0x7f179415b3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f179000c700 tx=0x7f179000ca10 comp rx=0 tx=0).stop 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 shutdown_connections 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f17780662f0 0x7f17780687a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17940b8ad0 0x7f17940b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17940b5ce0 0x7f17940a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 --2- 172.21.15.46:0/382520559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17940b4910 0x7f179415b3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 >> 172.21.15.46:0/382520559 conn(0x7f17940d3ae0 msgr2=0x7f17940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 shutdown_connections 2023-05-21T16:54:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.728+0000 7f179b1de700 1 -- 172.21.15.46:0/382520559 wait complete. 2023-05-21T16:54:43.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:43.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.852+0000 7fc7b6b3f700 1 Processor -- start 2023-05-21T16:54:43.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.852+0000 7fc7b6b3f700 1 -- start start 2023-05-21T16:54:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b00ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7b00aecb0 0x7fc7b00cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7b00cca80 0x7fc7b00b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00ccf00 con 0x7fc7b00aecb0 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00cee30 con 0x7fc7b00cca80 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00ce260 con 0x7fc7b01591a0 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7b00aecb0 0x7fc7b00cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7b00aecb0 0x7fc7b00cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40540/0 (socket says 172.21.15.46:40540) 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 -- 172.21.15.46:0/1537627954 learned_addr learned my addr 172.21.15.46:0/1537627954 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b633e700 1 --2- 172.21.15.46:0/1537627954 >> v2:172.21.15.142:3300/0 conn(0x7fc7b00cca80 0x7fc7b00b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b5b3d700 1 --2- 172.21.15.46:0/1537627954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b00ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 -- 172.21.15.46:0/1537627954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 msgr2=0x7fc7b00ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 --2- 172.21.15.46:0/1537627954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b00ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 -- 172.21.15.46:0/1537627954 >> v2:172.21.15.142:3300/0 conn(0x7fc7b00cca80 msgr2=0x7fc7b00b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 --2- 172.21.15.46:0/1537627954 >> v2:172.21.15.142:3300/0 conn(0x7fc7b00cca80 0x7fc7b00b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 -- 172.21.15.46:0/1537627954 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00ce500 con 0x7fc7b00aecb0 2023-05-21T16:54:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b533c700 1 --2- 172.21.15.46:0/1537627954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b00cc540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00ae720 tx=0x7fc7a000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc41e586a3860e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b4b3b700 1 -- 172.21.15.46:0/1537627954 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a000dd90 con 0x7fc7b00aecb0 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b4b3b700 1 -- 172.21.15.46:0/1537627954 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a0010470 con 0x7fc7b00aecb0 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b4b3b700 1 -- 172.21.15.46:0/1537627954 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0010800 con 0x7fc7b00aecb0 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1537627954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 msgr2=0x7fc7b00cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1537627954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b00cc540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00ae720 tx=0x7fc7a000be90 comp rx=0 tx=0).stop 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1537627954 shutdown_connections 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1537627954 >> v2:172.21.15.142:3300/0 conn(0x7fc7b00cca80 0x7fc7b00b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1537627954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b00cc540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1537627954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b00ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1537627954 >> 172.21.15.46:0/1537627954 conn(0x7fc7b006d8f0 msgr2=0x7fc7b006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:43.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1537627954 shutdown_connections 2023-05-21T16:54:43.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.856+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1537627954 wait complete. 2023-05-21T16:54:43.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 Processor -- start 2023-05-21T16:54:43.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 -- start start 2023-05-21T16:54:43.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b01ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7b00cca80 0x7fc7b00c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b006a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b01eda90 con 0x7fc7b00aecb0 2023-05-21T16:54:43.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00c3fe0 con 0x7fc7b00cca80 2023-05-21T16:54:43.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b6b3f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00c42c0 con 0x7fc7b01591a0 2023-05-21T16:54:43.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b01ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b01ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40544/0 (socket says 172.21.15.46:40544) 2023-05-21T16:54:43.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 -- 172.21.15.46:0/1054275653 learned_addr learned my addr 172.21.15.46:0/1054275653 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:43.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b533c700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7b00cca80 0x7fc7b00c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b633e700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 -- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 msgr2=0x7fc7b006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b006a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 -- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7b00cca80 msgr2=0x7fc7b00c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:43.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7b00cca80 0x7fc7b00c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:43.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 -- 172.21.15.46:0/1054275653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a000b810 con 0x7fc7b00aecb0 2023-05-21T16:54:43.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.860+0000 7fc7b5b3d700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b01ed550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00d800 tx=0x7fc7ac00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0125f0 con 0x7fc7b00aecb0 2023-05-21T16:54:43.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac012750 con 0x7fc7b00aecb0 2023-05-21T16:54:43.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b00ceac0 con 0x7fc7b00aecb0 2023-05-21T16:54:43.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac012ac0 con 0x7fc7b00aecb0 2023-05-21T16:54:43.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b00ce7e0 con 0x7fc7b00aecb0 2023-05-21T16:54:43.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b015dce0 con 0x7fc7b00aecb0 2023-05-21T16:54:43.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7ac012c20 con 0x7fc7b00aecb0 2023-05-21T16:54:43.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7a67fc700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7940662f0 0x7fc7940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:43.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7ac083e40 con 0x7fc7b00aecb0 2023-05-21T16:54:43.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.864+0000 7fc7b533c700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7940662f0 0x7fc7940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:43.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.868+0000 7fc7b533c700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7940662f0 0x7fc7940687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000bfd0 tx=0x7fc7a0013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:43.876+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7ac051250 con 0x7fc7b00aecb0 2023-05-21T16:54:44.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.040+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b0067ac0 con 0x7fc7b00aecb0 2023-05-21T16:54:44.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7a67fc700 1 -- 172.21.15.46:0/1054275653 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fc7ac054870 con 0x7fc7b00aecb0 2023-05-21T16:54:44.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:44.050 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7940662f0 msgr2=0x7fc7940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7940662f0 0x7fc7940687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000bfd0 tx=0x7fc7a0013000 comp rx=0 tx=0).stop 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 msgr2=0x7fc7b01ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b01ed550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00d800 tx=0x7fc7ac00db10 comp rx=0 tx=0).stop 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 shutdown_connections 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7940662f0 0x7fc7940687a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7b01591a0 0x7fc7b006a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7b00cca80 0x7fc7b00c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 --2- 172.21.15.46:0/1054275653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b00aecb0 0x7fc7b01ed550 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 >> 172.21.15.46:0/1054275653 conn(0x7fc7b006d8f0 msgr2=0x7fc7b01562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 shutdown_connections 2023-05-21T16:54:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.044+0000 7fc7b6b3f700 1 -- 172.21.15.46:0/1054275653 wait complete. 2023-05-21T16:54:44.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:44.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.180+0000 7ff5d3fff700 1 Processor -- start 2023-05-21T16:54:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.180+0000 7ff5d3fff700 1 -- start start 2023-05-21T16:54:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5d415a8d0 0x7ff5d415e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d415aca0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40ca520 con 0x7ff5d40aec10 2023-05-21T16:54:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d40cb7f0 con 0x7ff5d415a8d0 2023-05-21T16:54:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff5d40cbc10 0x7ff5d40cc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33882/0 (socket says 172.21.15.46:33882) 2023-05-21T16:54:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d37fe700 1 -- 172.21.15.46:0/1650246900 learned_addr learned my addr 172.21.15.46:0/1650246900 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d2ffd700 1 --2- 172.21.15.46:0/1650246900 >> v2:172.21.15.142:3300/0 conn(0x7ff5d415a8d0 0x7ff5d415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d27fc700 1 -- 172.21.15.46:0/1650246900 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469622826 0 0) 0x7ff5d415aca0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d27fc700 1 -- 172.21.15.46:0/1650246900 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c00035d0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d2ffd700 1 -- 172.21.15.46:0/1650246900 >> v1:172.21.15.142:6789/0 conn(0x7ff5d40aec10 legacy=0x7ff5d415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d2ffd700 1 -- 172.21.15.46:0/1650246900 >> v1:172.21.15.46:6789/0 conn(0x7ff5d40cbc10 legacy=0x7ff5d40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d2ffd700 1 -- 172.21.15.46:0/1650246900 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40cab70 con 0x7ff5d415a8d0 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d2ffd700 1 --2- 172.21.15.46:0/1650246900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d415a8d0 0x7ff5d415e390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009850 tx=0x7ff5c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b4814eee5926c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d27fc700 1 -- 172.21.15.46:0/1650246900 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4011830 con 0x7ff5d415a8d0 2023-05-21T16:54:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d27fc700 1 -- 172.21.15.46:0/1650246900 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4011990 con 0x7ff5d415a8d0 2023-05-21T16:54:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d27fc700 1 -- 172.21.15.46:0/1650246900 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4011d40 con 0x7ff5d415a8d0 2023-05-21T16:54:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- 172.21.15.46:0/1650246900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d415a8d0 msgr2=0x7ff5d415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/1650246900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d415a8d0 0x7ff5d415e390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009850 tx=0x7ff5c4009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- 172.21.15.46:0/1650246900 shutdown_connections 2023-05-21T16:54:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/1650246900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d415a8d0 0x7ff5d415e390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- 172.21.15.46:0/1650246900 >> 172.21.15.46:0/1650246900 conn(0x7ff5d406d930 msgr2=0x7ff5d406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- 172.21.15.46:0/1650246900 shutdown_connections 2023-05-21T16:54:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.184+0000 7ff5d3fff700 1 -- 172.21.15.46:0/1650246900 wait complete. 2023-05-21T16:54:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 Processor -- start 2023-05-21T16:54:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 -- start start 2023-05-21T16:54:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d40aec10 0x7ff5d40c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5d40cbc10 0x7ff5d415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5d415a8d0 0x7ff5d4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d415bc40 con 0x7ff5d40cbc10 2023-05-21T16:54:44.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d415da00 con 0x7ff5d40aec10 2023-05-21T16:54:44.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d3fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4155020 con 0x7ff5d415a8d0 2023-05-21T16:54:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5cbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5d40cbc10 0x7ff5d415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d40aec10 0x7ff5d40c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d40aec10 0x7ff5d40c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:60036/0 (socket says 172.21.15.46:60036) 2023-05-21T16:54:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d2ffd700 1 -- 172.21.15.46:0/2714840751 learned_addr learned my addr 172.21.15.46:0/2714840751 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:44.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.188+0000 7ff5d37fe700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5d415a8d0 0x7ff5d4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cbfff700 1 -- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5d415a8d0 msgr2=0x7ff5d4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cbfff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5d415a8d0 0x7ff5d4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cbfff700 1 -- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d40aec10 msgr2=0x7ff5d40c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cbfff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d40aec10 0x7ff5d40c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cbfff700 1 -- 172.21.15.46:0/2714840751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40094b0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cbfff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5d40cbc10 0x7ff5d415b700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00c480 tx=0x7ff5bc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0052d0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc005430 con 0x7ff5d40cbc10 2023-05-21T16:54:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0055a0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d40cb130 con 0x7ff5d40cbc10 2023-05-21T16:54:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40cae50 con 0x7ff5d40cbc10 2023-05-21T16:54:44.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d40cb410 con 0x7ff5d40cbc10 2023-05-21T16:54:44.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.192+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5bc0038e0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.196+0000 7ff5cb7fe700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5b4066320 0x7ff5b40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.196+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5bc0830e0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.196+0000 7ff5d2ffd700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5b4066320 0x7ff5b40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.196+0000 7ff5d2ffd700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5b4066320 0x7ff5b40687d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009ba0 tx=0x7ff5c401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.200+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff5bc050440 con 0x7ff5d40cbc10 2023-05-21T16:54:44.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.364+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5d4073cb0 con 0x7ff5d40cbc10 2023-05-21T16:54:44.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.364+0000 7ff5cb7fe700 1 -- 172.21.15.46:0/2714840751 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5bc053a60 con 0x7ff5d40cbc10 2023-05-21T16:54:44.370 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:44.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5b4066320 msgr2=0x7ff5b40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5b4066320 0x7ff5b40687d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009ba0 tx=0x7ff5c401c040 comp rx=0 tx=0).stop 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5d40cbc10 msgr2=0x7ff5d415b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5d40cbc10 0x7ff5d415b700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00c480 tx=0x7ff5bc00c790 comp rx=0 tx=0).stop 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 shutdown_connections 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff5b4066320 0x7ff5b40687d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5d415a8d0 0x7ff5d4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5d40cbc10 0x7ff5d415b700 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 --2- 172.21.15.46:0/2714840751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5d40aec10 0x7ff5d40c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 >> 172.21.15.46:0/2714840751 conn(0x7ff5d406d930 msgr2=0x7ff5d40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:44.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 shutdown_connections 2023-05-21T16:54:44.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.368+0000 7ff5d3fff700 1 -- 172.21.15.46:0/2714840751 wait complete. 2023-05-21T16:54:44.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f094255f700 1 Processor -- start 2023-05-21T16:54:44.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f094255f700 1 -- start start 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f094255f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09340514c0 0x7f09340e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f094255f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09340e5260 con 0x7f0934038980 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f094255f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0934053500 con 0x7f0934036320 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f094255f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093403a460 con 0x7f09340514c0 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f0941d5e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0934038980 0x7f0934055650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39438/0 (socket says 172.21.15.46:39438) 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f0941d5e700 1 -- 172.21.15.46:0/3530965702 learned_addr learned my addr 172.21.15.46:0/3530965702 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:44.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f0940d5c700 1 --2- 172.21.15.46:0/3530965702 >> v2:172.21.15.142:3300/0 conn(0x7f09340514c0 0x7f09340e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f092ffff700 1 -- 172.21.15.46:0/3530965702 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369447118 0 0) 0x7f093c073190 con 0x7f0934038980 2023-05-21T16:54:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f092ffff700 1 -- 172.21.15.46:0/3530965702 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09280035d0 con 0x7f0934038980 2023-05-21T16:54:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f092ffff700 1 -- 172.21.15.46:0/3530965702 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2810983467 0 0) 0x7f09280035d0 con 0x7f0934038980 2023-05-21T16:54:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f0940d5c700 1 -- 172.21.15.46:0/3530965702 >> v1:172.21.15.142:6789/0 conn(0x7f0934036320 legacy=0x7f0934039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f0940d5c700 1 -- 172.21.15.46:0/3530965702 >> v1:172.21.15.46:6789/0 conn(0x7f0934038980 legacy=0x7f0934055650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.500+0000 7f0940d5c700 1 -- 172.21.15.46:0/3530965702 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934051950 con 0x7f09340514c0 2023-05-21T16:54:44.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f0940d5c700 1 --2- 172.21.15.46:0/3530965702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09340514c0 0x7f09340e4d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0930009850 tx=0x7f0930009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff913b0bb1360dc1 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f092ffff700 1 -- 172.21.15.46:0/3530965702 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c04e360 con 0x7f09340514c0 2023-05-21T16:54:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f092ffff700 1 -- 172.21.15.46:0/3530965702 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0930004030 con 0x7f09340514c0 2023-05-21T16:54:44.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f092ffff700 1 -- 172.21.15.46:0/3530965702 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300043e0 con 0x7f09340514c0 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 -- 172.21.15.46:0/3530965702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09340514c0 msgr2=0x7f09340e4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 --2- 172.21.15.46:0/3530965702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09340514c0 0x7f09340e4d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0930009850 tx=0x7f0930009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 -- 172.21.15.46:0/3530965702 shutdown_connections 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 --2- 172.21.15.46:0/3530965702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09340514c0 0x7f09340e4d20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 -- 172.21.15.46:0/3530965702 >> 172.21.15.46:0/3530965702 conn(0x7f0934057b90 msgr2=0x7f0934053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 -- 172.21.15.46:0/3530965702 shutdown_connections 2023-05-21T16:54:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 -- 172.21.15.46:0/3530965702 wait complete. 2023-05-21T16:54:44.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 Processor -- start 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.504+0000 7f094255f700 1 -- start start 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0934036320 0x7f09340ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0934038980 0x7f0934176490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 0x7f093403a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340d8710 con 0x7f09340514c0 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340e22f0 con 0x7f0934038980 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340e25d0 con 0x7f0934036320 2023-05-21T16:54:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 0x7f093403a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 0x7f093403a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52550/0 (socket says 172.21.15.46:52550) 2023-05-21T16:54:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0940d5c700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0934038980 0x7f0934176490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 -- 172.21.15.46:0/3404280959 learned_addr learned my addr 172.21.15.46:0/3404280959 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094155d700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0934036320 0x7f09340ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 -- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0934036320 msgr2=0x7f09340ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0934036320 0x7f09340ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 -- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0934038980 msgr2=0x7f0934176490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0934038980 0x7f0934176490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 -- 172.21.15.46:0/3404280959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300094b0 con 0x7f09340514c0 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f0941d5e700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 0x7f093403a5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f093c04fba0 tx=0x7f093c073b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c072590 con 0x7f09340514c0 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c066f80 con 0x7f09340514c0 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0934054e50 con 0x7f09340514c0 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c067350 con 0x7f09340514c0 2023-05-21T16:54:44.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0934054b70 con 0x7f09340514c0 2023-05-21T16:54:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.508+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f093c0923c0 con 0x7f09340514c0 2023-05-21T16:54:44.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.512+0000 7f092dffb700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09200662f0 0x7f09200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.512+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f093c0fd160 con 0x7f09340514c0 2023-05-21T16:54:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.512+0000 7f094155d700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09200662f0 0x7f09200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.512+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934055130 con 0x7f09340514c0 2023-05-21T16:54:44.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.512+0000 7f094155d700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09200662f0 0x7f09200687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09341799b0 tx=0x7f0938009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.520+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f093c0ca5f0 con 0x7f09340514c0 2023-05-21T16:54:44.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09340e5260 con 0x7f09340514c0 2023-05-21T16:54:44.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f092dffb700 1 -- 172.21.15.46:0/3404280959 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f093c08d020 con 0x7f09340514c0 2023-05-21T16:54:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:44.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09200662f0 msgr2=0x7f09200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09200662f0 0x7f09200687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09341799b0 tx=0x7f0938009040 comp rx=0 tx=0).stop 2023-05-21T16:54:44.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 msgr2=0x7f093403a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 0x7f093403a5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f093c04fba0 tx=0x7f093c073b40 comp rx=0 tx=0).stop 2023-05-21T16:54:44.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 shutdown_connections 2023-05-21T16:54:44.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09200662f0 0x7f09200687a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f09340514c0 0x7f093403a5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0934038980 0x7f0934176490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 --2- 172.21.15.46:0/3404280959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0934036320 0x7f09340ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.684+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 >> 172.21.15.46:0/3404280959 conn(0x7f0934057b90 msgr2=0x7f0934037e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:44.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.688+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 shutdown_connections 2023-05-21T16:54:44.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.688+0000 7f094255f700 1 -- 172.21.15.46:0/3404280959 wait complete. 2023-05-21T16:54:44.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.816+0000 7f2e822df700 1 Processor -- start 2023-05-21T16:54:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.816+0000 7f2e822df700 1 -- start start 2023-05-21T16:54:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e7c0b8ad0 0x7f2e7c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2e7c0b4910 0x7f2e7c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c0b8ea0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0b52f0 con 0x7f2e7c0b4910 2023-05-21T16:54:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0d09d0 con 0x7f2e7c0b8ad0 2023-05-21T16:54:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2e7c0b4910 0x7f2e7c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2e7c0b4910 0x7f2e7c0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52566/0 (socket says 172.21.15.46:52566) 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 -- 172.21.15.46:0/3519886238 learned_addr learned my addr 172.21.15.46:0/3519886238 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e80adc700 1 --1- 172.21.15.46:0/3519886238 >> v1:172.21.15.46:6789/0 conn(0x7f2e7c0b5ce0 0x7f2e7c06a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39442/0 (socket says 172.21.15.46:39442) 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e812dd700 1 --2- 172.21.15.46:0/3519886238 >> v2:172.21.15.142:3300/0 conn(0x7f2e7c0b8ad0 0x7f2e7c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 -- 172.21.15.46:0/3519886238 >> v2:172.21.15.142:3300/0 conn(0x7f2e7c0b8ad0 msgr2=0x7f2e7c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 --2- 172.21.15.46:0/3519886238 >> v2:172.21.15.142:3300/0 conn(0x7f2e7c0b8ad0 0x7f2e7c0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 -- 172.21.15.46:0/3519886238 >> v1:172.21.15.46:6789/0 conn(0x7f2e7c0b5ce0 legacy=0x7f2e7c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 -- 172.21.15.46:0/3519886238 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0d0cb0 con 0x7f2e7c0b4910 2023-05-21T16:54:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e81ade700 1 --2- 172.21.15.46:0/3519886238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b4910 0x7f2e7c0b4db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0cf870 tx=0x7f2e7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb3740f14459741 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e73fff700 1 -- 172.21.15.46:0/3519886238 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400e070 con 0x7f2e7c0b4910 2023-05-21T16:54:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e73fff700 1 -- 172.21.15.46:0/3519886238 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400b9c0 con 0x7f2e7c0b4910 2023-05-21T16:54:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e73fff700 1 -- 172.21.15.46:0/3519886238 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400bd70 con 0x7f2e7c0b4910 2023-05-21T16:54:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- 172.21.15.46:0/3519886238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b4910 msgr2=0x7f2e7c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 --2- 172.21.15.46:0/3519886238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b4910 0x7f2e7c0b4db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0cf870 tx=0x7f2e7400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- 172.21.15.46:0/3519886238 shutdown_connections 2023-05-21T16:54:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 --2- 172.21.15.46:0/3519886238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b4910 0x7f2e7c0b4db0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 --2- 172.21.15.46:0/3519886238 >> v2:172.21.15.142:3300/0 conn(0x7f2e7c0b8ad0 0x7f2e7c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- 172.21.15.46:0/3519886238 >> 172.21.15.46:0/3519886238 conn(0x7f2e7c0d3ae0 msgr2=0x7f2e7c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- 172.21.15.46:0/3519886238 shutdown_connections 2023-05-21T16:54:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.820+0000 7f2e822df700 1 -- 172.21.15.46:0/3519886238 wait complete. 2023-05-21T16:54:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 Processor -- start 2023-05-21T16:54:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 -- start start 2023-05-21T16:54:44.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e7c0b4910 0x7f2e7c155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 0x7f2e7c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e7c0b8ad0 0x7f2e7c1f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1f3d90 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1f3480 con 0x7f2e7c0b8ad0 2023-05-21T16:54:44.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1568d0 con 0x7f2e7c0b4910 2023-05-21T16:54:44.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 0x7f2e7c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 0x7f2e7c156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52576/0 (socket says 172.21.15.46:52576) 2023-05-21T16:54:44.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 -- 172.21.15.46:0/1379102975 learned_addr learned my addr 172.21.15.46:0/1379102975 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:44.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e81ade700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e7c0b8ad0 0x7f2e7c1f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e812dd700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e7c0b4910 0x7f2e7c155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 -- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e7c0b4910 msgr2=0x7f2e7c155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e7c0b4910 0x7f2e7c155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 -- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e7c0b8ad0 msgr2=0x7f2e7c1f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e7c0b8ad0 0x7f2e7c1f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 -- 172.21.15.46:0/1379102975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74009b30 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e80adc700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 0x7f2e7c156060 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800c440 tx=0x7f2e7800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78005cd0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e78005e30 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c0cd790 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e780072f0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.824+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c0cd4f0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.828+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0cda70 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.828+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e78007450 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.828+0000 7f2e71ffb700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2e600662f0 0x7f2e600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:44.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.828+0000 7f2e812dd700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2e600662f0 0x7f2e600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:44.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.828+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e78082f80 con 0x7f2e7c0b5ce0 2023-05-21T16:54:44.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.832+0000 7f2e812dd700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2e600662f0 0x7f2e600687a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c157d80 tx=0x7f2e6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:44.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.836+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2e780b36f0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:45.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.996+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e7c1f3ed0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:45.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:44.996+0000 7f2e71ffb700 1 -- 172.21.15.46:0/1379102975 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e7c1f3ed0 con 0x7f2e7c0b5ce0 2023-05-21T16:54:45.003 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:45.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2e600662f0 msgr2=0x7f2e600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2e600662f0 0x7f2e600687a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c157d80 tx=0x7f2e6c008040 comp rx=0 tx=0).stop 2023-05-21T16:54:45.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 msgr2=0x7f2e7c156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 0x7f2e7c156060 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800c440 tx=0x7f2e7800c750 comp rx=0 tx=0).stop 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 shutdown_connections 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2e600662f0 0x7f2e600687a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e7c0b8ad0 0x7f2e7c1f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e7c0b5ce0 0x7f2e7c156060 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 --2- 172.21.15.46:0/1379102975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e7c0b4910 0x7f2e7c155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 >> 172.21.15.46:0/1379102975 conn(0x7f2e7c0d3ae0 msgr2=0x7f2e7c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 shutdown_connections 2023-05-21T16:54:45.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.000+0000 7f2e822df700 1 -- 172.21.15.46:0/1379102975 wait complete. 2023-05-21T16:54:45.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:45.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc55840700 1 Processor -- start 2023-05-21T16:54:45.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc55840700 1 -- start start 2023-05-21T16:54:45.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc55840700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc50153b10 0x7fbc5015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc55840700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc50161380 con 0x7fbc50160400 2023-05-21T16:54:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc55840700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5015d440 con 0x7fbc500cc5d0 2023-05-21T16:54:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc55840700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc500cd2b0 con 0x7fbc50153b10 2023-05-21T16:54:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4ffff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbc50160400 0x7fbc50069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39456/0 (socket says 172.21.15.46:39456) 2023-05-21T16:54:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4ffff700 1 -- 172.21.15.46:0/1038212243 learned_addr learned my addr 172.21.15.46:0/1038212243 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5483e700 1 --2- 172.21.15.46:0/1038212243 >> v2:172.21.15.46:3300/0 conn(0x7fbc50153b10 0x7fbc5015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925254426 0 0) 0x7fbc50161380 con 0x7fbc50160400 2023-05-21T16:54:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc3c0035d0 con 0x7fbc50160400 2023-05-21T16:54:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667200094 0 0) 0x7fbc3c0035d0 con 0x7fbc50160400 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 >> v2:172.21.15.46:3300/0 conn(0x7fbc50153b10 msgr2=0x7fbc5015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 --2- 172.21.15.46:0/1038212243 >> v2:172.21.15.46:3300/0 conn(0x7fbc50153b10 0x7fbc5015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 >> v1:172.21.15.142:6789/0 conn(0x7fbc500cc5d0 legacy=0x7fbc500cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5015d720 con 0x7fbc50160400 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7fbc380019f0 con 0x7fbc50160400 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5483e700 1 --2- 172.21.15.46:0/1038212243 >> v2:172.21.15.46:3300/0 conn(0x7fbc50153b10 0x7fbc5015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 >> v1:172.21.15.46:6789/0 conn(0x7fbc50160400 legacy=0x7fbc50069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3c003a20 0x7fbc3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc3c004870 0x7fbc3c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc3c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500cd2b0 con 0x7fbc3c005220 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c00c0a0 con 0x7fbc3c004870 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c00c260 con 0x7fbc3c003a20 2023-05-21T16:54:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc3c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4ffff700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc3c004870 0x7fbc3c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5483e700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3c003a20 0x7fbc3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 -- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3c003a20 msgr2=0x7fbc3c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3c003a20 0x7fbc3c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 -- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc3c004870 msgr2=0x7fbc3c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc3c004870 0x7fbc3c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 -- 172.21.15.46:0/1038212243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0035d0 con 0x7fbc3c005220 2023-05-21T16:54:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5483e700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3c003a20 0x7fbc3c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 -- 172.21.15.46:0/1038212243 reap_dead start 2023-05-21T16:54:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc5503f700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc3c00ba30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc480017e0 tx=0x7fbc3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b699ec218ced3a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480052d0 con 0x7fbc3c005220 2023-05-21T16:54:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48005430 con 0x7fbc3c005220 2023-05-21T16:54:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.128+0000 7fbc4f7fe700 1 -- 172.21.15.46:0/1038212243 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480055a0 con 0x7fbc3c005220 2023-05-21T16:54:45.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 -- 172.21.15.46:0/1038212243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 msgr2=0x7fbc3c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc3c00ba30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc480017e0 tx=0x7fbc3c0058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 -- 172.21.15.46:0/1038212243 shutdown_connections 2023-05-21T16:54:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 --2- 172.21.15.46:0/1038212243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc3c00ba30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 -- 172.21.15.46:0/1038212243 >> 172.21.15.46:0/1038212243 conn(0x7fbc500cf720 msgr2=0x7fbc500cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 -- 172.21.15.46:0/1038212243 shutdown_connections 2023-05-21T16:54:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 -- 172.21.15.46:0/1038212243 wait complete. 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 Processor -- start 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.132+0000 7fbc55840700 1 -- start start 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc5014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc500b09d0 0x7fbc500b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc50156460 0x7fbc50156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500b1380 con 0x7fbc3c005220 2023-05-21T16:54:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50154b60 con 0x7fbc500b09d0 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50154d90 con 0x7fbc50156460 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc5014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc5014f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52598/0 (socket says 172.21.15.46:52598) 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 -- 172.21.15.46:0/240576512 learned_addr learned my addr 172.21.15.46:0/240576512 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc4ffff700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc500b09d0 0x7fbc500b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5503f700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc50156460 0x7fbc50156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 -- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc50156460 msgr2=0x7fbc50156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc50156460 0x7fbc50156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 -- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc500b09d0 msgr2=0x7fbc500b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc500b09d0 0x7fbc500b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 -- 172.21.15.46:0/240576512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50070630 con 0x7fbc3c005220 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc5483e700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc5014f010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc40011860 tx=0x7fbc40011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40015870 con 0x7fbc3c005220 2023-05-21T16:54:45.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400159d0 con 0x7fbc3c005220 2023-05-21T16:54:45.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5015da00 con 0x7fbc3c005220 2023-05-21T16:54:45.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40015d40 con 0x7fbc3c005220 2023-05-21T16:54:45.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc500ae2c0 con 0x7fbc3c005220 2023-05-21T16:54:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.136+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5006db40 con 0x7fbc3c005220 2023-05-21T16:54:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.140+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc40013400 con 0x7fbc3c005220 2023-05-21T16:54:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.140+0000 7fbc4d7fa700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbc30066320 0x7fbc300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.140+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc40083da0 con 0x7fbc3c005220 2023-05-21T16:54:45.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.140+0000 7fbc4ffff700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbc30066320 0x7fbc300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.140+0000 7fbc4ffff700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbc30066320 0x7fbc300687d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbc501f5a30 tx=0x7fbc38006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.152+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbc40054c20 con 0x7fbc3c005220 2023-05-21T16:54:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.312+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc500cc120 con 0x7fbc3c005220 2023-05-21T16:54:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.312+0000 7fbc4d7fa700 1 -- 172.21.15.46:0/240576512 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc400547b0 con 0x7fbc3c005220 2023-05-21T16:54:45.319 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbc30066320 msgr2=0x7fbc300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbc30066320 0x7fbc300687d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbc501f5a30 tx=0x7fbc38006040 comp rx=0 tx=0).stop 2023-05-21T16:54:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 msgr2=0x7fbc5014f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc5014f010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc40011860 tx=0x7fbc40011b70 comp rx=0 tx=0).stop 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 shutdown_connections 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbc30066320 0x7fbc300687d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc50156460 0x7fbc50156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc500b09d0 0x7fbc500b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 --2- 172.21.15.46:0/240576512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc3c005220 0x7fbc5014f010 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 >> 172.21.15.46:0/240576512 conn(0x7fbc500cf720 msgr2=0x7fbc50069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 shutdown_connections 2023-05-21T16:54:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.316+0000 7fbc55840700 1 -- 172.21.15.46:0/240576512 wait complete. 2023-05-21T16:54:45.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.440+0000 7f825bfff700 1 Processor -- start 2023-05-21T16:54:45.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.440+0000 7f825bfff700 1 -- start start 2023-05-21T16:54:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.440+0000 7f825bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f825c1591a0 0x7f825c0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.440+0000 7f825bfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c0cee30 con 0x7f825c0ccc50 2023-05-21T16:54:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c0ce260 con 0x7f825c0aecb0 2023-05-21T16:54:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0ce500 con 0x7f825c1591a0 2023-05-21T16:54:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f825c1591a0 0x7f825c0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f825c0ccc50 0x7f825c06c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39464/0 (socket says 172.21.15.46:39464) 2023-05-21T16:54:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825b7fe700 1 -- 172.21.15.46:0/1792772713 learned_addr learned my addr 172.21.15.46:0/1792772713 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825affd700 1 -- 172.21.15.46:0/1792772713 >> v1:172.21.15.142:6789/0 conn(0x7f825c0aecb0 legacy=0x7f825c0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825affd700 1 -- 172.21.15.46:0/1792772713 >> v1:172.21.15.46:6789/0 conn(0x7f825c0ccc50 legacy=0x7f825c06c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825affd700 1 -- 172.21.15.46:0/1792772713 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0ce7e0 con 0x7f825c1591a0 2023-05-21T16:54:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825affd700 1 --2- 172.21.15.46:0/1792772713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c0ae770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f824c009850 tx=0x7f824c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d5e4c579e5889d server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f8259ffb700 1 -- 172.21.15.46:0/1792772713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c011830 con 0x7f825c1591a0 2023-05-21T16:54:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f8259ffb700 1 -- 172.21.15.46:0/1792772713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c011990 con 0x7f825c1591a0 2023-05-21T16:54:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f8259ffb700 1 -- 172.21.15.46:0/1792772713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c011d20 con 0x7f825c1591a0 2023-05-21T16:54:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- 172.21.15.46:0/1792772713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 msgr2=0x7f825c0ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 --2- 172.21.15.46:0/1792772713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c0ae770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f824c009850 tx=0x7f824c009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:45.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- 172.21.15.46:0/1792772713 shutdown_connections 2023-05-21T16:54:45.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 --2- 172.21.15.46:0/1792772713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c0ae770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- 172.21.15.46:0/1792772713 >> 172.21.15.46:0/1792772713 conn(0x7f825c06d8f0 msgr2=0x7f825c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- 172.21.15.46:0/1792772713 shutdown_connections 2023-05-21T16:54:45.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.444+0000 7f825bfff700 1 -- 172.21.15.46:0/1792772713 wait complete. 2023-05-21T16:54:45.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 Processor -- start 2023-05-21T16:54:45.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 -- start start 2023-05-21T16:54:45.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f825c0aecb0 0x7f825c0c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c0ccc50 0x7f825c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c1f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c6740 con 0x7f825c1591a0 2023-05-21T16:54:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c7dc0 con 0x7f825c0ccc50 2023-05-21T16:54:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c8900 con 0x7f825c0aecb0 2023-05-21T16:54:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c1f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c1f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52616/0 (socket says 172.21.15.46:52616) 2023-05-21T16:54:45.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 -- 172.21.15.46:0/1874271361 learned_addr learned my addr 172.21.15.46:0/1874271361 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:45.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825affd700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f825c0aecb0 0x7f825c0c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825a7fc700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c0ccc50 0x7f825c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 -- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f825c0aecb0 msgr2=0x7f825c0c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f825c0aecb0 0x7f825c0c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 -- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c0ccc50 msgr2=0x7f825c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c0ccc50 0x7f825c0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 -- 172.21.15.46:0/1874271361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0094b0 con 0x7f825c1591a0 2023-05-21T16:54:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825a7fc700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c0ccc50 0x7f825c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825b7fe700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c1f3250 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f825400cbc0 tx=0x7f825400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400a7b0 con 0x7f825c1591a0 2023-05-21T16:54:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825400a910 con 0x7f825c1591a0 2023-05-21T16:54:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c15dce0 con 0x7f825c1591a0 2023-05-21T16:54:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400ac80 con 0x7f825c1591a0 2023-05-21T16:54:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.448+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0ceac0 con 0x7f825c1591a0 2023-05-21T16:54:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.452+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c0cacd0 con 0x7f825c1591a0 2023-05-21T16:54:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.452+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f825401b3b0 con 0x7f825c1591a0 2023-05-21T16:54:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.452+0000 7f82437fe700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82480662f0 0x7f82480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.452+0000 7f825affd700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82480662f0 0x7f82480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.452+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82540835f0 con 0x7f825c1591a0 2023-05-21T16:54:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.452+0000 7f825affd700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82480662f0 0x7f82480687a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f824c014040 tx=0x7f824c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.460+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8254050a80 con 0x7f825c1591a0 2023-05-21T16:54:45.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.624+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825c067ac0 con 0x7f825c1591a0 2023-05-21T16:54:45.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f82437fe700 1 -- 172.21.15.46:0/1874271361 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f82540540a0 con 0x7f825c1591a0 2023-05-21T16:54:45.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:45.633 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:45.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82480662f0 msgr2=0x7f82480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82480662f0 0x7f82480687a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f824c014040 tx=0x7f824c01c040 comp rx=0 tx=0).stop 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 msgr2=0x7f825c1f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c1f3250 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f825400cbc0 tx=0x7f825400cbf0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 shutdown_connections 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f82480662f0 0x7f82480687a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825c1591a0 0x7f825c1f3250 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c0ccc50 0x7f825c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 --2- 172.21.15.46:0/1874271361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f825c0aecb0 0x7f825c0c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 >> 172.21.15.46:0/1874271361 conn(0x7f825c06d8f0 msgr2=0x7f825c0d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 shutdown_connections 2023-05-21T16:54:45.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.628+0000 7f825bfff700 1 -- 172.21.15.46:0/1874271361 wait complete. 2023-05-21T16:54:45.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:45.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.764+0000 7f81bf59e700 1 Processor -- start 2023-05-21T16:54:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.764+0000 7f81bf59e700 1 -- start start 2023-05-21T16:54:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c015d460 0x7f81c0070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c0159df0 con 0x7f81c0070ad0 2023-05-21T16:54:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c0070f10 con 0x7f81c0158d90 2023-05-21T16:54:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c015a280 con 0x7f81c015d460 2023-05-21T16:54:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f81c0070ad0 0x7f81c00ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39476/0 (socket says 172.21.15.46:39476) 2023-05-21T16:54:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bed9d700 1 -- 172.21.15.46:0/4055308583 learned_addr learned my addr 172.21.15.46:0/4055308583 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bdd9b700 1 --2- 172.21.15.46:0/4055308583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c015d460 0x7f81c0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bd59a700 1 -- 172.21.15.46:0/4055308583 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338027427 0 0) 0x7f81c0159df0 con 0x7f81c0070ad0 2023-05-21T16:54:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bd59a700 1 -- 172.21.15.46:0/4055308583 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ac0057e0 con 0x7f81c0070ad0 2023-05-21T16:54:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bdd9b700 1 -- 172.21.15.46:0/4055308583 >> v1:172.21.15.142:6789/0 conn(0x7f81c0158d90 legacy=0x7f81c00ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bd59a700 1 -- 172.21.15.46:0/4055308583 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451530295 0 0) 0x7f81c0070f10 con 0x7f81c0158d90 2023-05-21T16:54:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bdd9b700 1 -- 172.21.15.46:0/4055308583 >> v1:172.21.15.46:6789/0 conn(0x7f81c0070ad0 legacy=0x7f81c00ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bdd9b700 1 -- 172.21.15.46:0/4055308583 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00cd730 con 0x7f81c015d460 2023-05-21T16:54:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bdd9b700 1 --2- 172.21.15.46:0/4055308583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c015d460 0x7f81c0070590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009dc0 tx=0x7f81b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36940661866982 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bd59a700 1 -- 172.21.15.46:0/4055308583 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000e070 con 0x7f81c015d460 2023-05-21T16:54:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bd59a700 1 -- 172.21.15.46:0/4055308583 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000bb20 con 0x7f81c015d460 2023-05-21T16:54:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bd59a700 1 -- 172.21.15.46:0/4055308583 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000be90 con 0x7f81c015d460 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- 172.21.15.46:0/4055308583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c015d460 msgr2=0x7f81c0070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 --2- 172.21.15.46:0/4055308583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c015d460 0x7f81c0070590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009dc0 tx=0x7f81b000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- 172.21.15.46:0/4055308583 shutdown_connections 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 --2- 172.21.15.46:0/4055308583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c015d460 0x7f81c0070590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- 172.21.15.46:0/4055308583 >> 172.21.15.46:0/4055308583 conn(0x7f81c00cf720 msgr2=0x7f81c00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- 172.21.15.46:0/4055308583 shutdown_connections 2023-05-21T16:54:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.768+0000 7f81bf59e700 1 -- 172.21.15.46:0/4055308583 wait complete. 2023-05-21T16:54:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.772+0000 7f81bf59e700 1 Processor -- start 2023-05-21T16:54:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.772+0000 7f81bf59e700 1 -- start start 2023-05-21T16:54:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c0070ad0 0x7f81c0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c0158d90 0x7f81c00c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 0x7f81c00c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00b11b0 con 0x7f81c015d460 2023-05-21T16:54:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cb6a0 con 0x7f81c0158d90 2023-05-21T16:54:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cbb30 con 0x7f81c0070ad0 2023-05-21T16:54:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 0x7f81c00c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 0x7f81c00c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52624/0 (socket says 172.21.15.46:52624) 2023-05-21T16:54:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 -- 172.21.15.46:0/2033211753 learned_addr learned my addr 172.21.15.46:0/2033211753 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bdd9b700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c0158d90 0x7f81c00c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81be59c700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c0070ad0 0x7f81c0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 -- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c0070ad0 msgr2=0x7f81c0150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c0070ad0 0x7f81c0150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 -- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c0158d90 msgr2=0x7f81c00c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c0158d90 0x7f81c00c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 -- 172.21.15.46:0/2033211753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009a70 con 0x7f81c015d460 2023-05-21T16:54:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bdd9b700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c0158d90 0x7f81c00c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81be59c700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c0070ad0 0x7f81c0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bed9d700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 0x7f81c00c3cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c4f0 tx=0x7f81b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8005d90 con 0x7f81c015d460 2023-05-21T16:54:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b80070d0 con 0x7f81c015d460 2023-05-21T16:54:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c01597a0 con 0x7f81c015d460 2023-05-21T16:54:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8007460 con 0x7f81c015d460 2023-05-21T16:54:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c01594c0 con 0x7f81c015d460 2023-05-21T16:54:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.776+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c0159a80 con 0x7f81c015d460 2023-05-21T16:54:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.780+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81b80075c0 con 0x7f81c015d460 2023-05-21T16:54:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.780+0000 7f81b6ffd700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f81a0066320 0x7f81a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.780+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81b80831d0 con 0x7f81c015d460 2023-05-21T16:54:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.780+0000 7f81be59c700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f81a0066320 0x7f81a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.780+0000 7f81be59c700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f81a0066320 0x7f81a00687d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81a8000f60 tx=0x7f81a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:45.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.788+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f81b80505c0 con 0x7f81c015d460 2023-05-21T16:54:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81c00733b0 con 0x7f81c015d460 2023-05-21T16:54:45.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81b6ffd700 1 -- 172.21.15.46:0/2033211753 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81b8053be0 con 0x7f81c015d460 2023-05-21T16:54:45.953 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:45.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f81a0066320 msgr2=0x7f81a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f81a0066320 0x7f81a00687d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81a8000f60 tx=0x7f81a8009040 comp rx=0 tx=0).stop 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 msgr2=0x7f81c00c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 0x7f81c00c3cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c4f0 tx=0x7f81b800c800 comp rx=0 tx=0).stop 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 shutdown_connections 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f81a0066320 0x7f81a00687d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81c015d460 0x7f81c00c3cb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c0158d90 0x7f81c00c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 --2- 172.21.15.46:0/2033211753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c0070ad0 0x7f81c0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 >> 172.21.15.46:0/2033211753 conn(0x7f81c00cf720 msgr2=0x7f81c00c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 shutdown_connections 2023-05-21T16:54:45.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:45.948+0000 7f81bf59e700 1 -- 172.21.15.46:0/2033211753 wait complete. 2023-05-21T16:54:45.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.084+0000 7efc26ea4700 1 Processor -- start 2023-05-21T16:54:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.084+0000 7efc26ea4700 1 -- start start 2023-05-21T16:54:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc2015a8d0 0x7efc2015e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc200aec10 0x7efc2015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2015aca0 con 0x7efc2015ee10 2023-05-21T16:54:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200cb7f0 con 0x7efc2015a8d0 2023-05-21T16:54:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200ca520 con 0x7efc200aec10 2023-05-21T16:54:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc2015a8d0 0x7efc2015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc2015a8d0 0x7efc2015e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52626/0 (socket says 172.21.15.46:52626) 2023-05-21T16:54:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 -- 172.21.15.46:0/2546794663 learned_addr learned my addr 172.21.15.46:0/2546794663 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc256a1700 1 --2- 172.21.15.46:0/2546794663 >> v2:172.21.15.142:3300/0 conn(0x7efc200aec10 0x7efc2015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 -- 172.21.15.46:0/2546794663 >> v2:172.21.15.142:3300/0 conn(0x7efc200aec10 msgr2=0x7efc2015e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 --2- 172.21.15.46:0/2546794663 >> v2:172.21.15.142:3300/0 conn(0x7efc200aec10 0x7efc2015e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 -- 172.21.15.46:0/2546794663 >> v1:172.21.15.142:6789/0 conn(0x7efc2015ee10 legacy=0x7efc200b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 -- 172.21.15.46:0/2546794663 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2015f210 con 0x7efc2015a8d0 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc24ea0700 1 -- 172.21.15.46:0/2546794663 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500077086 0 0) 0x7efc2015aca0 con 0x7efc2015ee10 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc256a1700 1 --2- 172.21.15.46:0/2546794663 >> v2:172.21.15.142:3300/0 conn(0x7efc200aec10 0x7efc2015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc25ea2700 1 --2- 172.21.15.46:0/2546794663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2015a8d0 0x7efc2015e390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efc2006aa10 tx=0x7efc1c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c162975f5a0c32a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc24ea0700 1 -- 172.21.15.46:0/2546794663 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c011830 con 0x7efc2015a8d0 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc24ea0700 1 -- 172.21.15.46:0/2546794663 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c011990 con 0x7efc2015a8d0 2023-05-21T16:54:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc24ea0700 1 -- 172.21.15.46:0/2546794663 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c011d20 con 0x7efc2015a8d0 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- 172.21.15.46:0/2546794663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2015a8d0 msgr2=0x7efc2015e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 --2- 172.21.15.46:0/2546794663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2015a8d0 0x7efc2015e390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efc2006aa10 tx=0x7efc1c009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- 172.21.15.46:0/2546794663 shutdown_connections 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 --2- 172.21.15.46:0/2546794663 >> v2:172.21.15.142:3300/0 conn(0x7efc200aec10 0x7efc2015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 --2- 172.21.15.46:0/2546794663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2015a8d0 0x7efc2015e390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- 172.21.15.46:0/2546794663 >> 172.21.15.46:0/2546794663 conn(0x7efc2006d930 msgr2=0x7efc2006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- 172.21.15.46:0/2546794663 shutdown_connections 2023-05-21T16:54:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.088+0000 7efc26ea4700 1 -- 172.21.15.46:0/2546794663 wait complete. 2023-05-21T16:54:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 Processor -- start 2023-05-21T16:54:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 -- start start 2023-05-21T16:54:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 0x7efc2014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc2015a8d0 0x7efc20156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc2015ee10 0x7efc200ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200b0fe0 con 0x7efc200aec10 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200b12c0 con 0x7efc2015ee10 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc200b15a0 con 0x7efc2015a8d0 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 0x7efc2014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 0x7efc2014e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52640/0 (socket says 172.21.15.46:52640) 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 -- 172.21.15.46:0/1216820575 learned_addr learned my addr 172.21.15.46:0/1216820575 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc256a1700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc2015a8d0 0x7efc20156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc266a3700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc2015ee10 0x7efc200ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 -- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc2015a8d0 msgr2=0x7efc20156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc2015a8d0 0x7efc20156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 -- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc2015ee10 msgr2=0x7efc200ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc2015ee10 0x7efc200ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 -- 172.21.15.46:0/1216820575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100094b0 con 0x7efc200aec10 2023-05-21T16:54:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc25ea2700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 0x7efc2014e330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efc2006f4c0 tx=0x7efc1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0044d0 con 0x7efc200aec10 2023-05-21T16:54:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c009570 con 0x7efc200aec10 2023-05-21T16:54:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c01f070 con 0x7efc200aec10 2023-05-21T16:54:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc200cae50 con 0x7efc200aec10 2023-05-21T16:54:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.092+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c003900 con 0x7efc200aec10 2023-05-21T16:54:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.096+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc200cab70 con 0x7efc200aec10 2023-05-21T16:54:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.096+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc1c003a60 con 0x7efc200aec10 2023-05-21T16:54:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.096+0000 7efc167fc700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efc040662f0 0x7efc040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.096+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc1c021070 con 0x7efc200aec10 2023-05-21T16:54:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.096+0000 7efc256a1700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efc040662f0 0x7efc040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.096+0000 7efc256a1700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efc040662f0 0x7efc040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc200b2570 tx=0x7efc10009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.104+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efc1c0525b0 con 0x7efc200aec10 2023-05-21T16:54:46.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.268+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc200cb130 con 0x7efc200aec10 2023-05-21T16:54:46.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.268+0000 7efc167fc700 1 -- 172.21.15.46:0/1216820575 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc1c055bd0 con 0x7efc200aec10 2023-05-21T16:54:46.276 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:46.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efc040662f0 msgr2=0x7efc040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efc040662f0 0x7efc040687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc200b2570 tx=0x7efc10009240 comp rx=0 tx=0).stop 2023-05-21T16:54:46.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 msgr2=0x7efc2014e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 0x7efc2014e330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efc2006f4c0 tx=0x7efc1c004770 comp rx=0 tx=0).stop 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 shutdown_connections 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efc040662f0 0x7efc040687a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc2015ee10 0x7efc200ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc2015a8d0 0x7efc20156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 --2- 172.21.15.46:0/1216820575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200aec10 0x7efc2014e330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 >> 172.21.15.46:0/1216820575 conn(0x7efc2006d930 msgr2=0x7efc20159690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 shutdown_connections 2023-05-21T16:54:46.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.272+0000 7efc26ea4700 1 -- 172.21.15.46:0/1216820575 wait complete. 2023-05-21T16:54:46.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.408+0000 7f78b733c700 1 Processor -- start 2023-05-21T16:54:46.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- start start 2023-05-21T16:54:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78a8036770 0x7f78a8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80370f0 con 0x7f78a80e2d80 2023-05-21T16:54:46.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a803a820 con 0x7f78a803a450 2023-05-21T16:54:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80060c0 con 0x7f78a8036770 2023-05-21T16:54:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b5b39700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f78a80e2d80 0x7f78a80528c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39492/0 (socket says 172.21.15.46:39492) 2023-05-21T16:54:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b6b3b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78a8036770 0x7f78a8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b5b39700 1 -- 172.21.15.46:0/1498136255 learned_addr learned my addr 172.21.15.46:0/1498136255 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b6b3b700 1 -- 172.21.15.46:0/1498136255 >> v1:172.21.15.142:6789/0 conn(0x7f78a803a450 legacy=0x7f78a804f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b6b3b700 1 -- 172.21.15.46:0/1498136255 >> v1:172.21.15.46:6789/0 conn(0x7f78a80e2d80 legacy=0x7f78a80528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b6b3b700 1 -- 172.21.15.46:0/1498136255 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80e3210 con 0x7f78a8036770 2023-05-21T16:54:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b5338700 1 -- 172.21.15.46:0/1498136255 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425408637 0 0) 0x7f78a80370f0 con 0x7f78a80e2d80 2023-05-21T16:54:46.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b6b3b700 1 --2- 172.21.15.46:0/1498136255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a8036770 0x7f78a8036bb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f78b00695d0 tx=0x7f78b004eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce15763d0db8c883 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b5338700 1 -- 172.21.15.46:0/1498136255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0072490 con 0x7f78a8036770 2023-05-21T16:54:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b5338700 1 -- 172.21.15.46:0/1498136255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b00725f0 con 0x7f78a8036770 2023-05-21T16:54:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b5338700 1 -- 172.21.15.46:0/1498136255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0073a80 con 0x7f78a8036770 2023-05-21T16:54:46.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- 172.21.15.46:0/1498136255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a8036770 msgr2=0x7f78a8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 --2- 172.21.15.46:0/1498136255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a8036770 0x7f78a8036bb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f78b00695d0 tx=0x7f78b004eb10 comp rx=0 tx=0).stop 2023-05-21T16:54:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- 172.21.15.46:0/1498136255 shutdown_connections 2023-05-21T16:54:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 --2- 172.21.15.46:0/1498136255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a8036770 0x7f78a8036bb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- 172.21.15.46:0/1498136255 >> 172.21.15.46:0/1498136255 conn(0x7f78a8051770 msgr2=0x7f78a8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- 172.21.15.46:0/1498136255 shutdown_connections 2023-05-21T16:54:46.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.412+0000 7f78b733c700 1 -- 172.21.15.46:0/1498136255 wait complete. 2023-05-21T16:54:46.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 Processor -- start 2023-05-21T16:54:46.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 -- start start 2023-05-21T16:54:46.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78a8036770 0x7f78a804dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 0x7f78a80df230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a80e2d80 0x7f78a8048820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a804ec10 con 0x7f78a803a450 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80e56e0 con 0x7f78a80e2d80 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b733c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80e50d0 con 0x7f78a8036770 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 0x7f78a80df230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 0x7f78a80df230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52656/0 (socket says 172.21.15.46:52656) 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 -- 172.21.15.46:0/156467703 learned_addr learned my addr 172.21.15.46:0/156467703 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b633a700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78a8036770 0x7f78a804dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b6b3b700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a80e2d80 0x7f78a8048820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 -- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78a8036770 msgr2=0x7f78a804dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78a8036770 0x7f78a804dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 -- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a80e2d80 msgr2=0x7f78a8048820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a80e2d80 0x7f78a8048820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 -- 172.21.15.46:0/156467703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80e37d0 con 0x7f78a803a450 2023-05-21T16:54:46.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78b5b39700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 0x7f78a80df230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c550 tx=0x7f78a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.416+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004ca0 con 0x7f78a803a450 2023-05-21T16:54:46.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a4004e00 con 0x7f78a803a450 2023-05-21T16:54:46.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80e34f0 con 0x7f78a803a450 2023-05-21T16:54:46.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4007310 con 0x7f78a803a450 2023-05-21T16:54:46.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80e3ab0 con 0x7f78a803a450 2023-05-21T16:54:46.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a80df7d0 con 0x7f78a803a450 2023-05-21T16:54:46.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78a4007470 con 0x7f78a803a450 2023-05-21T16:54:46.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78a2ffd700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78940662f0 0x7f78940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78a40839a0 con 0x7f78a803a450 2023-05-21T16:54:46.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78b633a700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78940662f0 0x7f78940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.420+0000 7f78b633a700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78940662f0 0x7f78940687a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a80391f0 tx=0x7f78ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.428+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78a4050d80 con 0x7f78a803a450 2023-05-21T16:54:46.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:54:46.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:54:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.592+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78a80e5850 con 0x7f78a803a450 2023-05-21T16:54:46.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.592+0000 7f78a2ffd700 1 -- 172.21.15.46:0/156467703 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78a4007720 con 0x7f78a803a450 2023-05-21T16:54:46.599 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:46.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78940662f0 msgr2=0x7f78940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78940662f0 0x7f78940687a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a80391f0 tx=0x7f78ac009040 comp rx=0 tx=0).stop 2023-05-21T16:54:46.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 msgr2=0x7f78a80df230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 0x7f78a80df230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c550 tx=0x7f78a400c860 comp rx=0 tx=0).stop 2023-05-21T16:54:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 shutdown_connections 2023-05-21T16:54:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f78940662f0 0x7f78940687a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a80e2d80 0x7f78a8048820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78a803a450 0x7f78a80df230 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 --2- 172.21.15.46:0/156467703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78a8036770 0x7f78a804dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 >> 172.21.15.46:0/156467703 conn(0x7f78a8051770 msgr2=0x7f78a8034750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 shutdown_connections 2023-05-21T16:54:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.596+0000 7f78b733c700 1 -- 172.21.15.46:0/156467703 wait complete. 2023-05-21T16:54:46.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.724+0000 7efdda897700 1 Processor -- start 2023-05-21T16:54:46.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.724+0000 7efdda897700 1 -- start start 2023-05-21T16:54:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efdd40b5ce0 0x7efdd40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40b8ea0 con 0x7efdd40b8ad0 2023-05-21T16:54:46.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40d09d0 con 0x7efdd40b4910 2023-05-21T16:54:46.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd40d0cb0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9094700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efdd40b5ce0 0x7efdd40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9895700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efdd40b8ad0 0x7efdd406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39502/0 (socket says 172.21.15.46:39502) 2023-05-21T16:54:46.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9094700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efdd40b5ce0 0x7efdd40cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52662/0 (socket says 172.21.15.46:52662) 2023-05-21T16:54:46.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9895700 1 -- 172.21.15.46:0/2720030860 learned_addr learned my addr 172.21.15.46:0/2720030860 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:46.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9094700 1 -- 172.21.15.46:0/2720030860 >> v1:172.21.15.142:6789/0 conn(0x7efdd40b4910 legacy=0x7efdd40d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9094700 1 -- 172.21.15.46:0/2720030860 >> v1:172.21.15.46:6789/0 conn(0x7efdd40b8ad0 legacy=0x7efdd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9094700 1 -- 172.21.15.46:0/2720030860 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40cd4f0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd9094700 1 --2- 172.21.15.46:0/2720030860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd40cf310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009850 tx=0x7efdd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5881995fe71de58 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd8893700 1 -- 172.21.15.46:0/2720030860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011830 con 0x7efdd40b5ce0 2023-05-21T16:54:46.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd8893700 1 -- 172.21.15.46:0/2720030860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0011990 con 0x7efdd40b5ce0 2023-05-21T16:54:46.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdd8893700 1 -- 172.21.15.46:0/2720030860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011d20 con 0x7efdd40b5ce0 2023-05-21T16:54:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- 172.21.15.46:0/2720030860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 msgr2=0x7efdd40cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 --2- 172.21.15.46:0/2720030860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd40cf310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009850 tx=0x7efdd0009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- 172.21.15.46:0/2720030860 shutdown_connections 2023-05-21T16:54:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 --2- 172.21.15.46:0/2720030860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd40cf310 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- 172.21.15.46:0/2720030860 >> 172.21.15.46:0/2720030860 conn(0x7efdd40d3ae0 msgr2=0x7efdd40cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:46.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- 172.21.15.46:0/2720030860 shutdown_connections 2023-05-21T16:54:46.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.728+0000 7efdda897700 1 -- 172.21.15.46:0/2720030860 wait complete. 2023-05-21T16:54:46.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 Processor -- start 2023-05-21T16:54:46.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 -- start start 2023-05-21T16:54:46.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdd40b4910 0x7efdd415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd4160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdd40b8ad0 0x7efdd415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4149460 con 0x7efdd40b5ce0 2023-05-21T16:54:46.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd41496b0 con 0x7efdd40b8ad0 2023-05-21T16:54:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda897700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4149990 con 0x7efdd40b4910 2023-05-21T16:54:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd4160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52670/0 (socket says 172.21.15.46:52670) 2023-05-21T16:54:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 -- 172.21.15.46:0/1658413167 learned_addr learned my addr 172.21.15.46:0/1658413167 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdda096700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdd40b8ad0 0x7efdd415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9895700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdd40b4910 0x7efdd415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 -- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdd40b4910 msgr2=0x7efdd415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdd40b4910 0x7efdd415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 -- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdd40b8ad0 msgr2=0x7efdd415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdd40b8ad0 0x7efdd415c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.732+0000 7efdd9094700 1 -- 172.21.15.46:0/1658413167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00094b0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdd9094700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd4160260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efdd40b55f0 tx=0x7efdd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00036c0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0003820 con 0x7efdd40b5ce0 2023-05-21T16:54:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd40cda70 con 0x7efdd40b5ce0 2023-05-21T16:54:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003bd0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd40cd790 con 0x7efdd40b5ce0 2023-05-21T16:54:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd40b4db0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdd0003d30 con 0x7efdd40b5ce0 2023-05-21T16:54:46.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdca7fc700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efdb80662f0 0x7efdb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdd0021030 con 0x7efdd40b5ce0 2023-05-21T16:54:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.736+0000 7efdd9895700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efdb80662f0 0x7efdb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.740+0000 7efdd9895700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efdb80662f0 0x7efdb80687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdc4005930 tx=0x7efdc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:46.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.744+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efdd0052960 con 0x7efdd40b5ce0 2023-05-21T16:54:46.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdd40733b0 con 0x7efdd40b5ce0 2023-05-21T16:54:46.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdca7fc700 1 -- 172.21.15.46:0/1658413167 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdd0055f80 con 0x7efdd40b5ce0 2023-05-21T16:54:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:46.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efdb80662f0 msgr2=0x7efdb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efdb80662f0 0x7efdb80687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdc4005930 tx=0x7efdc4009040 comp rx=0 tx=0).stop 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 msgr2=0x7efdd4160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd4160260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efdd40b55f0 tx=0x7efdd0004770 comp rx=0 tx=0).stop 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 shutdown_connections 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efdb80662f0 0x7efdb80687a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdd40b8ad0 0x7efdd415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd40b5ce0 0x7efdd4160260 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 --2- 172.21.15.46:0/1658413167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdd40b4910 0x7efdd415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 >> 172.21.15.46:0/1658413167 conn(0x7efdd40d3ae0 msgr2=0x7efdd40b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 shutdown_connections 2023-05-21T16:54:46.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:46.912+0000 7efdda897700 1 -- 172.21.15.46:0/1658413167 wait complete. 2023-05-21T16:54:46.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:47.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce6fce700 1 Processor -- start 2023-05-21T16:54:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce6fce700 1 -- start start 2023-05-21T16:54:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce6fce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce006a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce6fce700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00ade30 con 0x7f0ce0160be0 2023-05-21T16:54:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce6fce700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00cd210 con 0x7f0ce0070c50 2023-05-21T16:54:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce6fce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00cc970 con 0x7f0ce0069f80 2023-05-21T16:54:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce5fcc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0ce0160be0 0x7f0ce01651c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39508/0 (socket says 172.21.15.46:39508) 2023-05-21T16:54:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce5fcc700 1 -- 172.21.15.46:0/1273419280 learned_addr learned my addr 172.21.15.46:0/1273419280 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce57cb700 1 --2- 172.21.15.46:0/1273419280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce006a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce4fca700 1 -- 172.21.15.46:0/1273419280 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755286094 0 0) 0x7f0ce00ade30 con 0x7f0ce0160be0 2023-05-21T16:54:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce4fca700 1 -- 172.21.15.46:0/1273419280 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc0035d0 con 0x7f0ce0160be0 2023-05-21T16:54:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce57cb700 1 -- 172.21.15.46:0/1273419280 >> v1:172.21.15.142:6789/0 conn(0x7f0ce0070c50 legacy=0x7f0ce00c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce57cb700 1 -- 172.21.15.46:0/1273419280 >> v1:172.21.15.46:6789/0 conn(0x7f0ce0160be0 legacy=0x7f0ce01651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce57cb700 1 -- 172.21.15.46:0/1273419280 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00ccc50 con 0x7f0ce0069f80 2023-05-21T16:54:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.044+0000 7f0ce57cb700 1 --2- 172.21.15.46:0/1273419280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce006a3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009dc0 tx=0x7f0cdc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=817be38a5341b440 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce4fca700 1 -- 172.21.15.46:0/1273419280 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00e070 con 0x7f0ce0069f80 2023-05-21T16:54:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce4fca700 1 -- 172.21.15.46:0/1273419280 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00bb20 con 0x7f0ce0069f80 2023-05-21T16:54:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce4fca700 1 -- 172.21.15.46:0/1273419280 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00be90 con 0x7f0ce0069f80 2023-05-21T16:54:47.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 -- 172.21.15.46:0/1273419280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 msgr2=0x7f0ce006a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/1273419280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce006a3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009dc0 tx=0x7f0cdc00b330 comp rx=0 tx=0).stop 2023-05-21T16:54:47.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 -- 172.21.15.46:0/1273419280 shutdown_connections 2023-05-21T16:54:47.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/1273419280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce006a3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 -- 172.21.15.46:0/1273419280 >> 172.21.15.46:0/1273419280 conn(0x7f0ce00cf720 msgr2=0x7f0ce00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:47.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 -- 172.21.15.46:0/1273419280 shutdown_connections 2023-05-21T16:54:47.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.048+0000 7f0ce6fce700 1 -- 172.21.15.46:0/1273419280 wait complete. 2023-05-21T16:54:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 Processor -- start 2023-05-21T16:54:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 -- start start 2023-05-21T16:54:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce0162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce0070c50 0x7f0ce01512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 0x7f0ce00c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0162640 con 0x7f0ce0160be0 2023-05-21T16:54:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c5630 con 0x7f0ce0070c50 2023-05-21T16:54:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0151830 con 0x7f0ce0069f80 2023-05-21T16:54:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 0x7f0ce00c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 0x7f0ce00c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52684/0 (socket says 172.21.15.46:52684) 2023-05-21T16:54:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 -- 172.21.15.46:0/3881488909 learned_addr learned my addr 172.21.15.46:0/3881488909 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce5fcc700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce0162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce57cb700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce0070c50 0x7f0ce01512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 -- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 msgr2=0x7f0ce0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce0162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 -- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce0070c50 msgr2=0x7f0ce01512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce0070c50 0x7f0ce01512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 -- 172.21.15.46:0/3881488909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009a70 con 0x7f0ce0160be0 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce5fcc700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce67cd700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 0x7f0ce00c2e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c4d0 tx=0x7f0cd800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80052d0 con 0x7f0ce0160be0 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8005430 con 0x7f0ce0160be0 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce0070730 con 0x7f0ce0160be0 2023-05-21T16:54:47.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80055a0 con 0x7f0ce0160be0 2023-05-21T16:54:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.052+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce00ccf30 con 0x7f0ce0160be0 2023-05-21T16:54:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.056+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00ae1a0 con 0x7f0ce0160be0 2023-05-21T16:54:47.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.056+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cd80036a0 con 0x7f0ce0160be0 2023-05-21T16:54:47.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.056+0000 7f0cd67fc700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0cc4066320 0x7f0cc40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.056+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cd8082f10 con 0x7f0ce0160be0 2023-05-21T16:54:47.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.056+0000 7f0ce5fcc700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0cc4066320 0x7f0cc40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.060+0000 7f0ce5fcc700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0cc4066320 0x7f0cc40687d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00011e0 tx=0x7f0cd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.064+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0cd8050420 con 0x7f0ce0160be0 2023-05-21T16:54:47.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.228+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ce00cc5d0 con 0x7f0ce0160be0 2023-05-21T16:54:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.232+0000 7f0cd67fc700 1 -- 172.21.15.46:0/3881488909 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f0cd8053a40 con 0x7f0ce0160be0 2023-05-21T16:54:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:47.239 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0cc4066320 msgr2=0x7f0cc40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0cc4066320 0x7f0cc40687d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00011e0 tx=0x7f0cd0009040 comp rx=0 tx=0).stop 2023-05-21T16:54:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 msgr2=0x7f0ce00c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 0x7f0ce00c2e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c4d0 tx=0x7f0cd800c890 comp rx=0 tx=0).stop 2023-05-21T16:54:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 shutdown_connections 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0cc4066320 0x7f0cc40687d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce0160be0 0x7f0ce00c2e90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce0070c50 0x7f0ce01512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 --2- 172.21.15.46:0/3881488909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ce0069f80 0x7f0ce0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 >> 172.21.15.46:0/3881488909 conn(0x7f0ce00cf720 msgr2=0x7f0ce015f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 shutdown_connections 2023-05-21T16:54:47.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.236+0000 7f0ce6fce700 1 -- 172.21.15.46:0/3881488909 wait complete. 2023-05-21T16:54:47.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:47.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:47.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a58844700 1 Processor -- start 2023-05-21T16:54:47.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a58844700 1 -- start start 2023-05-21T16:54:47.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a58844700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2a54158d90 0x7f2a5415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a58844700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a54159df0 con 0x7f2a54070ca0 2023-05-21T16:54:47.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a58844700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540cd730 con 0x7f2a540ccec0 2023-05-21T16:54:47.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a58844700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5415a280 con 0x7f2a54158d90 2023-05-21T16:54:47.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a52d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2a54158d90 0x7f2a5415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a5359e700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2a54070ca0 0x7f2a540ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39512/0 (socket says 172.21.15.46:39512) 2023-05-21T16:54:47.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a5359e700 1 -- 172.21.15.46:0/1907560913 learned_addr learned my addr 172.21.15.46:0/1907560913 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:47.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a52d9d700 1 -- 172.21.15.46:0/1907560913 >> v1:172.21.15.142:6789/0 conn(0x7f2a540ccec0 legacy=0x7f2a54070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a52d9d700 1 -- 172.21.15.46:0/1907560913 >> v1:172.21.15.46:6789/0 conn(0x7f2a54070ca0 legacy=0x7f2a540ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a51d9b700 1 -- 172.21.15.46:0/1907560913 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269485106 0 0) 0x7f2a540cd730 con 0x7f2a540ccec0 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a52d9d700 1 -- 172.21.15.46:0/1907560913 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a541594c0 con 0x7f2a54158d90 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.372+0000 7f2a52d9d700 1 --2- 172.21.15.46:0/1907560913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54158d90 0x7f2a5415d460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00a9f0 tx=0x7f2a3c00ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eab624e90d938f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a51d9b700 1 -- 172.21.15.46:0/1907560913 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c004230 con 0x7f2a54158d90 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a51d9b700 1 -- 172.21.15.46:0/1907560913 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c004390 con 0x7f2a54158d90 2023-05-21T16:54:47.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a51d9b700 1 -- 172.21.15.46:0/1907560913 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00c870 con 0x7f2a54158d90 2023-05-21T16:54:47.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 -- 172.21.15.46:0/1907560913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54158d90 msgr2=0x7f2a5415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 --2- 172.21.15.46:0/1907560913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54158d90 0x7f2a5415d460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00a9f0 tx=0x7f2a3c00ad00 comp rx=0 tx=0).stop 2023-05-21T16:54:47.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 -- 172.21.15.46:0/1907560913 shutdown_connections 2023-05-21T16:54:47.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 --2- 172.21.15.46:0/1907560913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54158d90 0x7f2a5415d460 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 -- 172.21.15.46:0/1907560913 >> 172.21.15.46:0/1907560913 conn(0x7f2a540cf720 msgr2=0x7f2a540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:47.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 -- 172.21.15.46:0/1907560913 shutdown_connections 2023-05-21T16:54:47.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 -- 172.21.15.46:0/1907560913 wait complete. 2023-05-21T16:54:47.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 Processor -- start 2023-05-21T16:54:47.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.376+0000 7f2a58844700 1 -- start start 2023-05-21T16:54:47.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 0x7f2a540c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a540ccec0 0x7f2a540cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a54158d90 0x7f2a5414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c2660 con 0x7f2a54070ca0 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c2940 con 0x7f2a54158d90 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c2c20 con 0x7f2a540ccec0 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 0x7f2a540c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 0x7f2a540c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52704/0 (socket says 172.21.15.46:52704) 2023-05-21T16:54:47.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 -- 172.21.15.46:0/2066648509 learned_addr learned my addr 172.21.15.46:0/2066648509 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a5359e700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a54158d90 0x7f2a5414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a5259c700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a540ccec0 0x7f2a540cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 -- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a540ccec0 msgr2=0x7f2a540cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a540ccec0 0x7f2a540cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 -- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a54158d90 msgr2=0x7f2a5414bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a54158d90 0x7f2a5414bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 -- 172.21.15.46:0/2066648509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c00a650 con 0x7f2a54070ca0 2023-05-21T16:54:47.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a5359e700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a54158d90 0x7f2a5414bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:47.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a52d9d700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 0x7f2a540c3700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00a1c0 tx=0x7f2a3c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c01e070 con 0x7f2a54070ca0 2023-05-21T16:54:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c003990 con 0x7f2a54070ca0 2023-05-21T16:54:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a54159a80 con 0x7f2a54070ca0 2023-05-21T16:54:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c003d40 con 0x7f2a54070ca0 2023-05-21T16:54:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a541597a0 con 0x7f2a54070ca0 2023-05-21T16:54:47.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.380+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54159160 con 0x7f2a54070ca0 2023-05-21T16:54:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.384+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a3c0183f0 con 0x7f2a54070ca0 2023-05-21T16:54:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.384+0000 7f2a4b7fe700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2a340662f0 0x7f2a340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.384+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a3c085150 con 0x7f2a54070ca0 2023-05-21T16:54:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.384+0000 7f2a5259c700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2a340662f0 0x7f2a340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.384+0000 7f2a5259c700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2a340662f0 0x7f2a340687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a540c3d40 tx=0x7f2a44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.392+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2a3c052660 con 0x7f2a54070ca0 2023-05-21T16:54:47.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a540733b0 con 0x7f2a54070ca0 2023-05-21T16:54:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a4b7fe700 1 -- 172.21.15.46:0/2066648509 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a3c055c80 con 0x7f2a54070ca0 2023-05-21T16:54:47.561 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2a340662f0 msgr2=0x7f2a340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2a340662f0 0x7f2a340687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a540c3d40 tx=0x7f2a44009040 comp rx=0 tx=0).stop 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 msgr2=0x7f2a540c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 0x7f2a540c3700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00a1c0 tx=0x7f2a3c0047e0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 shutdown_connections 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2a340662f0 0x7f2a340687a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a54158d90 0x7f2a5414bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a540ccec0 0x7f2a540cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 --2- 172.21.15.46:0/2066648509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a54070ca0 0x7f2a540c3700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 >> 172.21.15.46:0/2066648509 conn(0x7f2a540cf720 msgr2=0x7f2a5406d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 shutdown_connections 2023-05-21T16:54:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.556+0000 7f2a58844700 1 -- 172.21.15.46:0/2066648509 wait complete. 2023-05-21T16:54:47.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc162ce2700 1 Processor -- start 2023-05-21T16:54:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc162ce2700 1 -- start start 2023-05-21T16:54:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc162ce2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc15c160ea0 0x7fc15c0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc162ce2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15c069f80 con 0x7fc15c161280 2023-05-21T16:54:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc162ce2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15c0c2450 con 0x7fc15c070800 2023-05-21T16:54:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc162ce2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c1617f0 con 0x7fc15c160ea0 2023-05-21T16:54:47.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc160a7e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc15c160ea0 0x7fc15c0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc160a7e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc15c160ea0 0x7fc15c0ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52720/0 (socket says 172.21.15.46:52720) 2023-05-21T16:54:47.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc160a7e700 1 -- 172.21.15.46:0/891783160 learned_addr learned my addr 172.21.15.46:0/891783160 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:47.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc160a7e700 1 -- 172.21.15.46:0/891783160 >> v1:172.21.15.142:6789/0 conn(0x7fc15c070800 legacy=0x7fc15c070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc160a7e700 1 -- 172.21.15.46:0/891783160 >> v1:172.21.15.46:6789/0 conn(0x7fc15c161280 legacy=0x7fc15c0c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.692+0000 7fc160a7e700 1 -- 172.21.15.46:0/891783160 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c161ad0 con 0x7fc15c160ea0 2023-05-21T16:54:47.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc160a7e700 1 --2- 172.21.15.46:0/891783160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c160ea0 0x7fc15c0ccc80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc154009e50 tx=0x7fc15400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76136f561398f238 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc15b7fe700 1 -- 172.21.15.46:0/891783160 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e070 con 0x7fc15c160ea0 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc15b7fe700 1 -- 172.21.15.46:0/891783160 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400b9c0 con 0x7fc15c160ea0 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc15b7fe700 1 -- 172.21.15.46:0/891783160 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400bd70 con 0x7fc15c160ea0 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 -- 172.21.15.46:0/891783160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c160ea0 msgr2=0x7fc15c0ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 --2- 172.21.15.46:0/891783160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c160ea0 0x7fc15c0ccc80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc154009e50 tx=0x7fc15400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 -- 172.21.15.46:0/891783160 shutdown_connections 2023-05-21T16:54:47.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 --2- 172.21.15.46:0/891783160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c160ea0 0x7fc15c0ccc80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 -- 172.21.15.46:0/891783160 >> 172.21.15.46:0/891783160 conn(0x7fc15c0ceba0 msgr2=0x7fc15c0cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 -- 172.21.15.46:0/891783160 shutdown_connections 2023-05-21T16:54:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 -- 172.21.15.46:0/891783160 wait complete. 2023-05-21T16:54:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 Processor -- start 2023-05-21T16:54:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.696+0000 7fc162ce2700 1 -- start start 2023-05-21T16:54:47.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15c070800 0x7fc15c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 0x7fc15c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15c0c6cc0 0x7fc15c142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c0c7230 con 0x7fc15c161280 2023-05-21T16:54:47.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c0c7510 con 0x7fc15c070800 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c0c77f0 con 0x7fc15c0c6cc0 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 0x7fc15c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 0x7fc15c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52734/0 (socket says 172.21.15.46:52734) 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 -- 172.21.15.46:0/3068097496 learned_addr learned my addr 172.21.15.46:0/3068097496 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc160a7e700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15c070800 0x7fc15c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc16127f700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15c0c6cc0 0x7fc15c142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 -- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15c0c6cc0 msgr2=0x7fc15c142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15c0c6cc0 0x7fc15c142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 -- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15c070800 msgr2=0x7fc15c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15c070800 0x7fc15c15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 -- 172.21.15.46:0/3068097496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009b30 con 0x7fc15c161280 2023-05-21T16:54:47.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc16127f700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15c0c6cc0 0x7fc15c142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:47.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc15bfff700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 0x7fc15c15d5c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c500 tx=0x7fc15000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1500052d0 con 0x7fc15c161280 2023-05-21T16:54:47.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc150005430 con 0x7fc15c161280 2023-05-21T16:54:47.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1500055a0 con 0x7fc15c161280 2023-05-21T16:54:47.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c162090 con 0x7fc15c161280 2023-05-21T16:54:47.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c161db0 con 0x7fc15c161280 2023-05-21T16:54:47.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.700+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15c0cd1c0 con 0x7fc15c161280 2023-05-21T16:54:47.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.704+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1500038e0 con 0x7fc15c161280 2023-05-21T16:54:47.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.704+0000 7fc1597fa700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc1480662f0 0x7fc1480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:47.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.704+0000 7fc160a7e700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc1480662f0 0x7fc1480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.704+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1500830a0 con 0x7fc15c161280 2023-05-21T16:54:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.704+0000 7fc160a7e700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc1480662f0 0x7fc1480687a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc15400b370 tx=0x7fc154009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:47.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.708+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc1500505b0 con 0x7fc15c161280 2023-05-21T16:54:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.868+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc15c074200 con 0x7fc15c161280 2023-05-21T16:54:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.868+0000 7fc1597fa700 1 -- 172.21.15.46:0/3068097496 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc150053bd0 con 0x7fc15c161280 2023-05-21T16:54:47.875 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:47.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc1480662f0 msgr2=0x7fc1480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc1480662f0 0x7fc1480687a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc15400b370 tx=0x7fc154009000 comp rx=0 tx=0).stop 2023-05-21T16:54:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 msgr2=0x7fc15c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 0x7fc15c15d5c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c500 tx=0x7fc15000c810 comp rx=0 tx=0).stop 2023-05-21T16:54:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 shutdown_connections 2023-05-21T16:54:47.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc1480662f0 0x7fc1480687a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc15c0c6cc0 0x7fc15c142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc15c161280 0x7fc15c15d5c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 --2- 172.21.15.46:0/3068097496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc15c070800 0x7fc15c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:47.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 >> 172.21.15.46:0/3068097496 conn(0x7fc15c0ceba0 msgr2=0x7fc15c0c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:47.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 shutdown_connections 2023-05-21T16:54:47.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:47.872+0000 7fc162ce2700 1 -- 172.21.15.46:0/3068097496 wait complete. 2023-05-21T16:54:47.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:48.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f1474fd3700 1 Processor -- start 2023-05-21T16:54:48.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f1474fd3700 1 -- start start 2023-05-21T16:54:48.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f1474fd3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 0x7f147015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f1474fd3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147015efe0 con 0x7f1470070800 2023-05-21T16:54:48.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f1474fd3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147015a9a0 con 0x7f14700b19f0 2023-05-21T16:54:48.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f1474fd3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147015e740 con 0x7f14700b4910 2023-05-21T16:54:48.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 0x7f147015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146ed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1470070800 0x7f14700c9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39530/0 (socket says 172.21.15.46:39530) 2023-05-21T16:54:48.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146ed9d700 1 -- 172.21.15.46:0/119751226 learned_addr learned my addr 172.21.15.46:0/119751226 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:48.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 0x7f147015e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:54550/0 (socket says 172.21.15.46:54550) 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146d59a700 1 -- 172.21.15.46:0/119751226 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195121976 0 0) 0x7f147015efe0 con 0x7f1470070800 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146d59a700 1 -- 172.21.15.46:0/119751226 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14580035d0 con 0x7f1470070800 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146e59c700 1 -- 172.21.15.46:0/119751226 >> v1:172.21.15.142:6789/0 conn(0x7f14700b19f0 legacy=0x7f14700ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146e59c700 1 -- 172.21.15.46:0/119751226 >> v1:172.21.15.46:6789/0 conn(0x7f1470070800 legacy=0x7f14700c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146e59c700 1 -- 172.21.15.46:0/119751226 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015ea20 con 0x7f14700b4910 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146e59c700 1 --2- 172.21.15.46:0/119751226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 0x7f147015e0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1460009880 tx=0x7f1460009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc43006f54a38a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146d59a700 1 -- 172.21.15.46:0/119751226 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460011830 con 0x7f14700b4910 2023-05-21T16:54:48.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146d59a700 1 -- 172.21.15.46:0/119751226 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460011990 con 0x7f14700b4910 2023-05-21T16:54:48.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.008+0000 7f146d59a700 1 -- 172.21.15.46:0/119751226 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460011d20 con 0x7f14700b4910 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 -- 172.21.15.46:0/119751226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 msgr2=0x7f147015e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 --2- 172.21.15.46:0/119751226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 0x7f147015e0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1460009880 tx=0x7f1460009b90 comp rx=0 tx=0).stop 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 -- 172.21.15.46:0/119751226 shutdown_connections 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 --2- 172.21.15.46:0/119751226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b4910 0x7f147015e0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 -- 172.21.15.46:0/119751226 >> 172.21.15.46:0/119751226 conn(0x7f14700ceba0 msgr2=0x7f14700cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 -- 172.21.15.46:0/119751226 shutdown_connections 2023-05-21T16:54:48.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 -- 172.21.15.46:0/119751226 wait complete. 2023-05-21T16:54:48.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 Processor -- start 2023-05-21T16:54:48.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.012+0000 7f1474fd3700 1 -- start start 2023-05-21T16:54:48.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 0x7f147014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b19f0 0x7f14701549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14700b4910 0x7f1470154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147014fc00 con 0x7f14700b4910 2023-05-21T16:54:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147015c9d0 con 0x7f1470070800 2023-05-21T16:54:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147015ccb0 con 0x7f14700b19f0 2023-05-21T16:54:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14700b4910 0x7f1470154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 0x7f147014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 0x7f147014f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:33336/0 (socket says 172.21.15.46:33336) 2023-05-21T16:54:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146e59c700 1 -- 172.21.15.46:0/1894319069 learned_addr learned my addr 172.21.15.46:0/1894319069 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146dd9b700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b19f0 0x7f14701549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 -- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b19f0 msgr2=0x7f14701549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b19f0 0x7f14701549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 -- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 msgr2=0x7f147014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 0x7f147014f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 -- 172.21.15.46:0/1894319069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600094b0 con 0x7f14700b4910 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146e59c700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 0x7f147014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:48.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f146ed9d700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14700b4910 0x7f1470154f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f146800ca80 tx=0x7f146800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468007480 con 0x7f14700b4910 2023-05-21T16:54:48.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14680075e0 con 0x7f14700b4910 2023-05-21T16:54:48.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700c95c0 con 0x7f14700b4910 2023-05-21T16:54:48.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468007950 con 0x7f14700b4910 2023-05-21T16:54:48.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147015ed00 con 0x7f14700b4910 2023-05-21T16:54:48.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.016+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1470070c50 con 0x7f14700b4910 2023-05-21T16:54:48.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.020+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f146801b3b0 con 0x7f14700b4910 2023-05-21T16:54:48.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.020+0000 7f145effd700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14500662f0 0x7f14500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.020+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1468083600 con 0x7f14700b4910 2023-05-21T16:54:48.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.020+0000 7f146e59c700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14500662f0 0x7f14500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.020+0000 7f146e59c700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14500662f0 0x7f14500687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1460000c00 tx=0x7f1460010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.028+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f14680544a0 con 0x7f14700b4910 2023-05-21T16:54:48.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.188+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1470074200 con 0x7f14700b4910 2023-05-21T16:54:48.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.188+0000 7f145effd700 1 -- 172.21.15.46:0/1894319069 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1468054030 con 0x7f14700b4910 2023-05-21T16:54:48.196 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:48.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14500662f0 msgr2=0x7f14500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14500662f0 0x7f14500687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1460000c00 tx=0x7f1460010000 comp rx=0 tx=0).stop 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14700b4910 msgr2=0x7f1470154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14700b4910 0x7f1470154f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f146800ca80 tx=0x7f146800cab0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 shutdown_connections 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14500662f0 0x7f14500687a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14700b4910 0x7f1470154f00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14700b19f0 0x7f14701549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 --2- 172.21.15.46:0/1894319069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1470070800 0x7f147014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 >> 172.21.15.46:0/1894319069 conn(0x7f14700ceba0 msgr2=0x7f14700c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:48.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 shutdown_connections 2023-05-21T16:54:48.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.192+0000 7f1474fd3700 1 -- 172.21.15.46:0/1894319069 wait complete. 2023-05-21T16:54:48.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 Processor -- start 2023-05-21T16:54:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 -- start start 2023-05-21T16:54:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f843c06c760 0x7f843c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f843c15dbb0 0x7f843c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c06b9d0 con 0x7f843c069f80 2023-05-21T16:54:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c06b450 con 0x7f843c15dbb0 2023-05-21T16:54:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c159a90 con 0x7f843c06c760 2023-05-21T16:54:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f843c15dbb0 0x7f843c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f843c069f80 0x7f843c06a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39534/0 (socket says 172.21.15.46:39534) 2023-05-21T16:54:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843b7fe700 1 -- 172.21.15.46:0/724702688 learned_addr learned my addr 172.21.15.46:0/724702688 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843affd700 1 --2- 172.21.15.46:0/724702688 >> v2:172.21.15.142:3300/0 conn(0x7f843c06c760 0x7f843c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843a7fc700 1 -- 172.21.15.46:0/724702688 >> v2:172.21.15.142:3300/0 conn(0x7f843c06c760 msgr2=0x7f843c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843a7fc700 1 --2- 172.21.15.46:0/724702688 >> v2:172.21.15.142:3300/0 conn(0x7f843c06c760 0x7f843c15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843a7fc700 1 -- 172.21.15.46:0/724702688 >> v1:172.21.15.46:6789/0 conn(0x7f843c069f80 legacy=0x7f843c06a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843a7fc700 1 -- 172.21.15.46:0/724702688 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c06d070 con 0x7f843c15dbb0 2023-05-21T16:54:48.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f843a7fc700 1 --2- 172.21.15.46:0/724702688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c06cb30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f843c06c3c0 tx=0x7f842c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d58d780b21a390 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f8439ffb700 1 -- 172.21.15.46:0/724702688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c011830 con 0x7f843c15dbb0 2023-05-21T16:54:48.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f8439ffb700 1 -- 172.21.15.46:0/724702688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c011990 con 0x7f843c15dbb0 2023-05-21T16:54:48.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.328+0000 7f8439ffb700 1 -- 172.21.15.46:0/724702688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c011d20 con 0x7f843c15dbb0 2023-05-21T16:54:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 -- 172.21.15.46:0/724702688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 msgr2=0x7f843c06cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 --2- 172.21.15.46:0/724702688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c06cb30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f843c06c3c0 tx=0x7f842c009b30 comp rx=0 tx=0).stop 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 -- 172.21.15.46:0/724702688 shutdown_connections 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 --2- 172.21.15.46:0/724702688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c06cb30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 --2- 172.21.15.46:0/724702688 >> v2:172.21.15.142:3300/0 conn(0x7f843c06c760 0x7f843c15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 -- 172.21.15.46:0/724702688 >> 172.21.15.46:0/724702688 conn(0x7f843c0cf720 msgr2=0x7f843c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 -- 172.21.15.46:0/724702688 shutdown_connections 2023-05-21T16:54:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 -- 172.21.15.46:0/724702688 wait complete. 2023-05-21T16:54:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 Processor -- start 2023-05-21T16:54:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.332+0000 7f843bfff700 1 -- start start 2023-05-21T16:54:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f843c069f80 0x7f843c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f843c06c760 0x7f843c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0b1e20 con 0x7f843c15dbb0 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c2dd0 con 0x7f843c06c760 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0b2030 con 0x7f843c069f80 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52742/0 (socket says 172.21.15.46:52742) 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 -- 172.21.15.46:0/1134332451 learned_addr learned my addr 172.21.15.46:0/1134332451 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843affd700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f843c069f80 0x7f843c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843a7fc700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f843c06c760 0x7f843c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 -- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f843c069f80 msgr2=0x7f843c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f843c069f80 0x7f843c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 -- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f843c06c760 msgr2=0x7f843c0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f843c06c760 0x7f843c0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 -- 172.21.15.46:0/1134332451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0094b0 con 0x7f843c15dbb0 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843b7fe700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c150870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f843400cbc0 tx=0x7f843400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434007480 con 0x7f843c15dbb0 2023-05-21T16:54:48.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c159d50 con 0x7f843c15dbb0 2023-05-21T16:54:48.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84340075e0 con 0x7f843c15dbb0 2023-05-21T16:54:48.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c06b6f0 con 0x7f843c15dbb0 2023-05-21T16:54:48.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434007950 con 0x7f843c15dbb0 2023-05-21T16:54:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c15a030 con 0x7f843c15dbb0 2023-05-21T16:54:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.336+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8434012400 con 0x7f843c15dbb0 2023-05-21T16:54:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.340+0000 7f84337fe700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f841c0662f0 0x7f841c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.340+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8434083130 con 0x7f843c15dbb0 2023-05-21T16:54:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.340+0000 7f843affd700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f841c0662f0 0x7f841c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.340+0000 7f843affd700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f841c0662f0 0x7f841c0687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8424009bf0 tx=0x7f8424009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.344+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8434050670 con 0x7f843c15dbb0 2023-05-21T16:54:48.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.512+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f843c0733b0 con 0x7f843c15dbb0 2023-05-21T16:54:48.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f84337fe700 1 -- 172.21.15.46:0/1134332451 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8434053c90 con 0x7f843c15dbb0 2023-05-21T16:54:48.521 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f841c0662f0 msgr2=0x7f841c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f841c0662f0 0x7f841c0687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8424009bf0 tx=0x7f8424009240 comp rx=0 tx=0).stop 2023-05-21T16:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 msgr2=0x7f843c150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c150870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f843400cbc0 tx=0x7f843400cbf0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 shutdown_connections 2023-05-21T16:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f841c0662f0 0x7f841c0687a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f843c15dbb0 0x7f843c150870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f843c06c760 0x7f843c0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 --2- 172.21.15.46:0/1134332451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f843c069f80 0x7f843c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 >> 172.21.15.46:0/1134332451 conn(0x7f843c0cf720 msgr2=0x7f843c0abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:48.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 shutdown_connections 2023-05-21T16:54:48.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.516+0000 7f843bfff700 1 -- 172.21.15.46:0/1134332451 wait complete. 2023-05-21T16:54:48.570 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-21T16:54:48.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-21T16:54:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 Processor -- start 2023-05-21T16:54:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 -- start start 2023-05-21T16:54:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c06c760 0x7f318c0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f318c15e210 0x7f318c15e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c15aea0 con 0x7f318c154de0 2023-05-21T16:54:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c15ac20 con 0x7f318c15e210 2023-05-21T16:54:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c06cbd0 con 0x7f318c06c760 2023-05-21T16:54:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f318c154de0 0x7f318c15b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39550/0 (socket says 172.21.15.46:39550) 2023-05-21T16:54:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318affd700 1 -- 172.21.15.46:0/4241949719 learned_addr learned my addr 172.21.15.46:0/4241949719 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f3183fff700 1 --2- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c06c760 0x7f318c0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.688+0000 7f318b7fe700 1 --2- 172.21.15.46:0/4241949719 >> v2:172.21.15.142:3300/0 conn(0x7f318c15e210 0x7f318c15e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318a7fc700 1 -- 172.21.15.46:0/4241949719 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353139577 0 0) 0x7f318c15aea0 con 0x7f318c154de0 2023-05-21T16:54:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318a7fc700 1 -- 172.21.15.46:0/4241949719 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31780035d0 con 0x7f318c154de0 2023-05-21T16:54:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318b7fe700 1 -- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c06c760 msgr2=0x7f318c0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318b7fe700 1 --2- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c06c760 0x7f318c0caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318b7fe700 1 -- 172.21.15.46:0/4241949719 >> v1:172.21.15.46:6789/0 conn(0x7f318c154de0 legacy=0x7f318c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318b7fe700 1 -- 172.21.15.46:0/4241949719 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c071790 con 0x7f318c15e210 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318b7fe700 1 --2- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c15e210 0x7f318c15e650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3184009d90 tx=0x7f318400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd8fc8dbff8cc03 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318a7fc700 1 -- 172.21.15.46:0/4241949719 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400e070 con 0x7f318c15e210 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318a7fc700 1 -- 172.21.15.46:0/4241949719 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318400bb20 con 0x7f318c15e210 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318a7fc700 1 -- 172.21.15.46:0/4241949719 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184012430 con 0x7f318c15e210 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 -- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c15e210 msgr2=0x7f318c15e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c15e210 0x7f318c15e650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3184009d90 tx=0x7f318400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:48.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 -- 172.21.15.46:0/4241949719 shutdown_connections 2023-05-21T16:54:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c15e210 0x7f318c15e650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/4241949719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c06c760 0x7f318c0caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 -- 172.21.15.46:0/4241949719 >> 172.21.15.46:0/4241949719 conn(0x7f318c0cf720 msgr2=0x7f318c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 -- 172.21.15.46:0/4241949719 shutdown_connections 2023-05-21T16:54:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 -- 172.21.15.46:0/4241949719 wait complete. 2023-05-21T16:54:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 Processor -- start 2023-05-21T16:54:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.692+0000 7f318bfff700 1 -- start start 2023-05-21T16:54:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 0x7f318c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c154de0 0x7f318c0af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c15e210 0x7f318c1e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b13e0 con 0x7f318c06c760 2023-05-21T16:54:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b0340 con 0x7f318c154de0 2023-05-21T16:54:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b0620 con 0x7f318c15e210 2023-05-21T16:54:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 0x7f318c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 0x7f318c0b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52754/0 (socket says 172.21.15.46:52754) 2023-05-21T16:54:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 -- 172.21.15.46:0/2443201547 learned_addr learned my addr 172.21.15.46:0/2443201547 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318b7fe700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c15e210 0x7f318c1e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f3183fff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c154de0 0x7f318c0af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 -- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c15e210 msgr2=0x7f318c1e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c15e210 0x7f318c1e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 -- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c154de0 msgr2=0x7f318c0af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c154de0 0x7f318c0af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 -- 172.21.15.46:0/2443201547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009a70 con 0x7f318c06c760 2023-05-21T16:54:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318affd700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 0x7f318c0b3c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c700 tx=0x7f317c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c005d90 con 0x7f318c06c760 2023-05-21T16:54:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c0070d0 con 0x7f318c06c760 2023-05-21T16:54:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c06d0b0 con 0x7f318c06c760 2023-05-21T16:54:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c007480 con 0x7f318c06c760 2023-05-21T16:54:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c06cdd0 con 0x7f318c06c760 2023-05-21T16:54:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.696+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c06d390 con 0x7f318c06c760 2023-05-21T16:54:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.700+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f317c0075e0 con 0x7f318c06c760 2023-05-21T16:54:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.700+0000 7f31837fe700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f316c066320 0x7f316c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.700+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f317c0831c0 con 0x7f318c06c760 2023-05-21T16:54:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.700+0000 7f3183fff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f316c066320 0x7f316c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.700+0000 7f3183fff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f316c066320 0x7f316c0687d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f318c0af780 tx=0x7f3174009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.708+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f317c0505c0 con 0x7f318c06c760 2023-05-21T16:54:48.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:48.932+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f318c0733b0 con 0x7f318c06c760 2023-05-21T16:54:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.688+0000 7f31837fe700 1 -- 172.21.15.46:0/2443201547 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v53) v1 ==== 147+0+0 (secure 0 0 0) 0x7f317c053be0 con 0x7f318c06c760 2023-05-21T16:54:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f316c066320 msgr2=0x7f316c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f316c066320 0x7f316c0687d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f318c0af780 tx=0x7f3174009240 comp rx=0 tx=0).stop 2023-05-21T16:54:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 msgr2=0x7f318c0b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 0x7f318c0b3c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c700 tx=0x7f317c00ca10 comp rx=0 tx=0).stop 2023-05-21T16:54:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 shutdown_connections 2023-05-21T16:54:49.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f316c066320 0x7f316c0687d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f318c15e210 0x7f318c1e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f318c154de0 0x7f318c0af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 --2- 172.21.15.46:0/2443201547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c06c760 0x7f318c0b3c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 >> 172.21.15.46:0/2443201547 conn(0x7f318c0cf720 msgr2=0x7f318c15d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 shutdown_connections 2023-05-21T16:54:49.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.692+0000 7f318bfff700 1 -- 172.21.15.46:0/2443201547 wait complete. 2023-05-21T16:54:49.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-21T16:54:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.876+0000 7f6242761700 1 Processor -- start 2023-05-21T16:54:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.876+0000 7f6242761700 1 -- start start 2023-05-21T16:54:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f623c0b5ce0 0x7f623c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c0b8ea0 con 0x7f623c0b4910 2023-05-21T16:54:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c0d09d0 con 0x7f623c0b5ce0 2023-05-21T16:54:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c0d0cb0 con 0x7f623c0b8ad0 2023-05-21T16:54:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6240f5e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f623c0b5ce0 0x7f623c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6241f60700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f623c0b4910 0x7f623c1601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39554/0 (socket says 172.21.15.46:39554) 2023-05-21T16:54:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6241f60700 1 -- 172.21.15.46:0/2882128570 learned_addr learned my addr 172.21.15.46:0/2882128570 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f624175f700 1 --2- 172.21.15.46:0/2882128570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6240f5e700 1 -- 172.21.15.46:0/2882128570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 msgr2=0x7f623c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6240f5e700 1 --2- 172.21.15.46:0/2882128570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6233fff700 1 -- 172.21.15.46:0/2882128570 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261090611 0 0) 0x7f623c0b8ea0 con 0x7f623c0b4910 2023-05-21T16:54:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6240f5e700 1 -- 172.21.15.46:0/2882128570 >> v1:172.21.15.46:6789/0 conn(0x7f623c0b4910 legacy=0x7f623c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6240f5e700 1 -- 172.21.15.46:0/2882128570 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0cd4f0 con 0x7f623c0b5ce0 2023-05-21T16:54:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6240f5e700 1 --2- 172.21.15.46:0/2882128570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b5ce0 0x7f623c06a990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f622c009850 tx=0x7f622c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b48962f287359 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6233fff700 1 -- 172.21.15.46:0/2882128570 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011830 con 0x7f623c0b5ce0 2023-05-21T16:54:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6233fff700 1 -- 172.21.15.46:0/2882128570 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c011990 con 0x7f623c0b5ce0 2023-05-21T16:54:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6233fff700 1 -- 172.21.15.46:0/2882128570 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011d40 con 0x7f623c0b5ce0 2023-05-21T16:54:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- 172.21.15.46:0/2882128570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b5ce0 msgr2=0x7f623c06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 --2- 172.21.15.46:0/2882128570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b5ce0 0x7f623c06a990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f622c009850 tx=0x7f622c009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- 172.21.15.46:0/2882128570 shutdown_connections 2023-05-21T16:54:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 --2- 172.21.15.46:0/2882128570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b5ce0 0x7f623c06a990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 --2- 172.21.15.46:0/2882128570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- 172.21.15.46:0/2882128570 >> 172.21.15.46:0/2882128570 conn(0x7f623c0d3ae0 msgr2=0x7f623c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- 172.21.15.46:0/2882128570 shutdown_connections 2023-05-21T16:54:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.880+0000 7f6242761700 1 -- 172.21.15.46:0/2882128570 wait complete. 2023-05-21T16:54:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 Processor -- start 2023-05-21T16:54:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 -- start start 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b4910 0x7f623c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f623c0b5ce0 0x7f623c0aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c15d910 con 0x7f623c0b4910 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c15dbf0 con 0x7f623c0b5ce0 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6242761700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c15e610 con 0x7f623c0b8ad0 2023-05-21T16:54:49.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f624175f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b4910 0x7f623c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f624175f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b4910 0x7f623c15a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52766/0 (socket says 172.21.15.46:52766) 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f624175f700 1 -- 172.21.15.46:0/3120558149 learned_addr learned my addr 172.21.15.46:0/3120558149 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6241f60700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.884+0000 7f6240f5e700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f623c0b5ce0 0x7f623c0aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6241f60700 1 -- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f623c0b5ce0 msgr2=0x7f623c0aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6241f60700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f623c0b5ce0 0x7f623c0aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6241f60700 1 -- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b4910 msgr2=0x7f623c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6241f60700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b4910 0x7f623c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6241f60700 1 -- 172.21.15.46:0/3120558149 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0094b0 con 0x7f623c0b8ad0 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6241f60700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0aa6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f623400caf0 tx=0x7f623400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400a9e0 con 0x7f623c0b8ad0 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400ab60 con 0x7f623c0b8ad0 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c0cda70 con 0x7f623c0b8ad0 2023-05-21T16:54:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340070d0 con 0x7f623c0b8ad0 2023-05-21T16:54:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c0cd790 con 0x7f623c0b8ad0 2023-05-21T16:54:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c06aed0 con 0x7f623c0b8ad0 2023-05-21T16:54:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6234007230 con 0x7f623c0b8ad0 2023-05-21T16:54:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.888+0000 7f6231ffb700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f62200662f0 0x7f62200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.892+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6234083850 con 0x7f623c0b8ad0 2023-05-21T16:54:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.892+0000 7f624175f700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f62200662f0 0x7f62200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.892+0000 7f624175f700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f62200662f0 0x7f62200687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f623c0b8000 tx=0x7f6238009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:49.896+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6234050d60 con 0x7f623c0b8ad0 2023-05-21T16:54:50.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.068+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f623c0733b0 con 0x7f623c0b8ad0 2023-05-21T16:54:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6231ffb700 1 -- 172.21.15.46:0/3120558149 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6234018020 con 0x7f623c0b8ad0 2023-05-21T16:54:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f62200662f0 msgr2=0x7f62200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f62200662f0 0x7f62200687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f623c0b8000 tx=0x7f6238009240 comp rx=0 tx=0).stop 2023-05-21T16:54:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 msgr2=0x7f623c0aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0aa6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f623400caf0 tx=0x7f623400ce00 comp rx=0 tx=0).stop 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 shutdown_connections 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f62200662f0 0x7f62200687a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f623c0b8ad0 0x7f623c0aa6f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f623c0b5ce0 0x7f623c0aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 --2- 172.21.15.46:0/3120558149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f623c0b4910 0x7f623c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 >> 172.21.15.46:0/3120558149 conn(0x7f623c0d3ae0 msgr2=0x7f623c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:50.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 shutdown_connections 2023-05-21T16:54:50.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.080+0000 7f6242761700 1 -- 172.21.15.46:0/3120558149 wait complete. 2023-05-21T16:54:50.102 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-21T16:54:50.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-21T16:54:50.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-21T16:54:50.139 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-21T16:54:50.140 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:54:50.140 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:50.176 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:54:50.176 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:50.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 Processor -- start 2023-05-21T16:54:50.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 -- start start 2023-05-21T16:54:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f4570160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f457015d370 0x7f457015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700ceb20 con 0x7f45700d0640 2023-05-21T16:54:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4570161320 con 0x7f457015d370 2023-05-21T16:54:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457015dd30 con 0x7f457015a4f0 2023-05-21T16:54:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f457015d370 0x7f457015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f457015d370 0x7f457015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52776/0 (socket says 172.21.15.46:52776) 2023-05-21T16:54:50.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 -- 172.21.15.46:0/3325358304 learned_addr learned my addr 172.21.15.46:0/3325358304 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:50.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575175700 1 --2- 172.21.15.46:0/3325358304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f4570160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 -- 172.21.15.46:0/3325358304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 msgr2=0x7f4570160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 --2- 172.21.15.46:0/3325358304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f4570160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 -- 172.21.15.46:0/3325358304 >> v1:172.21.15.142:6789/0 conn(0x7f45700d0640 legacy=0x7f45700cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 -- 172.21.15.46:0/3325358304 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700cee00 con 0x7f457015d370 2023-05-21T16:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4575976700 1 --2- 172.21.15.46:0/3325358304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f457015d7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f456c009910 tx=0x7f456c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6ddf728f1c3b33 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4567fff700 1 -- 172.21.15.46:0/3325358304 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c011830 con 0x7f457015d370 2023-05-21T16:54:50.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4567fff700 1 -- 172.21.15.46:0/3325358304 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c011990 con 0x7f457015d370 2023-05-21T16:54:50.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f4567fff700 1 -- 172.21.15.46:0/3325358304 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c011d40 con 0x7f457015d370 2023-05-21T16:54:50.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 -- 172.21.15.46:0/3325358304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 msgr2=0x7f457015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.280+0000 7f45773d9700 1 --2- 172.21.15.46:0/3325358304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f457015d7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f456c009910 tx=0x7f456c009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:50.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 -- 172.21.15.46:0/3325358304 shutdown_connections 2023-05-21T16:54:50.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 --2- 172.21.15.46:0/3325358304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f457015d7f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 --2- 172.21.15.46:0/3325358304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f4570160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 -- 172.21.15.46:0/3325358304 >> 172.21.15.46:0/3325358304 conn(0x7f457006fc60 msgr2=0x7f45700cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:50.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 -- 172.21.15.46:0/3325358304 shutdown_connections 2023-05-21T16:54:50.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 -- 172.21.15.46:0/3325358304 wait complete. 2023-05-21T16:54:50.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 Processor -- start 2023-05-21T16:54:50.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.284+0000 7f45773d9700 1 -- start start 2023-05-21T16:54:50.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45700d0640 0x7f45700c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f45700b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f45701574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700b1630 con 0x7f457015d370 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700c5170 con 0x7f45700d0640 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45700b6060 con 0x7f457015a4f0 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f45701574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f45701574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52782/0 (socket says 172.21.15.46:52782) 2023-05-21T16:54:50.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 -- 172.21.15.46:0/2998296724 learned_addr learned my addr 172.21.15.46:0/2998296724 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:50.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575175700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45700d0640 0x7f45700c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4574974700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f45700b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 -- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 msgr2=0x7f45700b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f45700b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 -- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45700d0640 msgr2=0x7f45700c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45700d0640 0x7f45700c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 -- 172.21.15.46:0/2998296724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c009570 con 0x7f457015d370 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4574974700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f45700b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4575976700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f45701574d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f456c009f70 tx=0x7f456c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c004510 con 0x7f457015d370 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c01e070 con 0x7f457015d370 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45700cbb10 con 0x7f457015d370 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c003900 con 0x7f457015d370 2023-05-21T16:54:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457015ce50 con 0x7f457015d370 2023-05-21T16:54:50.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45700d0a90 con 0x7f457015d370 2023-05-21T16:54:50.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.288+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f456c003a60 con 0x7f457015d370 2023-05-21T16:54:50.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.292+0000 7f4565ffb700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f45540662f0 0x7f45540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.292+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f456c084e60 con 0x7f457015d370 2023-05-21T16:54:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.292+0000 7f4575175700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f45540662f0 0x7f45540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.292+0000 7f4575175700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f45540662f0 0x7f45540687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45700cbae0 tx=0x7f456800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.296+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f456c052370 con 0x7f457015d370 2023-05-21T16:54:50.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.460+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4570157a10 con 0x7f457015d370 2023-05-21T16:54:50.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.464+0000 7f4565ffb700 1 -- 172.21.15.46:0/2998296724 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f4570157a10 con 0x7f457015d370 2023-05-21T16:54:50.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:50.469 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:50.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f45540662f0 msgr2=0x7f45540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f45540662f0 0x7f45540687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45700cbae0 tx=0x7f456800b040 comp rx=0 tx=0).stop 2023-05-21T16:54:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 msgr2=0x7f45701574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f45701574d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f456c009f70 tx=0x7f456c004770 comp rx=0 tx=0).stop 2023-05-21T16:54:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 shutdown_connections 2023-05-21T16:54:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f45540662f0 0x7f45540687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f457015d370 0x7f45701574d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f457015a4f0 0x7f45700b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 --2- 172.21.15.46:0/2998296724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45700d0640 0x7f45700c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 >> 172.21.15.46:0/2998296724 conn(0x7f457006fc60 msgr2=0x7f45700cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 shutdown_connections 2023-05-21T16:54:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.468+0000 7f45773d9700 1 -- 172.21.15.46:0/2998296724 wait complete. 2023-05-21T16:54:50.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:50.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 Processor -- start 2023-05-21T16:54:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- start start 2023-05-21T16:54:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f187c0dee50 0x7f187c04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f187c04f880 0x7f187c04fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c0064d0 con 0x7f187c006960 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c050210 con 0x7f187c04f880 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c0df220 con 0x7f187c0dee50 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f187c04f880 0x7f187c04fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f187c04f880 0x7f187c04fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52796/0 (socket says 172.21.15.46:52796) 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 -- 172.21.15.46:0/2725778811 learned_addr learned my addr 172.21.15.46:0/2725778811 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188a0b9700 1 --2- 172.21.15.46:0/2725778811 >> v2:172.21.15.142:3300/0 conn(0x7f187c0dee50 0x7f187c04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 -- 172.21.15.46:0/2725778811 >> v2:172.21.15.142:3300/0 conn(0x7f187c0dee50 msgr2=0x7f187c04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:50.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 --2- 172.21.15.46:0/2725778811 >> v2:172.21.15.142:3300/0 conn(0x7f187c0dee50 0x7f187c04f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 -- 172.21.15.46:0/2725778811 >> v1:172.21.15.46:6789/0 conn(0x7f187c006960 legacy=0x7f187c006da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 -- 172.21.15.46:0/2725778811 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0340b0 con 0x7f187c04f880 2023-05-21T16:54:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18898b8700 1 --2- 172.21.15.46:0/2725778811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c04f880 0x7f187c04fcd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f187c0527f0 tx=0x7f187400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba06ddb7c9740b32 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18890b7700 1 -- 172.21.15.46:0/2725778811 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400dd30 con 0x7f187c04f880 2023-05-21T16:54:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18890b7700 1 -- 172.21.15.46:0/2725778811 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400de90 con 0x7f187c04f880 2023-05-21T16:54:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f18890b7700 1 -- 172.21.15.46:0/2725778811 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874010690 con 0x7f187c04f880 2023-05-21T16:54:50.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- 172.21.15.46:0/2725778811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c04f880 msgr2=0x7f187c04fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 --2- 172.21.15.46:0/2725778811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c04f880 0x7f187c04fcd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f187c0527f0 tx=0x7f187400be90 comp rx=0 tx=0).stop 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- 172.21.15.46:0/2725778811 shutdown_connections 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 --2- 172.21.15.46:0/2725778811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c04f880 0x7f187c04fcd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 --2- 172.21.15.46:0/2725778811 >> v2:172.21.15.142:3300/0 conn(0x7f187c0dee50 0x7f187c04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- 172.21.15.46:0/2725778811 >> 172.21.15.46:0/2725778811 conn(0x7f187c051770 msgr2=0x7f187c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- 172.21.15.46:0/2725778811 shutdown_connections 2023-05-21T16:54:50.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.596+0000 7f188b0bb700 1 -- 172.21.15.46:0/2725778811 wait complete. 2023-05-21T16:54:50.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 Processor -- start 2023-05-21T16:54:50.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 -- start start 2023-05-21T16:54:50.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f187c006960 0x7f187c0d8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f187c04f880 0x7f187c0df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 0x7f187c0df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c038210 con 0x7f187c0dee50 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0d5840 con 0x7f187c04f880 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188b0bb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c04e400 con 0x7f187c006960 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 0x7f187c0df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 0x7f187c0df8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52812/0 (socket says 172.21.15.46:52812) 2023-05-21T16:54:50.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 -- 172.21.15.46:0/920867466 learned_addr learned my addr 172.21.15.46:0/920867466 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f18898b8700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f187c04f880 0x7f187c0df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a0b9700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f187c006960 0x7f187c0d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 -- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f187c006960 msgr2=0x7f187c0d8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f187c006960 0x7f187c0d8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 -- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f187c04f880 msgr2=0x7f187c0df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f187c04f880 0x7f187c0df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 -- 172.21.15.46:0/920867466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187400b810 con 0x7f187c0dee50 2023-05-21T16:54:50.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.600+0000 7f188a8ba700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 0x7f187c0df8a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f188000c4b0 tx=0x7f188000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880005220 con 0x7f187c0dee50 2023-05-21T16:54:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880005380 con 0x7f187c0dee50 2023-05-21T16:54:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c054770 con 0x7f187c0dee50 2023-05-21T16:54:50.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880006880 con 0x7f187c0dee50 2023-05-21T16:54:50.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c054490 con 0x7f187c0dee50 2023-05-21T16:54:50.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c006160 con 0x7f187c0dee50 2023-05-21T16:54:50.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18800069e0 con 0x7f187c0dee50 2023-05-21T16:54:50.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f187affd700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18680662f0 0x7f18680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f188a0b9700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18680662f0 0x7f18680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.604+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1880083280 con 0x7f187c0dee50 2023-05-21T16:54:50.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.608+0000 7f188a0b9700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18680662f0 0x7f18680687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f188404f090 tx=0x7f18840619b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.616+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1880050660 con 0x7f187c0dee50 2023-05-21T16:54:50.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.772+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f187c005570 con 0x7f187c0dee50 2023-05-21T16:54:50.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.772+0000 7f187affd700 1 -- 172.21.15.46:0/920867466 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1880053c80 con 0x7f187c0dee50 2023-05-21T16:54:50.778 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:50.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18680662f0 msgr2=0x7f18680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18680662f0 0x7f18680687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f188404f090 tx=0x7f18840619b0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 msgr2=0x7f187c0df8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 0x7f187c0df8a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f188000c4b0 tx=0x7f188000c870 comp rx=0 tx=0).stop 2023-05-21T16:54:50.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 shutdown_connections 2023-05-21T16:54:50.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18680662f0 0x7f18680687a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f187c0dee50 0x7f187c0df8a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f187c04f880 0x7f187c0df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 --2- 172.21.15.46:0/920867466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f187c006960 0x7f187c0d8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 >> 172.21.15.46:0/920867466 conn(0x7f187c051770 msgr2=0x7f187c0549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:50.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 shutdown_connections 2023-05-21T16:54:50.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.776+0000 7f188b0bb700 1 -- 172.21.15.46:0/920867466 wait complete. 2023-05-21T16:54:50.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0327fff700 1 Processor -- start 2023-05-21T16:54:50.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0327fff700 1 -- start start 2023-05-21T16:54:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0327fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03280b5020 0x7f03280cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0327fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03280b8ea0 con 0x7f03280b8ad0 2023-05-21T16:54:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0327fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03280d09d0 con 0x7f03280b5ce0 2023-05-21T16:54:50.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0327fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03280d0cb0 con 0x7f03280b5020 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0326ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f03280b8ad0 0x7f032806a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39572/0 (socket says 172.21.15.46:39572) 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0326ffd700 1 -- 172.21.15.46:0/598669940 learned_addr learned my addr 172.21.15.46:0/598669940 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f03277fe700 1 --2- 172.21.15.46:0/598669940 >> v2:172.21.15.142:3300/0 conn(0x7f03280b5020 0x7f03280cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.904+0000 7f0325ffb700 1 -- 172.21.15.46:0/598669940 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653719813 0 0) 0x7f03280b8ea0 con 0x7f03280b8ad0 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0325ffb700 1 -- 172.21.15.46:0/598669940 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03100035d0 con 0x7f03280b8ad0 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f03277fe700 1 -- 172.21.15.46:0/598669940 >> v1:172.21.15.142:6789/0 conn(0x7f03280b5ce0 legacy=0x7f03280b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f03277fe700 1 -- 172.21.15.46:0/598669940 >> v1:172.21.15.46:6789/0 conn(0x7f03280b8ad0 legacy=0x7f032806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f03277fe700 1 -- 172.21.15.46:0/598669940 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03280cd4f0 con 0x7f03280b5020 2023-05-21T16:54:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f03277fe700 1 --2- 172.21.15.46:0/598669940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f03280cf310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0320009d90 tx=0x7f032000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c1b94201cc685ea server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0325ffb700 1 -- 172.21.15.46:0/598669940 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000e070 con 0x7f03280b5020 2023-05-21T16:54:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0325ffb700 1 -- 172.21.15.46:0/598669940 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000bb20 con 0x7f03280b5020 2023-05-21T16:54:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0325ffb700 1 -- 172.21.15.46:0/598669940 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000be90 con 0x7f03280b5020 2023-05-21T16:54:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 -- 172.21.15.46:0/598669940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 msgr2=0x7f03280cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 --2- 172.21.15.46:0/598669940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f03280cf310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0320009d90 tx=0x7f032000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 -- 172.21.15.46:0/598669940 shutdown_connections 2023-05-21T16:54:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 --2- 172.21.15.46:0/598669940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f03280cf310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 -- 172.21.15.46:0/598669940 >> 172.21.15.46:0/598669940 conn(0x7f03280d3ae0 msgr2=0x7f03280cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 -- 172.21.15.46:0/598669940 shutdown_connections 2023-05-21T16:54:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 -- 172.21.15.46:0/598669940 wait complete. 2023-05-21T16:54:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 Processor -- start 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.908+0000 7f0327fff700 1 -- start start 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f032814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03280b5ce0 0x7f03280cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 0x7f03281550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03280ca8b0 con 0x7f03280b8ad0 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281503f0 con 0x7f03280b5020 2023-05-21T16:54:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03280cab30 con 0x7f03280b5ce0 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 0x7f03281550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 0x7f03281550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52816/0 (socket says 172.21.15.46:52816) 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 -- 172.21.15.46:0/839602907 learned_addr learned my addr 172.21.15.46:0/839602907 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03267fc700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03280b5ce0 0x7f03280cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0326ffd700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f032814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 -- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03280b5ce0 msgr2=0x7f03280cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03280b5ce0 0x7f03280cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 -- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 msgr2=0x7f032814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f032814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 -- 172.21.15.46:0/839602907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320009a70 con 0x7f03280b8ad0 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0326ffd700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f032814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f03277fe700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 0x7f03281550f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f032000b370 tx=0x7f0320004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320004960 con 0x7f03280b8ad0 2023-05-21T16:54:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320020070 con 0x7f03280b8ad0 2023-05-21T16:54:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03280cda70 con 0x7f03280b8ad0 2023-05-21T16:54:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200276c0 con 0x7f03280b8ad0 2023-05-21T16:54:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03280cd790 con 0x7f03280b8ad0 2023-05-21T16:54:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0328167550 con 0x7f03280b8ad0 2023-05-21T16:54:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.912+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0320012430 con 0x7f03280b8ad0 2023-05-21T16:54:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.916+0000 7f030f7fe700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f03140662f0 0x7f03140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.916+0000 7f0326ffd700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f03140662f0 0x7f03140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.916+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0320022070 con 0x7f03280b8ad0 2023-05-21T16:54:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.916+0000 7f0326ffd700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f03140662f0 0x7f03140687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f031c0011e0 tx=0x7f031c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:50.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:50.924+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f03200536e0 con 0x7f03280b8ad0 2023-05-21T16:54:51.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.080+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03280733b0 con 0x7f03280b8ad0 2023-05-21T16:54:51.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.080+0000 7f030f7fe700 1 -- 172.21.15.46:0/839602907 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0320056d00 con 0x7f03280b8ad0 2023-05-21T16:54:51.086 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f03140662f0 msgr2=0x7f03140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f03140662f0 0x7f03140687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f031c0011e0 tx=0x7f031c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 msgr2=0x7f03281550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 0x7f03281550f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f032000b370 tx=0x7f0320004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 shutdown_connections 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f03140662f0 0x7f03140687a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03280b8ad0 0x7f03281550f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03280b5ce0 0x7f03280cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 --2- 172.21.15.46:0/839602907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03280b5020 0x7f032814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 >> 172.21.15.46:0/839602907 conn(0x7f03280d3ae0 msgr2=0x7f03280b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 shutdown_connections 2023-05-21T16:54:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.084+0000 7f0327fff700 1 -- 172.21.15.46:0/839602907 wait complete. 2023-05-21T16:54:51.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:51.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 Processor -- start 2023-05-21T16:54:51.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 -- start start 2023-05-21T16:54:51.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14dc0b5ce0 0x7f14dc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc0b8ea0 con 0x7f14dc0b8ad0 2023-05-21T16:54:51.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc0b52f0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e29c8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0d09d0 con 0x7f14dc0b4910 2023-05-21T16:54:51.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e11c5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14dc0b5ce0 0x7f14dc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e21c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.208+0000 7f14e21c7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:54630/0 (socket says 172.21.15.46:54630) 2023-05-21T16:54:51.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e11c5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14dc0b5ce0 0x7f14dc0cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:33414/0 (socket says 172.21.15.46:33414) 2023-05-21T16:54:51.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e21c7700 1 -- 172.21.15.46:0/986293622 learned_addr learned my addr 172.21.15.46:0/986293622 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:51.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e19c6700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f14dc0b8ad0 0x7f14dc06a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:54258/0 (socket says 172.21.15.46:54258) 2023-05-21T16:54:51.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e11c5700 1 -- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 msgr2=0x7f14dc0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:51.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e11c5700 1 --2- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e11c5700 1 -- 172.21.15.46:0/986293622 >> v1:172.21.15.142:6789/0 conn(0x7f14dc0b8ad0 legacy=0x7f14dc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e11c5700 1 -- 172.21.15.46:0/986293622 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0d0cb0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e11c5700 1 --2- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc0cf310 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009850 tx=0x7f14d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75ee5b610fd51e4 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e09c4700 1 -- 172.21.15.46:0/986293622 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011830 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e09c4700 1 -- 172.21.15.46:0/986293622 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8011990 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e09c4700 1 -- 172.21.15.46:0/986293622 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011d40 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 -- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b5ce0 msgr2=0x7f14dc0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 --2- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc0cf310 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009850 tx=0x7f14d8009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 -- 172.21.15.46:0/986293622 shutdown_connections 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 --2- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 --2- 172.21.15.46:0/986293622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc0cf310 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 -- 172.21.15.46:0/986293622 >> 172.21.15.46:0/986293622 conn(0x7f14dc0d3ae0 msgr2=0x7f14dc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 -- 172.21.15.46:0/986293622 shutdown_connections 2023-05-21T16:54:51.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.212+0000 7f14e29c8700 1 -- 172.21.15.46:0/986293622 wait complete. 2023-05-21T16:54:51.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 Processor -- start 2023-05-21T16:54:51.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 -- start start 2023-05-21T16:54:51.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc1f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b8ad0 0x7f14dc06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc15d270 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc15df30 con 0x7f14dc0b8ad0 2023-05-21T16:54:51.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc15e210 con 0x7f14dc0b4910 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc1f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52820/0 (socket says 172.21.15.46:52820) 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 -- 172.21.15.46:0/3165741137 learned_addr learned my addr 172.21.15.46:0/3165741137 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e21c7700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b8ad0 0x7f14dc06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e19c6700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc1f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 -- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 msgr2=0x7f14dc1f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc1f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 -- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b8ad0 msgr2=0x7f14dc06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b8ad0 0x7f14dc06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 -- 172.21.15.46:0/3165741137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80094b0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e11c5700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc1f1c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14d8014040 tx=0x7f14d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d80036c0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d801e070 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc0cd790 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8003a80 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.216+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc0cd4f0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.220+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc0cda70 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.220+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14d8003be0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.220+0000 7f14ce7fc700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14c00662f0 0x7f14c00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.220+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14d8020070 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.220+0000 7f14e19c6700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14c00662f0 0x7f14c00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.220+0000 7f14e19c6700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14c00662f0 0x7f14c00687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14d0000f60 tx=0x7f14d0007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.228+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f14d8052590 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.392+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14dc0733b0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.392+0000 7f14ce7fc700 1 -- 172.21.15.46:0/3165741137 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14d8055bb0 con 0x7f14dc0b5ce0 2023-05-21T16:54:51.399 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14c00662f0 msgr2=0x7f14c00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14c00662f0 0x7f14c00687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14d0000f60 tx=0x7f14d0007ef0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 msgr2=0x7f14dc1f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc1f1c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14d8014040 tx=0x7f14d8004770 comp rx=0 tx=0).stop 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 shutdown_connections 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f14c00662f0 0x7f14c00687a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14dc0b8ad0 0x7f14dc06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14dc0b5ce0 0x7f14dc1f1c20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 --2- 172.21.15.46:0/3165741137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14dc0b4910 0x7f14dc1f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 >> 172.21.15.46:0/3165741137 conn(0x7f14dc0d3ae0 msgr2=0x7f14dc0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 shutdown_connections 2023-05-21T16:54:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.396+0000 7f14e29c8700 1 -- 172.21.15.46:0/3165741137 wait complete. 2023-05-21T16:54:51.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:51.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645359e700 1 Processor -- start 2023-05-21T16:54:51.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645359e700 1 -- start start 2023-05-21T16:54:51.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64540b5020 0x7f64540cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540b8ea0 con 0x7f64540b8ad0 2023-05-21T16:54:51.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540d09d0 con 0x7f64540b5ce0 2023-05-21T16:54:51.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540d0cb0 con 0x7f64540b5020 2023-05-21T16:54:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64540b5020 0x7f64540cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64540b5020 0x7f64540cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52832/0 (socket says 172.21.15.46:52832) 2023-05-21T16:54:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 -- 172.21.15.46:0/2963213328 learned_addr learned my addr 172.21.15.46:0/2963213328 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 -- 172.21.15.46:0/2963213328 >> v1:172.21.15.142:6789/0 conn(0x7f64540b5ce0 legacy=0x7f64540b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 -- 172.21.15.46:0/2963213328 >> v1:172.21.15.46:6789/0 conn(0x7f64540b8ad0 legacy=0x7f645406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 -- 172.21.15.46:0/2963213328 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540cd4f0 con 0x7f64540b5020 2023-05-21T16:54:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f6452d9d700 1 --2- 172.21.15.46:0/2963213328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5020 0x7f64540cf310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f644c009910 tx=0x7f644c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67a9a4c5c693c84 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645159a700 1 -- 172.21.15.46:0/2963213328 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c004230 con 0x7f64540b5020 2023-05-21T16:54:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645159a700 1 -- 172.21.15.46:0/2963213328 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c004390 con 0x7f64540b5020 2023-05-21T16:54:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.528+0000 7f645159a700 1 -- 172.21.15.46:0/2963213328 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c009e60 con 0x7f64540b5020 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 -- 172.21.15.46:0/2963213328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5020 msgr2=0x7f64540cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 --2- 172.21.15.46:0/2963213328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5020 0x7f64540cf310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f644c009910 tx=0x7f644c009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 -- 172.21.15.46:0/2963213328 shutdown_connections 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 --2- 172.21.15.46:0/2963213328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5020 0x7f64540cf310 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 -- 172.21.15.46:0/2963213328 >> 172.21.15.46:0/2963213328 conn(0x7f64540d3ae0 msgr2=0x7f64540cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 -- 172.21.15.46:0/2963213328 shutdown_connections 2023-05-21T16:54:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 -- 172.21.15.46:0/2963213328 wait complete. 2023-05-21T16:54:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 Processor -- start 2023-05-21T16:54:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.532+0000 7f645359e700 1 -- start start 2023-05-21T16:54:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64540b5020 0x7f6454156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 0x7f645414b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64540b8ad0 0x7f6454151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454157d20 con 0x7f64540b5ce0 2023-05-21T16:54:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454157480 con 0x7f64540b5020 2023-05-21T16:54:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454157760 con 0x7f64540b8ad0 2023-05-21T16:54:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 0x7f645414b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64540b5020 0x7f6454156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 0x7f645414b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52844/0 (socket says 172.21.15.46:52844) 2023-05-21T16:54:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64540b5020 0x7f6454156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:33424/0 (socket says 172.21.15.46:33424) 2023-05-21T16:54:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 -- 172.21.15.46:0/2891310827 learned_addr learned my addr 172.21.15.46:0/2891310827 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6452d9d700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64540b8ad0 0x7f6454151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 -- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64540b8ad0 msgr2=0x7f6454151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64540b8ad0 0x7f6454151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 -- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64540b5020 msgr2=0x7f6454156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64540b5020 0x7f6454156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 -- 172.21.15.46:0/2891310827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c009570 con 0x7f64540b5ce0 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6451d9b700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 0x7f645414b0f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f644800b4a0 tx=0x7f644800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448011830 con 0x7f64540b5ce0 2023-05-21T16:54:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448011990 con 0x7f64540b5ce0 2023-05-21T16:54:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64540cda70 con 0x7f64540b5ce0 2023-05-21T16:54:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448011d40 con 0x7f64540b5ce0 2023-05-21T16:54:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.536+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540cd790 con 0x7f64540b5ce0 2023-05-21T16:54:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.540+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6454167550 con 0x7f64540b5ce0 2023-05-21T16:54:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.540+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f644801a400 con 0x7f64540b5ce0 2023-05-21T16:54:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.540+0000 7f6442ffd700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f64340662f0 0x7f64340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.540+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64480837e0 con 0x7f64540b5ce0 2023-05-21T16:54:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.540+0000 7f645259c700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f64340662f0 0x7f64340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.540+0000 7f645259c700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f64340662f0 0x7f64340687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f644400f290 tx=0x7f6444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.548+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6448050cf0 con 0x7f64540b5ce0 2023-05-21T16:54:51.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64540733b0 con 0x7f64540b5ce0 2023-05-21T16:54:51.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f6442ffd700 1 -- 172.21.15.46:0/2891310827 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6448054310 con 0x7f64540b5ce0 2023-05-21T16:54:51.717 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:51.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f64340662f0 msgr2=0x7f64340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f64340662f0 0x7f64340687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f644400f290 tx=0x7f6444009040 comp rx=0 tx=0).stop 2023-05-21T16:54:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 msgr2=0x7f645414b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 0x7f645414b0f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f644800b4a0 tx=0x7f644800b7b0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 shutdown_connections 2023-05-21T16:54:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f64340662f0 0x7f64340687a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64540b8ad0 0x7f6454151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540b5ce0 0x7f645414b0f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 --2- 172.21.15.46:0/2891310827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64540b5020 0x7f6454156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 >> 172.21.15.46:0/2891310827 conn(0x7f64540d3ae0 msgr2=0x7f64540cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:51.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 shutdown_connections 2023-05-21T16:54:51.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.712+0000 7f645359e700 1 -- 172.21.15.46:0/2891310827 wait complete. 2023-05-21T16:54:51.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:54:51.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.836+0000 7fc970afe700 1 Processor -- start 2023-05-21T16:54:51.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.836+0000 7fc970afe700 1 -- start start 2023-05-21T16:54:51.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc96c160be0 0x7fc96c1651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc96c06a420 0x7fc96c0c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c0ade30 con 0x7fc96c069f80 2023-05-21T16:54:51.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0cd210 con 0x7fc96c06a420 2023-05-21T16:54:51.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0cc970 con 0x7fc96c160be0 2023-05-21T16:54:51.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc96c06a420 0x7fc96c0c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc96c06a420 0x7fc96c0c18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52856/0 (socket says 172.21.15.46:52856) 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 -- 172.21.15.46:0/911730505 learned_addr learned my addr 172.21.15.46:0/911730505 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96b7fe700 1 --2- 172.21.15.46:0/911730505 >> v2:172.21.15.142:3300/0 conn(0x7fc96c160be0 0x7fc96c1651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 -- 172.21.15.46:0/911730505 >> v2:172.21.15.142:3300/0 conn(0x7fc96c160be0 msgr2=0x7fc96c1651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 --2- 172.21.15.46:0/911730505 >> v2:172.21.15.142:3300/0 conn(0x7fc96c160be0 0x7fc96c1651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 -- 172.21.15.46:0/911730505 >> v1:172.21.15.142:6789/0 conn(0x7fc96c069f80 legacy=0x7fc96c070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 -- 172.21.15.46:0/911730505 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0ccc50 con 0x7fc96c06a420 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96bfff700 1 --2- 172.21.15.46:0/911730505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c06a420 0x7fc96c0c18a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc96c06c460 tx=0x7fc96400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a78b995cde41d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96a7fc700 1 -- 172.21.15.46:0/911730505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400e070 con 0x7fc96c06a420 2023-05-21T16:54:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96a7fc700 1 -- 172.21.15.46:0/911730505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400b9c0 con 0x7fc96c06a420 2023-05-21T16:54:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc96a7fc700 1 -- 172.21.15.46:0/911730505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400bd70 con 0x7fc96c06a420 2023-05-21T16:54:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- 172.21.15.46:0/911730505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c06a420 msgr2=0x7fc96c0c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 --2- 172.21.15.46:0/911730505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c06a420 0x7fc96c0c18a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc96c06c460 tx=0x7fc96400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- 172.21.15.46:0/911730505 shutdown_connections 2023-05-21T16:54:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 --2- 172.21.15.46:0/911730505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c06a420 0x7fc96c0c18a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 --2- 172.21.15.46:0/911730505 >> v2:172.21.15.142:3300/0 conn(0x7fc96c160be0 0x7fc96c1651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- 172.21.15.46:0/911730505 >> 172.21.15.46:0/911730505 conn(0x7fc96c0cf720 msgr2=0x7fc96c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- 172.21.15.46:0/911730505 shutdown_connections 2023-05-21T16:54:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.840+0000 7fc970afe700 1 -- 172.21.15.46:0/911730505 wait complete. 2023-05-21T16:54:51.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 Processor -- start 2023-05-21T16:54:51.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 -- start start 2023-05-21T16:54:51.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c069f80 0x7fc96c161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c06a420 0x7fc96c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 0x7fc96c1f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c161fb0 con 0x7fc96c160be0 2023-05-21T16:54:51.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c160fb0 con 0x7fc96c069f80 2023-05-21T16:54:51.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1f7340 con 0x7fc96c06a420 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 0x7fc96c1f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 0x7fc96c1f6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52872/0 (socket says 172.21.15.46:52872) 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 -- 172.21.15.46:0/1495353209 learned_addr learned my addr 172.21.15.46:0/1495353209 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96b7fe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c069f80 0x7fc96c161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96affd700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c06a420 0x7fc96c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 -- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c06a420 msgr2=0x7fc96c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c06a420 0x7fc96c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 -- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c069f80 msgr2=0x7fc96c161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c069f80 0x7fc96c161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 -- 172.21.15.46:0/1495353209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009b30 con 0x7fc96c160be0 2023-05-21T16:54:51.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc96bfff700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 0x7fc96c1f6810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc96c06e960 tx=0x7fc964004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964004880 con 0x7fc96c160be0 2023-05-21T16:54:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640099b0 con 0x7fc96c160be0 2023-05-21T16:54:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c070730 con 0x7fc96c160be0 2023-05-21T16:54:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.844+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96401c680 con 0x7fc96c160be0 2023-05-21T16:54:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.848+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c0ccf30 con 0x7fc96c160be0 2023-05-21T16:54:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.848+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c165700 con 0x7fc96c160be0 2023-05-21T16:54:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.848+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc96401c7e0 con 0x7fc96c160be0 2023-05-21T16:54:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.848+0000 7fc953fff700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc9580662f0 0x7fc9580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.848+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc964085900 con 0x7fc96c160be0 2023-05-21T16:54:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.848+0000 7fc96b7fe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc9580662f0 0x7fc9580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.852+0000 7fc96b7fe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc9580662f0 0x7fc9580687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b1170 tx=0x7fc960008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:51.860+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc964052d70 con 0x7fc96c160be0 2023-05-21T16:54:52.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.036+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc96c0733b0 con 0x7fc96c160be0 2023-05-21T16:54:52.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.036+0000 7fc953fff700 1 -- 172.21.15.46:0/1495353209 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc964056390 con 0x7fc96c160be0 2023-05-21T16:54:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc9580662f0 msgr2=0x7fc9580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc9580662f0 0x7fc9580687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b1170 tx=0x7fc960008040 comp rx=0 tx=0).stop 2023-05-21T16:54:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 msgr2=0x7fc96c1f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 0x7fc96c1f6810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc96c06e960 tx=0x7fc964004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 shutdown_connections 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc9580662f0 0x7fc9580687a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc96c160be0 0x7fc96c1f6810 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc96c06a420 0x7fc96c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 --2- 172.21.15.46:0/1495353209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc96c069f80 0x7fc96c161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 >> 172.21.15.46:0/1495353209 conn(0x7fc96c0cf720 msgr2=0x7fc96c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 shutdown_connections 2023-05-21T16:54:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.040+0000 7fc970afe700 1 -- 172.21.15.46:0/1495353209 wait complete. 2023-05-21T16:54:52.047 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:54:52.057 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:54:52.057 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:52.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.168+0000 7f53d169d700 1 Processor -- start 2023-05-21T16:54:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.168+0000 7f53d169d700 1 -- start start 2023-05-21T16:54:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0709d0 0x7f53cc0d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53cc0ccaa0 0x7f53cc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0b3ac0 con 0x7f53cc15c9b0 2023-05-21T16:54:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0cf620 con 0x7f53cc0ccaa0 2023-05-21T16:54:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0cc4f0 con 0x7f53cc0709d0 2023-05-21T16:54:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53cc0ccaa0 0x7f53cc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53cc0ccaa0 0x7f53cc0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52880/0 (socket says 172.21.15.46:52880) 2023-05-21T16:54:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3777606806 learned_addr learned my addr 172.21.15.46:0/3777606806 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53cb7fe700 1 --2- 172.21.15.46:0/3777606806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0709d0 0x7f53cc0d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3777606806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0709d0 msgr2=0x7f53cc0d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 --2- 172.21.15.46:0/3777606806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0709d0 0x7f53cc0d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3777606806 >> v1:172.21.15.142:6789/0 conn(0x7f53cc15c9b0 legacy=0x7f53cc0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3777606806 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0cf890 con 0x7f53cc0ccaa0 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d0e9c700 1 --2- 172.21.15.46:0/3777606806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc0ccaa0 0x7f53cc0b3f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009e50 tx=0x7f53c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77124f2b49cfe775 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53caffd700 1 -- 172.21.15.46:0/3777606806 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400e070 con 0x7f53cc0ccaa0 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53caffd700 1 -- 172.21.15.46:0/3777606806 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c400b9c0 con 0x7f53cc0ccaa0 2023-05-21T16:54:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53caffd700 1 -- 172.21.15.46:0/3777606806 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400bd70 con 0x7f53cc0ccaa0 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- 172.21.15.46:0/3777606806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc0ccaa0 msgr2=0x7f53cc0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 --2- 172.21.15.46:0/3777606806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc0ccaa0 0x7f53cc0b3f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009e50 tx=0x7f53c400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- 172.21.15.46:0/3777606806 shutdown_connections 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 --2- 172.21.15.46:0/3777606806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc0ccaa0 0x7f53cc0b3f50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 --2- 172.21.15.46:0/3777606806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0709d0 0x7f53cc0d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- 172.21.15.46:0/3777606806 >> 172.21.15.46:0/3777606806 conn(0x7f53cc0cd6f0 msgr2=0x7f53cc0cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- 172.21.15.46:0/3777606806 shutdown_connections 2023-05-21T16:54:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.172+0000 7f53d169d700 1 -- 172.21.15.46:0/3777606806 wait complete. 2023-05-21T16:54:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 Processor -- start 2023-05-21T16:54:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 -- start start 2023-05-21T16:54:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53cc0709d0 0x7f53cc06f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0ccaa0 0x7f53cc0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 0x7f53cc0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0af680 con 0x7f53cc15c9b0 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0aca60 con 0x7f53cc0709d0 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0acd40 con 0x7f53cc0ccaa0 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 0x7f53cc0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 0x7f53cc0af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52882/0 (socket says 172.21.15.46:52882) 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3302298303 learned_addr learned my addr 172.21.15.46:0/3302298303 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53cbfff700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53cc0709d0 0x7f53cc06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53cb7fe700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0ccaa0 0x7f53cc0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0ccaa0 msgr2=0x7f53cc0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0ccaa0 0x7f53cc0aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53cc0709d0 msgr2=0x7f53cc06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53cc0709d0 0x7f53cc06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 -- 172.21.15.46:0/3302298303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c4009b30 con 0x7f53cc15c9b0 2023-05-21T16:54:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d0e9c700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 0x7f53cc0af140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0ce3b0 tx=0x7f53c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4004800 con 0x7f53cc15c9b0 2023-05-21T16:54:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc0cd440 con 0x7f53cc15c9b0 2023-05-21T16:54:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c40099b0 con 0x7f53cc15c9b0 2023-05-21T16:54:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc15cd80 con 0x7f53cc15c9b0 2023-05-21T16:54:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.176+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4025650 con 0x7f53cc15c9b0 2023-05-21T16:54:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.180+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc0cc7d0 con 0x7f53cc15c9b0 2023-05-21T16:54:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.180+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53c40257b0 con 0x7f53cc15c9b0 2023-05-21T16:54:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.180+0000 7f53c8ff9700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b80662f0 0x7f53b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.180+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c4085940 con 0x7f53cc15c9b0 2023-05-21T16:54:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.180+0000 7f53cbfff700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b80662f0 0x7f53b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.180+0000 7f53cbfff700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b80662f0 0x7f53b80687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53bc000f60 tx=0x7f53bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.188+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f53c4052e50 con 0x7f53cc15c9b0 2023-05-21T16:54:52.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.352+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53cc0733b0 con 0x7f53cc15c9b0 2023-05-21T16:54:52.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.356+0000 7f53c8ff9700 1 -- 172.21.15.46:0/3302298303 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f53c4056470 con 0x7f53cc15c9b0 2023-05-21T16:54:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:52.364 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b80662f0 msgr2=0x7f53b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b80662f0 0x7f53b80687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53bc000f60 tx=0x7f53bc009040 comp rx=0 tx=0).stop 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 msgr2=0x7f53cc0af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 0x7f53cc0af140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0ce3b0 tx=0x7f53c4004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 shutdown_connections 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b80662f0 0x7f53b80687a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53cc15c9b0 0x7f53cc0af140 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53cc0ccaa0 0x7f53cc0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 --2- 172.21.15.46:0/3302298303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53cc0709d0 0x7f53cc06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 >> 172.21.15.46:0/3302298303 conn(0x7f53cc0cd6f0 msgr2=0x7f53cc0b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 shutdown_connections 2023-05-21T16:54:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.360+0000 7f53d169d700 1 -- 172.21.15.46:0/3302298303 wait complete. 2023-05-21T16:54:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:52.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.500+0000 7f687759e700 1 Processor -- start 2023-05-21T16:54:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.500+0000 7f687759e700 1 -- start start 2023-05-21T16:54:52.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.500+0000 7f687759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f687815a8d0 0x7f687815e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.500+0000 7f687759e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687815aca0 con 0x7f68780cbc10 2023-05-21T16:54:52.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.500+0000 7f687759e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780ca520 con 0x7f68780aec10 2023-05-21T16:54:52.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.500+0000 7f687759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780cb7f0 con 0x7f687815a8d0 2023-05-21T16:54:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f6876d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f68780cbc10 0x7f68780cc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39600/0 (socket says 172.21.15.46:39600) 2023-05-21T16:54:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f6876d9d700 1 -- 172.21.15.46:0/971383687 learned_addr learned my addr 172.21.15.46:0/971383687 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:52.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 --2- 172.21.15.46:0/971383687 >> v2:172.21.15.142:3300/0 conn(0x7f687815a8d0 0x7f687815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247448560 0 0) 0x7f687815aca0 con 0x7f68780cbc10 2023-05-21T16:54:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68640035d0 con 0x7f68780cbc10 2023-05-21T16:54:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930230664 0 0) 0x7f68780ca520 con 0x7f68780aec10 2023-05-21T16:54:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687815aca0 con 0x7f68780aec10 2023-05-21T16:54:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4077724769 0 0) 0x7f68640035d0 con 0x7f68780cbc10 2023-05-21T16:54:52.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 >> v2:172.21.15.142:3300/0 conn(0x7f687815a8d0 msgr2=0x7f687815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 --2- 172.21.15.46:0/971383687 >> v2:172.21.15.142:3300/0 conn(0x7f687815a8d0 0x7f687815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 >> v1:172.21.15.142:6789/0 conn(0x7f68780aec10 legacy=0x7f687815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780cab70 con 0x7f68780cbc10 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f68700019f0 con 0x7f68780cbc10 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 >> v1:172.21.15.46:6789/0 conn(0x7f68780cbc10 legacy=0x7f68780cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f6864003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6864004870 0x7f6864004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6864005220 0x7f686400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780cb7f0 con 0x7f6864003bb0 2023-05-21T16:54:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686400c080 con 0x7f6864004870 2023-05-21T16:54:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686400c240 con 0x7f6864005220 2023-05-21T16:54:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f6864003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f6875d9b700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6864004870 0x7f6864004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f6876d9d700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6864005220 0x7f686400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 -- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6864005220 msgr2=0x7f686400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6864005220 0x7f686400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 -- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6864004870 msgr2=0x7f6864004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6864004870 0x7f6864004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 -- 172.21.15.46:0/971383687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640035d0 con 0x7f6864003bb0 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f6876d9d700 1 -- 172.21.15.46:0/971383687 reap_dead start 2023-05-21T16:54:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687659c700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f6864003fa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6860009b70 tx=0x7f68640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2079010f4eb6dc8 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000e6c0 con 0x7f6864003bb0 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000e820 con 0x7f6864003bb0 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687559a700 1 -- 172.21.15.46:0/971383687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000eb90 con 0x7f6864003bb0 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 -- 172.21.15.46:0/971383687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 msgr2=0x7f6864003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f6864003fa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6860009b70 tx=0x7f68640058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 -- 172.21.15.46:0/971383687 shutdown_connections 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 --2- 172.21.15.46:0/971383687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f6864003fa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 -- 172.21.15.46:0/971383687 >> 172.21.15.46:0/971383687 conn(0x7f687806d930 msgr2=0x7f687806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 -- 172.21.15.46:0/971383687 shutdown_connections 2023-05-21T16:54:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.504+0000 7f687759e700 1 -- 172.21.15.46:0/971383687 wait complete. 2023-05-21T16:54:52.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 Processor -- start 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 -- start start 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f68780ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f687815d650 0x7f68780abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68780ac010 0x7f68780c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c4580 con 0x7f6864003bb0 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687815cab0 con 0x7f68780ac010 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c3970 con 0x7f687815d650 2023-05-21T16:54:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f68780ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f68780ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52898/0 (socket says 172.21.15.46:52898) 2023-05-21T16:54:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f687659c700 1 -- 172.21.15.46:0/2747541409 learned_addr learned my addr 172.21.15.46:0/2747541409 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f6875d9b700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f687815d650 0x7f68780abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.508+0000 7f6876d9d700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68780ac010 0x7f68780c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687659c700 1 -- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f687815d650 msgr2=0x7f68780abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687659c700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f687815d650 0x7f68780abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687659c700 1 -- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68780ac010 msgr2=0x7f68780c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687659c700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68780ac010 0x7f68780c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687659c700 1 -- 172.21.15.46:0/2747541409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780cb130 con 0x7f6864003bb0 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687659c700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f68780ada80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f686400c050 tx=0x7f68600047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000e6c0 con 0x7f6864003bb0 2023-05-21T16:54:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860003af0 con 0x7f6864003bb0 2023-05-21T16:54:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68780cae50 con 0x7f6864003bb0 2023-05-21T16:54:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860003ea0 con 0x7f6864003bb0 2023-05-21T16:54:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780cb410 con 0x7f6864003bb0 2023-05-21T16:54:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6860013470 con 0x7f6864003bb0 2023-05-21T16:54:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.512+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6878073cb0 con 0x7f6864003bb0 2023-05-21T16:54:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.516+0000 7f686effd700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68580662f0 0x7f68580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.516+0000 7f6875d9b700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68580662f0 0x7f68580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.516+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68600851b0 con 0x7f6864003bb0 2023-05-21T16:54:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.516+0000 7f6875d9b700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68580662f0 0x7f68580687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68780b2200 tx=0x7f6868009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.520+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6860052740 con 0x7f6864003bb0 2023-05-21T16:54:52.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f687806d710 con 0x7f6864003bb0 2023-05-21T16:54:52.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f686effd700 1 -- 172.21.15.46:0/2747541409 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6860055d60 con 0x7f6864003bb0 2023-05-21T16:54:52.693 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68580662f0 msgr2=0x7f68580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68580662f0 0x7f68580687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68780b2200 tx=0x7f6868009040 comp rx=0 tx=0).stop 2023-05-21T16:54:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 msgr2=0x7f68780ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f68780ada80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f686400c050 tx=0x7f68600047e0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 shutdown_connections 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68580662f0 0x7f68580687a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68780ac010 0x7f68780c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f687815d650 0x7f68780abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 --2- 172.21.15.46:0/2747541409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864003bb0 0x7f68780ada80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 >> 172.21.15.46:0/2747541409 conn(0x7f687806d930 msgr2=0x7f6878159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:52.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 shutdown_connections 2023-05-21T16:54:52.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.688+0000 7f687759e700 1 -- 172.21.15.46:0/2747541409 wait complete. 2023-05-21T16:54:52.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:52.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.820+0000 7f7691c42700 1 Processor -- start 2023-05-21T16:54:52.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.820+0000 7f7691c42700 1 -- start start 2023-05-21T16:54:52.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7691c42700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f768c157470 0x7f768c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7691c42700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0cd670 con 0x7f768c15a8e0 2023-05-21T16:54:52.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7691c42700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c06cb10 con 0x7f768c0b1c30 2023-05-21T16:54:52.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7691c42700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c06cdf0 con 0x7f768c157470 2023-05-21T16:54:52.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f768bfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f768c15a8e0 0x7f768c0b1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39608/0 (socket says 172.21.15.46:39608) 2023-05-21T16:54:52.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f768bfff700 1 -- 172.21.15.46:0/178839969 learned_addr learned my addr 172.21.15.46:0/178839969 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:52.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7690c40700 1 --2- 172.21.15.46:0/178839969 >> v2:172.21.15.142:3300/0 conn(0x7f768c157470 0x7f768c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f768b7fe700 1 -- 172.21.15.46:0/178839969 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963386280 0 0) 0x7f768c0cd670 con 0x7f768c15a8e0 2023-05-21T16:54:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f768b7fe700 1 -- 172.21.15.46:0/178839969 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f767c0035d0 con 0x7f768c15a8e0 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7690c40700 1 -- 172.21.15.46:0/178839969 >> v1:172.21.15.142:6789/0 conn(0x7f768c0b1c30 legacy=0x7f768c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7690c40700 1 -- 172.21.15.46:0/178839969 >> v1:172.21.15.46:6789/0 conn(0x7f768c15a8e0 legacy=0x7f768c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7690c40700 1 -- 172.21.15.46:0/178839969 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c06d0d0 con 0x7f768c157470 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f7690c40700 1 --2- 172.21.15.46:0/178839969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c157470 0x7f768c06c2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7680009850 tx=0x7f7680009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0c93ca3545729d server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.824+0000 7f768b7fe700 1 -- 172.21.15.46:0/178839969 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680011830 con 0x7f768c157470 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f768b7fe700 1 -- 172.21.15.46:0/178839969 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680011990 con 0x7f768c157470 2023-05-21T16:54:52.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f768b7fe700 1 -- 172.21.15.46:0/178839969 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680011d00 con 0x7f768c157470 2023-05-21T16:54:52.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 -- 172.21.15.46:0/178839969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c157470 msgr2=0x7f768c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 --2- 172.21.15.46:0/178839969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c157470 0x7f768c06c2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7680009850 tx=0x7f7680009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:52.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 -- 172.21.15.46:0/178839969 shutdown_connections 2023-05-21T16:54:52.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 --2- 172.21.15.46:0/178839969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c157470 0x7f768c06c2c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 -- 172.21.15.46:0/178839969 >> 172.21.15.46:0/178839969 conn(0x7f768c06d930 msgr2=0x7f768c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:52.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 -- 172.21.15.46:0/178839969 shutdown_connections 2023-05-21T16:54:52.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 -- 172.21.15.46:0/178839969 wait complete. 2023-05-21T16:54:52.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 Processor -- start 2023-05-21T16:54:52.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.828+0000 7f7691c42700 1 -- start start 2023-05-21T16:54:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c0b1c30 0x7f768c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 0x7f768c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f768c15a8e0 0x7f768c0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0c80f0 con 0x7f768c157470 2023-05-21T16:54:52.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0ac1f0 con 0x7f768c0b1c30 2023-05-21T16:54:52.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0ac4d0 con 0x7f768c15a8e0 2023-05-21T16:54:52.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 0x7f768c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 0x7f768c155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52906/0 (socket says 172.21.15.46:52906) 2023-05-21T16:54:52.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 -- 172.21.15.46:0/1330512463 learned_addr learned my addr 172.21.15.46:0/1330512463 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:52.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691441700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f768c15a8e0 0x7f768c0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7690c40700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c0b1c30 0x7f768c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 -- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f768c15a8e0 msgr2=0x7f768c0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f768c15a8e0 0x7f768c0accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 -- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c0b1c30 msgr2=0x7f768c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c0b1c30 0x7f768c153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 -- 172.21.15.46:0/1330512463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800094b0 con 0x7f768c157470 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7690c40700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c0b1c30 0x7f768c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:52.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f768bfff700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 0x7f768c155a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7678005930 tx=0x7f767800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678005d90 con 0x7f768c157470 2023-05-21T16:54:52.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76780070d0 con 0x7f768c157470 2023-05-21T16:54:52.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678007480 con 0x7f768c157470 2023-05-21T16:54:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c06c800 con 0x7f768c157470 2023-05-21T16:54:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0cd8c0 con 0x7f768c157470 2023-05-21T16:54:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.832+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c0ce4f0 con 0x7f768c157470 2023-05-21T16:54:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.836+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76780075e0 con 0x7f768c157470 2023-05-21T16:54:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.836+0000 7f76897fa700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f76700662f0 0x7f76700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.836+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76780831a0 con 0x7f768c157470 2023-05-21T16:54:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.836+0000 7f7690c40700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f76700662f0 0x7f76700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:52.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.836+0000 7f7690c40700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f76700662f0 0x7f76700687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7680000c00 tx=0x7f7680008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:52.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:52.844+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7678050630 con 0x7f768c157470 2023-05-21T16:54:53.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.004+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f768c073cb0 con 0x7f768c157470 2023-05-21T16:54:53.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f76897fa700 1 -- 172.21.15.46:0/1330512463 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7678053c50 con 0x7f768c157470 2023-05-21T16:54:53.013 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f76700662f0 msgr2=0x7f76700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f76700662f0 0x7f76700687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7680000c00 tx=0x7f7680008030 comp rx=0 tx=0).stop 2023-05-21T16:54:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 msgr2=0x7f768c155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 0x7f768c155a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7678005930 tx=0x7f767800c7b0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 shutdown_connections 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f76700662f0 0x7f76700687a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f768c15a8e0 0x7f768c0accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f768c157470 0x7f768c155a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 --2- 172.21.15.46:0/1330512463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f768c0b1c30 0x7f768c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 >> 172.21.15.46:0/1330512463 conn(0x7f768c06d930 msgr2=0x7f768c159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 shutdown_connections 2023-05-21T16:54:53.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.008+0000 7f7691c42700 1 -- 172.21.15.46:0/1330512463 wait complete. 2023-05-21T16:54:53.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe382cb5700 1 Processor -- start 2023-05-21T16:54:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe382cb5700 1 -- start start 2023-05-21T16:54:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe382cb5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe37c157470 0x7fe37c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe382cb5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c0cd670 con 0x7fe37c15a8e0 2023-05-21T16:54:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe382cb5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c06cb10 con 0x7fe37c0b1c30 2023-05-21T16:54:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe382cb5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c06cdf0 con 0x7fe37c157470 2023-05-21T16:54:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe381cb3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe37c157470 0x7fe37c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe3814b2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe37c15a8e0 0x7fe37c0b1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39616/0 (socket says 172.21.15.46:39616) 2023-05-21T16:54:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe381cb3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe37c157470 0x7fe37c06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52912/0 (socket says 172.21.15.46:52912) 2023-05-21T16:54:53.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.148+0000 7fe3814b2700 1 -- 172.21.15.46:0/4106959708 learned_addr learned my addr 172.21.15.46:0/4106959708 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe381cb3700 1 -- 172.21.15.46:0/4106959708 >> v1:172.21.15.142:6789/0 conn(0x7fe37c0b1c30 legacy=0x7fe37c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe381cb3700 1 -- 172.21.15.46:0/4106959708 >> v1:172.21.15.46:6789/0 conn(0x7fe37c15a8e0 legacy=0x7fe37c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe381cb3700 1 -- 172.21.15.46:0/4106959708 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c06d0d0 con 0x7fe37c157470 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe381cb3700 1 --2- 172.21.15.46:0/4106959708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c06c2c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe378009850 tx=0x7fe378009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f5ac13c4136b04 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe380cb1700 1 -- 172.21.15.46:0/4106959708 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378011830 con 0x7fe37c157470 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe380cb1700 1 -- 172.21.15.46:0/4106959708 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378011990 con 0x7fe37c157470 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe380cb1700 1 -- 172.21.15.46:0/4106959708 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378011d20 con 0x7fe37c157470 2023-05-21T16:54:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 -- 172.21.15.46:0/4106959708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 msgr2=0x7fe37c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 --2- 172.21.15.46:0/4106959708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c06c2c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe378009850 tx=0x7fe378009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 -- 172.21.15.46:0/4106959708 shutdown_connections 2023-05-21T16:54:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 --2- 172.21.15.46:0/4106959708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c06c2c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 -- 172.21.15.46:0/4106959708 >> 172.21.15.46:0/4106959708 conn(0x7fe37c06d930 msgr2=0x7fe37c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 -- 172.21.15.46:0/4106959708 shutdown_connections 2023-05-21T16:54:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.152+0000 7fe382cb5700 1 -- 172.21.15.46:0/4106959708 wait complete. 2023-05-21T16:54:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 Processor -- start 2023-05-21T16:54:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 -- start start 2023-05-21T16:54:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe37c0b1c30 0x7fe37c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe37c15a8e0 0x7fe37c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0c8690 con 0x7fe37c157470 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0c7a80 con 0x7fe37c0b1c30 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0c7d60 con 0x7fe37c15a8e0 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c0b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52914/0 (socket says 172.21.15.46:52914) 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 -- 172.21.15.46:0/297520163 learned_addr learned my addr 172.21.15.46:0/297520163 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe381cb3700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe37c0b1c30 0x7fe37c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3824b4700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe37c15a8e0 0x7fe37c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 -- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe37c15a8e0 msgr2=0x7fe37c0b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe37c15a8e0 0x7fe37c0b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 -- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe37c0b1c30 msgr2=0x7fe37c1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe37c0b1c30 0x7fe37c1491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 -- 172.21.15.46:0/297520163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780094b0 con 0x7fe37c157470 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3824b4700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe37c15a8e0 0x7fe37c0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe3814b2700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c0b0440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe37000c500 tx=0x7fe37000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370005d90 con 0x7fe37c157470 2023-05-21T16:54:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3700070d0 con 0x7fe37c157470 2023-05-21T16:54:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370007440 con 0x7fe37c157470 2023-05-21T16:54:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c06c800 con 0x7fe37c157470 2023-05-21T16:54:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.156+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c0cd8c0 con 0x7fe37c157470 2023-05-21T16:54:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.160+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c0ce4f0 con 0x7fe37c157470 2023-05-21T16:54:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.160+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3700075a0 con 0x7fe37c157470 2023-05-21T16:54:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.160+0000 7fe36e7fc700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe360066340 0x7fe3600687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.160+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe370082fe0 con 0x7fe37c157470 2023-05-21T16:54:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.160+0000 7fe381cb3700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe360066340 0x7fe3600687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.160+0000 7fe381cb3700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe360066340 0x7fe3600687f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe378009fd0 tx=0x7fe378008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.172+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe3700504d0 con 0x7fe37c157470 2023-05-21T16:54:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.336+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe37c073cb0 con 0x7fe37c157470 2023-05-21T16:54:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.336+0000 7fe36e7fc700 1 -- 172.21.15.46:0/297520163 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe370053af0 con 0x7fe37c157470 2023-05-21T16:54:53.343 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe360066340 msgr2=0x7fe3600687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe360066340 0x7fe3600687f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe378009fd0 tx=0x7fe378008030 comp rx=0 tx=0).stop 2023-05-21T16:54:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 msgr2=0x7fe37c0b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c0b0440 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe37000c500 tx=0x7fe37000c810 comp rx=0 tx=0).stop 2023-05-21T16:54:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 shutdown_connections 2023-05-21T16:54:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe360066340 0x7fe3600687f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe37c15a8e0 0x7fe37c0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe37c157470 0x7fe37c0b0440 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 --2- 172.21.15.46:0/297520163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe37c0b1c30 0x7fe37c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 >> 172.21.15.46:0/297520163 conn(0x7fe37c06d930 msgr2=0x7fe37c0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 shutdown_connections 2023-05-21T16:54:53.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.340+0000 7fe382cb5700 1 -- 172.21.15.46:0/297520163 wait complete. 2023-05-21T16:54:53.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:53.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 Processor -- start 2023-05-21T16:54:53.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 -- start start 2023-05-21T16:54:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3dd00b8ad0 0x7f3dd00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b4910 0x7f3dd00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00b8ea0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00b52f0 con 0x7f3dd00b8ad0 2023-05-21T16:54:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dd5220700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00d09d0 con 0x7f3dd00b4910 2023-05-21T16:54:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dc7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3dd00b5ce0 0x7f3dd006a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39626/0 (socket says 172.21.15.46:39626) 2023-05-21T16:54:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.472+0000 7f3dc7fff700 1 -- 172.21.15.46:0/1469818423 learned_addr learned my addr 172.21.15.46:0/1469818423 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcffff700 1 --2- 172.21.15.46:0/1469818423 >> v2:172.21.15.142:3300/0 conn(0x7f3dd00b8ad0 0x7f3dd00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd4a1f700 1 --2- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b4910 0x7f3dd00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcf7fe700 1 -- 172.21.15.46:0/1469818423 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211915192 0 0) 0x7f3dd00b8ea0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcf7fe700 1 -- 172.21.15.46:0/1469818423 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc0035d0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcffff700 1 -- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b4910 msgr2=0x7f3dd00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcffff700 1 --2- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b4910 0x7f3dd00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcffff700 1 -- 172.21.15.46:0/1469818423 >> v1:172.21.15.46:6789/0 conn(0x7f3dd00b5ce0 legacy=0x7f3dd006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcffff700 1 -- 172.21.15.46:0/1469818423 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00d0cb0 con 0x7f3dd00b8ad0 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcffff700 1 --2- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b8ad0 0x7f3dd00cf310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009850 tx=0x7f3dc0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a210137112b3401 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcf7fe700 1 -- 172.21.15.46:0/1469818423 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011830 con 0x7f3dd00b8ad0 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcf7fe700 1 -- 172.21.15.46:0/1469818423 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0011990 con 0x7f3dd00b8ad0 2023-05-21T16:54:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dcf7fe700 1 -- 172.21.15.46:0/1469818423 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011d40 con 0x7f3dd00b8ad0 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 -- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b8ad0 msgr2=0x7f3dd00cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b8ad0 0x7f3dd00cf310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009850 tx=0x7f3dc0009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 -- 172.21.15.46:0/1469818423 shutdown_connections 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b4910 0x7f3dd00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1469818423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b8ad0 0x7f3dd00cf310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 -- 172.21.15.46:0/1469818423 >> 172.21.15.46:0/1469818423 conn(0x7f3dd00d3ae0 msgr2=0x7f3dd00cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 -- 172.21.15.46:0/1469818423 shutdown_connections 2023-05-21T16:54:53.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 -- 172.21.15.46:0/1469818423 wait complete. 2023-05-21T16:54:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 Processor -- start 2023-05-21T16:54:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.476+0000 7f3dd5220700 1 -- start start 2023-05-21T16:54:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b4910 0x7f3dd015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 0x7f3dd006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b8ad0 0x7f3dd006c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd014cbd0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd014c8f0 con 0x7f3dd00b4910 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd015c1c0 con 0x7f3dd00b8ad0 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 0x7f3dd006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 0x7f3dd006bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52920/0 (socket says 172.21.15.46:52920) 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 -- 172.21.15.46:0/1984953558 learned_addr learned my addr 172.21.15.46:0/1984953558 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd4a1f700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b8ad0 0x7f3dd006c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dcffff700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b4910 0x7f3dd015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 -- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b8ad0 msgr2=0x7f3dd006c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b8ad0 0x7f3dd006c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 -- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b4910 msgr2=0x7f3dd015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b4910 0x7f3dd015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 -- 172.21.15.46:0/1984953558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00094b0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd4a1f700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b8ad0 0x7f3dd006c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:53.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dc7fff700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 0x7f3dd006bee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c4d0 tx=0x7f3db800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8005d90 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db80070d0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00cd790 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8007480 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00cd4f0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00cda70 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.480+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3db80075e0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.484+0000 7f3dcd7fa700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3db00662f0 0x7f3db00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.484+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3db8083340 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.484+0000 7f3dcffff700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3db00662f0 0x7f3db00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.484+0000 7f3dcffff700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3db00662f0 0x7f3db00687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009ba0 tx=0x7f3dc0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.492+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3db8050720 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.648+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dd00733b0 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dcd7fa700 1 -- 172.21.15.46:0/1984953558 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3db8053d40 con 0x7f3dd00b5ce0 2023-05-21T16:54:53.657 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3db00662f0 msgr2=0x7f3db00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3db00662f0 0x7f3db00687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009ba0 tx=0x7f3dc0008030 comp rx=0 tx=0).stop 2023-05-21T16:54:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 msgr2=0x7f3dd006bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 0x7f3dd006bee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c4d0 tx=0x7f3db800c890 comp rx=0 tx=0).stop 2023-05-21T16:54:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 shutdown_connections 2023-05-21T16:54:53.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f3db00662f0 0x7f3db00687a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dd00b8ad0 0x7f3dd006c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dd00b5ce0 0x7f3dd006bee0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 --2- 172.21.15.46:0/1984953558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dd00b4910 0x7f3dd015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 >> 172.21.15.46:0/1984953558 conn(0x7f3dd00d3ae0 msgr2=0x7f3dd00b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 shutdown_connections 2023-05-21T16:54:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.652+0000 7f3dd5220700 1 -- 172.21.15.46:0/1984953558 wait complete. 2023-05-21T16:54:53.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:54:53.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 Processor -- start 2023-05-21T16:54:53.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 -- start start 2023-05-21T16:54:53.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b815a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2b815dbb0 0x7fe2b806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe2b8069f80 0x7fe2b806a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b806b9d0 con 0x7fe2b8069f80 2023-05-21T16:54:53.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b806b450 con 0x7fe2b815dbb0 2023-05-21T16:54:53.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8159a90 con 0x7fe2b806c760 2023-05-21T16:54:53.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe2b8069f80 0x7fe2b806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe2b8069f80 0x7fe2b806a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52926/0 (socket says 172.21.15.46:52926) 2023-05-21T16:54:53.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 -- 172.21.15.46:0/2889727824 learned_addr learned my addr 172.21.15.46:0/2889727824 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:53.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b6ffd700 1 --2- 172.21.15.46:0/2889727824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b67fc700 1 --2- 172.21.15.46:0/2889727824 >> v2:172.21.15.142:3300/0 conn(0x7fe2b815dbb0 0x7fe2b806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 -- 172.21.15.46:0/2889727824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 msgr2=0x7fe2b815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:53.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 --2- 172.21.15.46:0/2889727824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 -- 172.21.15.46:0/2889727824 >> v2:172.21.15.142:3300/0 conn(0x7fe2b815dbb0 msgr2=0x7fe2b806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:53.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 --2- 172.21.15.46:0/2889727824 >> v2:172.21.15.142:3300/0 conn(0x7fe2b815dbb0 0x7fe2b806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 -- 172.21.15.46:0/2889727824 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b806d070 con 0x7fe2b8069f80 2023-05-21T16:54:53.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b67fc700 1 --2- 172.21.15.46:0/2889727824 >> v2:172.21.15.142:3300/0 conn(0x7fe2b815dbb0 0x7fe2b806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:53.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b77fe700 1 --2- 172.21.15.46:0/2889727824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b8069f80 0x7fe2b806a400 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2b806eba0 tx=0x7fe2b000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72563ff52faa9958 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b5ffb700 1 -- 172.21.15.46:0/2889727824 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0010070 con 0x7fe2b8069f80 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b5ffb700 1 -- 172.21.15.46:0/2889727824 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000dd90 con 0x7fe2b8069f80 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b5ffb700 1 -- 172.21.15.46:0/2889727824 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000b310 con 0x7fe2b8069f80 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 -- 172.21.15.46:0/2889727824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b8069f80 msgr2=0x7fe2b806a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.784+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/2889727824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b8069f80 0x7fe2b806a400 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2b806eba0 tx=0x7fe2b000d430 comp rx=0 tx=0).stop 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- 172.21.15.46:0/2889727824 shutdown_connections 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/2889727824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b8069f80 0x7fe2b806a400 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/2889727824 >> v2:172.21.15.142:3300/0 conn(0x7fe2b815dbb0 0x7fe2b806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/2889727824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- 172.21.15.46:0/2889727824 >> 172.21.15.46:0/2889727824 conn(0x7fe2b80cf720 msgr2=0x7fe2b80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- 172.21.15.46:0/2889727824 shutdown_connections 2023-05-21T16:54:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- 172.21.15.46:0/2889727824 wait complete. 2023-05-21T16:54:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 Processor -- start 2023-05-21T16:54:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- start start 2023-05-21T16:54:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2b8069f80 0x7fe2b81490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b80b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 0x7fe2b8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80c2a60 con 0x7fe2b815dbb0 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8149620 con 0x7fe2b8069f80 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b815bd30 con 0x7fe2b806c760 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 0x7fe2b8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 0x7fe2b8156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52932/0 (socket says 172.21.15.46:52932) 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b77fe700 1 -- 172.21.15.46:0/3097118972 learned_addr learned my addr 172.21.15.46:0/3097118972 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b6ffd700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2b8069f80 0x7fe2b81490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.788+0000 7fe2b67fc700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b77fe700 1 -- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 msgr2=0x7fe2b80b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b77fe700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b80b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b77fe700 1 -- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2b8069f80 msgr2=0x7fe2b81490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b77fe700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2b8069f80 0x7fe2b81490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b77fe700 1 -- 172.21.15.46:0/3097118972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b000bd40 con 0x7fe2b815dbb0 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b77fe700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 0x7fe2b8156b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8071960 tx=0x7fe2b0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000bbc0 con 0x7fe2b815dbb0 2023-05-21T16:54:53.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b0009810 con 0x7fe2b815dbb0 2023-05-21T16:54:53.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b8159d50 con 0x7fe2b815dbb0 2023-05-21T16:54:53.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0009ba0 con 0x7fe2b815dbb0 2023-05-21T16:54:53.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b806b6f0 con 0x7fe2b815dbb0 2023-05-21T16:54:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2b0009d00 con 0x7fe2b815dbb0 2023-05-21T16:54:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b815a030 con 0x7fe2b815dbb0 2023-05-21T16:54:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe29f7fe700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2a40662f0 0x7fe2a40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.792+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2b0087610 con 0x7fe2b815dbb0 2023-05-21T16:54:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.796+0000 7fe2b6ffd700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2a40662f0 0x7fe2a40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.796+0000 7fe2b6ffd700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2a40662f0 0x7fe2a40687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009970 tx=0x7fe2ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.800+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe2b0054b20 con 0x7fe2b815dbb0 2023-05-21T16:54:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.976+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe2b806b230 con 0x7fe2b815dbb0 2023-05-21T16:54:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.976+0000 7fe29f7fe700 1 -- 172.21.15.46:0/3097118972 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe2b0058140 con 0x7fe2b815dbb0 2023-05-21T16:54:53.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2a40662f0 msgr2=0x7fe2a40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2a40662f0 0x7fe2a40687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009970 tx=0x7fe2ac008040 comp rx=0 tx=0).stop 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 msgr2=0x7fe2b8156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 0x7fe2b8156b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8071960 tx=0x7fe2b0004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 shutdown_connections 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2a40662f0 0x7fe2a40687a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2b815dbb0 0x7fe2b8156b70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2b806c760 0x7fe2b80b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 --2- 172.21.15.46:0/3097118972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2b8069f80 0x7fe2b81490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 >> 172.21.15.46:0/3097118972 conn(0x7fe2b80cf720 msgr2=0x7fe2b80ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 shutdown_connections 2023-05-21T16:54:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:53.980+0000 7fe2b7fff700 1 -- 172.21.15.46:0/3097118972 wait complete. 2023-05-21T16:54:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:54:53.997 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2023-05-21T16:54:53.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:53.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-21T16:54:54.017 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:54:54.018 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:54:54.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:54.018 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-21T16:54:54.071 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:54:54.071 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:54.079 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:54:54.079 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:54.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 Processor -- start 2023-05-21T16:54:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 -- start start 2023-05-21T16:54:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d5415d460 0x7f6d54070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6d54070ad0 0x7f6d540ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d54159df0 con 0x7f6d54158d90 2023-05-21T16:54:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5415a280 con 0x7f6d54070ad0 2023-05-21T16:54:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d59244700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d54070f10 con 0x7f6d5415d460 2023-05-21T16:54:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6d54070ad0 0x7f6d540ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6d54070ad0 0x7f6d540ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52934/0 (socket says 172.21.15.46:52934) 2023-05-21T16:54:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 -- 172.21.15.46:0/3152251812 learned_addr learned my addr 172.21.15.46:0/3152251812 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d537fe700 1 --2- 172.21.15.46:0/3152251812 >> v2:172.21.15.142:3300/0 conn(0x7f6d5415d460 0x7f6d54070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 -- 172.21.15.46:0/3152251812 >> v2:172.21.15.142:3300/0 conn(0x7f6d5415d460 msgr2=0x7f6d54070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 --2- 172.21.15.46:0/3152251812 >> v2:172.21.15.142:3300/0 conn(0x7f6d5415d460 0x7f6d54070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 -- 172.21.15.46:0/3152251812 >> v1:172.21.15.46:6789/0 conn(0x7f6d54158d90 legacy=0x7f6d540ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 -- 172.21.15.46:0/3152251812 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540cd730 con 0x7f6d54070ad0 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d58a43700 1 --2- 172.21.15.46:0/3152251812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54070ad0 0x7f6d540ca580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d5406ba20 tx=0x7f6d4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35f8b325ddc2b58 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d52ffd700 1 -- 172.21.15.46:0/3152251812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00b8a0 con 0x7f6d54070ad0 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d52ffd700 1 -- 172.21.15.46:0/3152251812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c00ba00 con 0x7f6d54070ad0 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.244+0000 7f6d52ffd700 1 -- 172.21.15.46:0/3152251812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00bd90 con 0x7f6d54070ad0 2023-05-21T16:54:54.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- 172.21.15.46:0/3152251812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54070ad0 msgr2=0x7f6d540ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 --2- 172.21.15.46:0/3152251812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54070ad0 0x7f6d540ca580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d5406ba20 tx=0x7f6d4c009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- 172.21.15.46:0/3152251812 shutdown_connections 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 --2- 172.21.15.46:0/3152251812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54070ad0 0x7f6d540ca580 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 --2- 172.21.15.46:0/3152251812 >> v2:172.21.15.142:3300/0 conn(0x7f6d5415d460 0x7f6d54070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- 172.21.15.46:0/3152251812 >> 172.21.15.46:0/3152251812 conn(0x7f6d540cf720 msgr2=0x7f6d540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- 172.21.15.46:0/3152251812 shutdown_connections 2023-05-21T16:54:54.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- 172.21.15.46:0/3152251812 wait complete. 2023-05-21T16:54:54.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 Processor -- start 2023-05-21T16:54:54.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- start start 2023-05-21T16:54:54.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d54070ad0 0x7f6d54146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 0x7f6d540c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5415d460 0x7f6d540c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540c2880 con 0x7f6d54158d90 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540c2a90 con 0x7f6d5415d460 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d59244700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540c2d70 con 0x7f6d54070ad0 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 0x7f6d540c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 0x7f6d540c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52944/0 (socket says 172.21.15.46:52944) 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 -- 172.21.15.46:0/1387929431 learned_addr learned my addr 172.21.15.46:0/1387929431 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d53fff700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d54070ad0 0x7f6d54146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d58a43700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5415d460 0x7f6d540c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 -- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d54070ad0 msgr2=0x7f6d54146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d54070ad0 0x7f6d54146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 -- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5415d460 msgr2=0x7f6d540c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5415d460 0x7f6d540c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.248+0000 7f6d537fe700 1 -- 172.21.15.46:0/1387929431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c009570 con 0x7f6d54158d90 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d537fe700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 0x7f6d540c9430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d44007e40 tx=0x7f6d4400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400eea0 con 0x7f6d54158d90 2023-05-21T16:54:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d44014420 con 0x7f6d54158d90 2023-05-21T16:54:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d541597a0 con 0x7f6d54158d90 2023-05-21T16:54:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440147d0 con 0x7f6d54158d90 2023-05-21T16:54:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d541594c0 con 0x7f6d54158d90 2023-05-21T16:54:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d44014930 con 0x7f6d54158d90 2023-05-21T16:54:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d54159a80 con 0x7f6d54158d90 2023-05-21T16:54:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d50ff9700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d400662f0 0x7f6d400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d440845d0 con 0x7f6d54158d90 2023-05-21T16:54:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.252+0000 7f6d53fff700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d400662f0 0x7f6d400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.256+0000 7f6d53fff700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d400662f0 0x7f6d400687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6d480016e0 tx=0x7f6d48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.260+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6d440519e0 con 0x7f6d54158d90 2023-05-21T16:54:54.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.424+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d540733b0 con 0x7f6d54158d90 2023-05-21T16:54:54.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.428+0000 7f6d50ff9700 1 -- 172.21.15.46:0/1387929431 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f6d44055000 con 0x7f6d54158d90 2023-05-21T16:54:54.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:54.435 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d400662f0 msgr2=0x7f6d400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d400662f0 0x7f6d400687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6d480016e0 tx=0x7f6d48009040 comp rx=0 tx=0).stop 2023-05-21T16:54:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 msgr2=0x7f6d540c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 0x7f6d540c9430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d44007e40 tx=0x7f6d4400e3c0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 shutdown_connections 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6d400662f0 0x7f6d400687a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d5415d460 0x7f6d540c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d54158d90 0x7f6d540c9430 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 --2- 172.21.15.46:0/1387929431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d54070ad0 0x7f6d54146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 >> 172.21.15.46:0/1387929431 conn(0x7f6d540cf720 msgr2=0x7f6d540cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 shutdown_connections 2023-05-21T16:54:54.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.432+0000 7f6d59244700 1 -- 172.21.15.46:0/1387929431 wait complete. 2023-05-21T16:54:54.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:54.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:54.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.568+0000 7f117f227700 1 Processor -- start 2023-05-21T16:54:54.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.568+0000 7f117f227700 1 -- start start 2023-05-21T16:54:54.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.568+0000 7f117f227700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11780b8ad0 0x7f11780cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.568+0000 7f117f227700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11780b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.568+0000 7f117f227700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11780b8ea0 con 0x7f11780b5ce0 2023-05-21T16:54:54.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.568+0000 7f117f227700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11780b52f0 con 0x7f11780b8ad0 2023-05-21T16:54:54.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11780d09d0 con 0x7f11780b4910 2023-05-21T16:54:54.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117da24700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f11780b5ce0 0x7f117806a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39634/0 (socket says 172.21.15.46:39634) 2023-05-21T16:54:54.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117da24700 1 -- 172.21.15.46:0/1086710408 learned_addr learned my addr 172.21.15.46:0/1086710408 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117ea26700 1 --2- 172.21.15.46:0/1086710408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11780b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117e225700 1 --2- 172.21.15.46:0/1086710408 >> v2:172.21.15.142:3300/0 conn(0x7f11780b8ad0 0x7f11780cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117d223700 1 -- 172.21.15.46:0/1086710408 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423319739 0 0) 0x7f11780b8ea0 con 0x7f11780b5ce0 2023-05-21T16:54:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117d223700 1 -- 172.21.15.46:0/1086710408 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11640035d0 con 0x7f11780b5ce0 2023-05-21T16:54:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117ea26700 1 -- 172.21.15.46:0/1086710408 >> v2:172.21.15.142:3300/0 conn(0x7f11780b8ad0 msgr2=0x7f11780cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117ea26700 1 --2- 172.21.15.46:0/1086710408 >> v2:172.21.15.142:3300/0 conn(0x7f11780b8ad0 0x7f11780cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117ea26700 1 -- 172.21.15.46:0/1086710408 >> v1:172.21.15.46:6789/0 conn(0x7f11780b5ce0 legacy=0x7f117806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117ea26700 1 -- 172.21.15.46:0/1086710408 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780d0cb0 con 0x7f11780b4910 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117ea26700 1 --2- 172.21.15.46:0/1086710408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11780b4db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d90 tx=0x7f117000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea00a415f82a7286 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117d223700 1 -- 172.21.15.46:0/1086710408 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000e070 con 0x7f11780b4910 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117d223700 1 -- 172.21.15.46:0/1086710408 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000bb20 con 0x7f11780b4910 2023-05-21T16:54:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117d223700 1 -- 172.21.15.46:0/1086710408 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000be90 con 0x7f11780b4910 2023-05-21T16:54:54.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 -- 172.21.15.46:0/1086710408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 msgr2=0x7f11780b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 --2- 172.21.15.46:0/1086710408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11780b4db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d90 tx=0x7f117000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:54.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 -- 172.21.15.46:0/1086710408 shutdown_connections 2023-05-21T16:54:54.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 --2- 172.21.15.46:0/1086710408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11780b4db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 --2- 172.21.15.46:0/1086710408 >> v2:172.21.15.142:3300/0 conn(0x7f11780b8ad0 0x7f11780cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 -- 172.21.15.46:0/1086710408 >> 172.21.15.46:0/1086710408 conn(0x7f11780d3ae0 msgr2=0x7f11780cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:54.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 -- 172.21.15.46:0/1086710408 shutdown_connections 2023-05-21T16:54:54.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.572+0000 7f117f227700 1 -- 172.21.15.46:0/1086710408 wait complete. 2023-05-21T16:54:54.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 Processor -- start 2023-05-21T16:54:54.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 -- start start 2023-05-21T16:54:54.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11781f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 0x7f117815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11780b8ad0 0x7f11780aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117815e060 con 0x7f11780b5ce0 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117815e340 con 0x7f11780b8ad0 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117f227700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117815e620 con 0x7f11780b4910 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117da24700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 0x7f117815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117da24700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 0x7f117815a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55760/0 (socket says 172.21.15.46:55760) 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117da24700 1 -- 172.21.15.46:0/936096900 learned_addr learned my addr 172.21.15.46:0/936096900 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117e225700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11781f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.576+0000 7f117ea26700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11780b8ad0 0x7f11780aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117da24700 1 -- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 msgr2=0x7f11781f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117da24700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11781f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117da24700 1 -- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11780b8ad0 msgr2=0x7f11780aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117da24700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11780b8ad0 0x7f11780aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117da24700 1 -- 172.21.15.46:0/936096900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170009a70 con 0x7f11780b5ce0 2023-05-21T16:54:54.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117da24700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 0x7f117815a9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f116800c4d0 tx=0x7f116800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168005d90 con 0x7f11780b5ce0 2023-05-21T16:54:54.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680070d0 con 0x7f11780b5ce0 2023-05-21T16:54:54.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11780cd790 con 0x7f11780b5ce0 2023-05-21T16:54:54.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168007480 con 0x7f11780b5ce0 2023-05-21T16:54:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11780cd4f0 con 0x7f11780b5ce0 2023-05-21T16:54:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11780cda70 con 0x7f11780b5ce0 2023-05-21T16:54:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11680075e0 con 0x7f11780b5ce0 2023-05-21T16:54:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f116effd700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f115c0662f0 0x7f115c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11680832a0 con 0x7f11780b5ce0 2023-05-21T16:54:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.580+0000 7f117e225700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f115c0662f0 0x7f115c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.584+0000 7f117e225700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f115c0662f0 0x7f115c0687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1174009ae0 tx=0x7f1174008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.588+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1168050720 con 0x7f11780b5ce0 2023-05-21T16:54:54.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.752+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11780733b0 con 0x7f11780b5ce0 2023-05-21T16:54:54.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.752+0000 7f116effd700 1 -- 172.21.15.46:0/936096900 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1168053d40 con 0x7f11780b5ce0 2023-05-21T16:54:54.760 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:54.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f115c0662f0 msgr2=0x7f115c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f115c0662f0 0x7f115c0687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1174009ae0 tx=0x7f1174008040 comp rx=0 tx=0).stop 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 msgr2=0x7f117815a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 0x7f117815a9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f116800c4d0 tx=0x7f116800c890 comp rx=0 tx=0).stop 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 shutdown_connections 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f115c0662f0 0x7f115c0687a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11780b8ad0 0x7f11780aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11780b5ce0 0x7f117815a9f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 --2- 172.21.15.46:0/936096900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11780b4910 0x7f11781f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 >> 172.21.15.46:0/936096900 conn(0x7f11780d3ae0 msgr2=0x7f11780cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 shutdown_connections 2023-05-21T16:54:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.756+0000 7f117f227700 1 -- 172.21.15.46:0/936096900 wait complete. 2023-05-21T16:54:54.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 Processor -- start 2023-05-21T16:54:54.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 -- start start 2023-05-21T16:54:54.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f733415d460 0x7f7334070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7334070ad0 0x7f73340ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334159df0 con 0x7f7334158d90 2023-05-21T16:54:54.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733415a280 con 0x7f733415d460 2023-05-21T16:54:54.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.892+0000 7f733a89e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7334070f10 con 0x7f7334070ad0 2023-05-21T16:54:54.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f733415d460 0x7f7334070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f733415d460 0x7f7334070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55766/0 (socket says 172.21.15.46:55766) 2023-05-21T16:54:54.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 -- 172.21.15.46:0/3842717825 learned_addr learned my addr 172.21.15.46:0/3842717825 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:54.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a09d700 1 --2- 172.21.15.46:0/3842717825 >> v2:172.21.15.142:3300/0 conn(0x7f7334070ad0 0x7f73340ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 -- 172.21.15.46:0/3842717825 >> v2:172.21.15.142:3300/0 conn(0x7f7334070ad0 msgr2=0x7f73340ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:54.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 --2- 172.21.15.46:0/3842717825 >> v2:172.21.15.142:3300/0 conn(0x7f7334070ad0 0x7f73340ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 -- 172.21.15.46:0/3842717825 >> v1:172.21.15.142:6789/0 conn(0x7f7334158d90 legacy=0x7f73340ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 -- 172.21.15.46:0/3842717825 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73340cd730 con 0x7f733415d460 2023-05-21T16:54:54.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733909b700 1 --2- 172.21.15.46:0/3842717825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f733415d460 0x7f7334070590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7334159d60 tx=0x7f7324009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1426cdb7b214cf server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733889a700 1 -- 172.21.15.46:0/3842717825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732400b8a0 con 0x7f733415d460 2023-05-21T16:54:54.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733889a700 1 -- 172.21.15.46:0/3842717825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732400ba00 con 0x7f733415d460 2023-05-21T16:54:54.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733889a700 1 -- 172.21.15.46:0/3842717825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732400bd90 con 0x7f733415d460 2023-05-21T16:54:54.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 -- 172.21.15.46:0/3842717825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f733415d460 msgr2=0x7f7334070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 --2- 172.21.15.46:0/3842717825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f733415d460 0x7f7334070590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7334159d60 tx=0x7f7324009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 -- 172.21.15.46:0/3842717825 shutdown_connections 2023-05-21T16:54:54.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 --2- 172.21.15.46:0/3842717825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f733415d460 0x7f7334070590 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 --2- 172.21.15.46:0/3842717825 >> v2:172.21.15.142:3300/0 conn(0x7f7334070ad0 0x7f73340ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 -- 172.21.15.46:0/3842717825 >> 172.21.15.46:0/3842717825 conn(0x7f73340cf720 msgr2=0x7f73340cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:54.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 -- 172.21.15.46:0/3842717825 shutdown_connections 2023-05-21T16:54:54.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.896+0000 7f733a89e700 1 -- 172.21.15.46:0/3842717825 wait complete. 2023-05-21T16:54:54.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 Processor -- start 2023-05-21T16:54:54.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 -- start start 2023-05-21T16:54:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7334070ad0 0x7f73340afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 0x7f7334151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f733415d460 0x7f73340b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340c6f80 con 0x7f7334158d90 2023-05-21T16:54:54.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7334152030 con 0x7f7334070ad0 2023-05-21T16:54:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a89e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73341f05b0 con 0x7f733415d460 2023-05-21T16:54:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733909b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 0x7f7334151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733909b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 0x7f7334151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55770/0 (socket says 172.21.15.46:55770) 2023-05-21T16:54:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733909b700 1 -- 172.21.15.46:0/2092690718 learned_addr learned my addr 172.21.15.46:0/2092690718 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733a09d700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f733415d460 0x7f73340b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.900+0000 7f733989c700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7334070ad0 0x7f73340afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733909b700 1 -- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f733415d460 msgr2=0x7f73340b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733909b700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f733415d460 0x7f73340b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733909b700 1 -- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7334070ad0 msgr2=0x7f73340afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733909b700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7334070ad0 0x7f73340afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733909b700 1 -- 172.21.15.46:0/2092690718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324009570 con 0x7f7334158d90 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733989c700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7334070ad0 0x7f73340afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733909b700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 0x7f7334151af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7324000c00 tx=0x7f7324004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73240038c0 con 0x7f7334158d90 2023-05-21T16:54:54.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324003a20 con 0x7f7334158d90 2023-05-21T16:54:54.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73341597a0 con 0x7f7334158d90 2023-05-21T16:54:54.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324003db0 con 0x7f7334158d90 2023-05-21T16:54:54.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73341594c0 con 0x7f7334158d90 2023-05-21T16:54:54.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334159a80 con 0x7f7334158d90 2023-05-21T16:54:54.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7324011420 con 0x7f7334158d90 2023-05-21T16:54:54.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f73327fc700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73200662f0 0x7f73200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:54.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7324020030 con 0x7f7334158d90 2023-05-21T16:54:54.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.904+0000 7f733989c700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73200662f0 0x7f73200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:54.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.908+0000 7f733989c700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73200662f0 0x7f73200687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f73280017a0 tx=0x7f7328009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:54.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:54.916+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f73240526a0 con 0x7f7334158d90 2023-05-21T16:54:55.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.076+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73340733b0 con 0x7f7334158d90 2023-05-21T16:54:55.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.076+0000 7f73327fc700 1 -- 172.21.15.46:0/2092690718 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7324055cc0 con 0x7f7334158d90 2023-05-21T16:54:55.084 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:55.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73200662f0 msgr2=0x7f73200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73200662f0 0x7f73200687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f73280017a0 tx=0x7f7328009040 comp rx=0 tx=0).stop 2023-05-21T16:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 msgr2=0x7f7334151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 0x7f7334151af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7324000c00 tx=0x7f7324004770 comp rx=0 tx=0).stop 2023-05-21T16:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 shutdown_connections 2023-05-21T16:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73200662f0 0x7f73200687a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f733415d460 0x7f73340b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7334158d90 0x7f7334151af0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 --2- 172.21.15.46:0/2092690718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7334070ad0 0x7f73340afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 >> 172.21.15.46:0/2092690718 conn(0x7f73340cf720 msgr2=0x7f733406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:55.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 shutdown_connections 2023-05-21T16:54:55.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.080+0000 7f733a89e700 1 -- 172.21.15.46:0/2092690718 wait complete. 2023-05-21T16:54:55.098 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.208+0000 7f1046529700 1 Processor -- start 2023-05-21T16:54:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.208+0000 7f1046529700 1 -- start start 2023-05-21T16:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f104006c760 0x7f104015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104006b9d0 con 0x7f104015dbb0 2023-05-21T16:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104006b450 con 0x7f10400c9cd0 2023-05-21T16:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1040159a90 con 0x7f104006c760 2023-05-21T16:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f104015dbb0 0x7f104006cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39644/0 (socket says 172.21.15.46:39644) 2023-05-21T16:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 -- 172.21.15.46:0/4180869451 learned_addr learned my addr 172.21.15.46:0/4180869451 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1045527700 1 --2- 172.21.15.46:0/4180869451 >> v2:172.21.15.142:3300/0 conn(0x7f104006c760 0x7f104015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409764583 0 0) 0x7f104006b9d0 con 0x7f104015dbb0 2023-05-21T16:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f102c0035d0 con 0x7f104015dbb0 2023-05-21T16:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282181449 0 0) 0x7f104006b450 con 0x7f10400c9cd0 2023-05-21T16:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104006b9d0 con 0x7f10400c9cd0 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3860330246 0 0) 0x7f102c0035d0 con 0x7f104015dbb0 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 >> v2:172.21.15.142:3300/0 conn(0x7f104006c760 msgr2=0x7f104015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 --2- 172.21.15.46:0/4180869451 >> v2:172.21.15.142:3300/0 conn(0x7f104006c760 0x7f104015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 >> v1:172.21.15.142:6789/0 conn(0x7f10400c9cd0 legacy=0x7f10400ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104006b6f0 con 0x7f104015dbb0 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f103c001670 con 0x7f104015dbb0 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 >> v1:172.21.15.46:6789/0 conn(0x7f104015dbb0 legacy=0x7f104006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102c003c00 0x7f102c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f102c004870 0x7f102c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f102c005270 0x7f102c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040159a90 con 0x7f102c004870 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c00e390 con 0x7f102c005270 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c00e550 con 0x7f102c003c00 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f102c004870 0x7f102c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1045527700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102c003c00 0x7f102c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1045d28700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f102c005270 0x7f102c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 -- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102c003c00 msgr2=0x7f102c003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102c003c00 0x7f102c003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 -- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f102c005270 msgr2=0x7f102c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f102c005270 0x7f102c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1045d28700 1 -- 172.21.15.46:0/4180869451 reap_dead start 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 -- 172.21.15.46:0/4180869451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0035d0 con 0x7f102c004870 2023-05-21T16:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1044d26700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f102c004870 0x7f102c004ce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f103c001eb0 tx=0x7f102c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2350e54b9ab891d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c00cc30 con 0x7f102c004870 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c00cd90 con 0x7f102c004870 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1037fff700 1 -- 172.21.15.46:0/4180869451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c005ba0 con 0x7f102c004870 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- 172.21.15.46:0/4180869451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f102c004870 msgr2=0x7f102c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f102c004870 0x7f102c004ce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f103c001eb0 tx=0x7f102c0058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- 172.21.15.46:0/4180869451 shutdown_connections 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 --2- 172.21.15.46:0/4180869451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f102c004870 0x7f102c004ce0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- 172.21.15.46:0/4180869451 >> 172.21.15.46:0/4180869451 conn(0x7f10400cf720 msgr2=0x7f10400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- 172.21.15.46:0/4180869451 shutdown_connections 2023-05-21T16:54:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.212+0000 7f1046529700 1 -- 172.21.15.46:0/4180869451 wait complete. 2023-05-21T16:54:55.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 Processor -- start 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 -- start start 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 0x7f10400c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10400c82e0 0x7f104015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f104014ac60 0x7f104014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400c48e0 con 0x7f10400c7f10 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104014b610 con 0x7f10400c82e0 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10401585e0 con 0x7f104014ac60 2023-05-21T16:54:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 0x7f10400c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 0x7f10400c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55796/0 (socket says 172.21.15.46:55796) 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 -- 172.21.15.46:0/524301375 learned_addr learned my addr 172.21.15.46:0/524301375 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1044d26700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10400c82e0 0x7f104015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045d28700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f104014ac60 0x7f104014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 -- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f104014ac60 msgr2=0x7f104014b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f104014ac60 0x7f104014b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 -- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10400c82e0 msgr2=0x7f104015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10400c82e0 0x7f104015a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 -- 172.21.15.46:0/524301375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104015a030 con 0x7f10400c7f10 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045d28700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f104014ac60 0x7f104014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1045527700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 0x7f10400c4d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f10300115d0 tx=0x7f10300118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030015870 con 0x7f10400c7f10 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10300159d0 con 0x7f10400c7f10 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030015d40 con 0x7f10400c7f10 2023-05-21T16:54:55.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1040159d50 con 0x7f10400c7f10 2023-05-21T16:54:55.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.216+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104015a310 con 0x7f10400c7f10 2023-05-21T16:54:55.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.220+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10400733b0 con 0x7f10400c7f10 2023-05-21T16:54:55.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.220+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1030013400 con 0x7f10400c7f10 2023-05-21T16:54:55.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.220+0000 7f1035ffb700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f10240662f0 0x7f10240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.220+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1030083ef0 con 0x7f10400c7f10 2023-05-21T16:54:55.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.220+0000 7f1044d26700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f10240662f0 0x7f10240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.224+0000 7f1044d26700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f10240662f0 0x7f10240687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1040061b20 tx=0x7f103c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.228+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1030051360 con 0x7f10400c7f10 2023-05-21T16:54:55.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.392+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f104015d990 con 0x7f10400c7f10 2023-05-21T16:54:55.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.392+0000 7f1035ffb700 1 -- 172.21.15.46:0/524301375 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1030054980 con 0x7f10400c7f10 2023-05-21T16:54:55.399 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f10240662f0 msgr2=0x7f10240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f10240662f0 0x7f10240687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1040061b20 tx=0x7f103c007000 comp rx=0 tx=0).stop 2023-05-21T16:54:55.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 msgr2=0x7f10400c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 0x7f10400c4d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f10300115d0 tx=0x7f10300118e0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 shutdown_connections 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f10240662f0 0x7f10240687a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f104014ac60 0x7f104014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10400c82e0 0x7f104015a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 --2- 172.21.15.46:0/524301375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10400c7f10 0x7f10400c4d00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 >> 172.21.15.46:0/524301375 conn(0x7f10400cf720 msgr2=0x7f10400ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:55.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 shutdown_connections 2023-05-21T16:54:55.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.396+0000 7f1046529700 1 -- 172.21.15.46:0/524301375 wait complete. 2023-05-21T16:54:55.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.524+0000 7fe18737f700 1 Processor -- start 2023-05-21T16:54:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.524+0000 7fe18737f700 1 -- start start 2023-05-21T16:54:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.524+0000 7fe18737f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe18015acd0 0x7fe180070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.524+0000 7fe18737f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1800ae260 con 0x7fe1800cae30 2023-05-21T16:54:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.524+0000 7fe18737f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18015b470 con 0x7fe1800ade90 2023-05-21T16:54:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.524+0000 7fe18737f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18015bd10 con 0x7fe18015acd0 2023-05-21T16:54:55.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe185b7c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe1800cae30 0x7fe18006ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39648/0 (socket says 172.21.15.46:39648) 2023-05-21T16:54:55.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe185b7c700 1 -- 172.21.15.46:0/912180933 learned_addr learned my addr 172.21.15.46:0/912180933 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:55.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe186b7e700 1 --2- 172.21.15.46:0/912180933 >> v2:172.21.15.142:3300/0 conn(0x7fe18015acd0 0x7fe180070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18537b700 1 -- 172.21.15.46:0/912180933 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211024238 0 0) 0x7fe1800ae260 con 0x7fe1800cae30 2023-05-21T16:54:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18537b700 1 -- 172.21.15.46:0/912180933 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c0035d0 con 0x7fe1800cae30 2023-05-21T16:54:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe186b7e700 1 -- 172.21.15.46:0/912180933 >> v1:172.21.15.142:6789/0 conn(0x7fe1800ade90 legacy=0x7fe180069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18537b700 1 -- 172.21.15.46:0/912180933 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440660227 0 0) 0x7fe18015b470 con 0x7fe1800ade90 2023-05-21T16:54:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe186b7e700 1 -- 172.21.15.46:0/912180933 >> v1:172.21.15.46:6789/0 conn(0x7fe1800cae30 legacy=0x7fe18006ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe186b7e700 1 -- 172.21.15.46:0/912180933 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18015b750 con 0x7fe18015acd0 2023-05-21T16:54:55.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe186b7e700 1 --2- 172.21.15.46:0/912180933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18015acd0 0x7fe180070590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe178009d90 tx=0x7fe17800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c945d7cceecf15 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18537b700 1 -- 172.21.15.46:0/912180933 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800e070 con 0x7fe18015acd0 2023-05-21T16:54:55.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18537b700 1 -- 172.21.15.46:0/912180933 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800bb20 con 0x7fe18015acd0 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18537b700 1 -- 172.21.15.46:0/912180933 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800bed0 con 0x7fe18015acd0 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 -- 172.21.15.46:0/912180933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18015acd0 msgr2=0x7fe180070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 --2- 172.21.15.46:0/912180933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18015acd0 0x7fe180070590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe178009d90 tx=0x7fe17800b330 comp rx=0 tx=0).stop 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 -- 172.21.15.46:0/912180933 shutdown_connections 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 --2- 172.21.15.46:0/912180933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe18015acd0 0x7fe180070590 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 -- 172.21.15.46:0/912180933 >> 172.21.15.46:0/912180933 conn(0x7fe1800cf720 msgr2=0x7fe1800cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 -- 172.21.15.46:0/912180933 shutdown_connections 2023-05-21T16:54:55.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.528+0000 7fe18737f700 1 -- 172.21.15.46:0/912180933 wait complete. 2023-05-21T16:54:55.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 Processor -- start 2023-05-21T16:54:55.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 -- start start 2023-05-21T16:54:55.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1800ade90 0x7fe18014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1800cae30 0x7fe1800c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 0x7fe1800b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c4290 con 0x7fe18015acd0 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c3960 con 0x7fe1800ade90 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18737f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c3c40 con 0x7fe1800cae30 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe186b7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 0x7fe1800b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe186b7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 0x7fe1800b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55810/0 (socket says 172.21.15.46:55810) 2023-05-21T16:54:55.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe186b7e700 1 -- 172.21.15.46:0/65774930 learned_addr learned my addr 172.21.15.46:0/65774930 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:55.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe18637d700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1800ade90 0x7fe18014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe185b7c700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1800cae30 0x7fe1800c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe186b7e700 1 -- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1800cae30 msgr2=0x7fe1800c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.532+0000 7fe186b7e700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1800cae30 0x7fe1800c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe186b7e700 1 -- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1800ade90 msgr2=0x7fe18014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe186b7e700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1800ade90 0x7fe18014d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe186b7e700 1 -- 172.21.15.46:0/65774930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009a70 con 0x7fe18015acd0 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe185b7c700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1800cae30 0x7fe1800c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe186b7e700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 0x7fe1800b3ab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe178014040 tx=0x7fe178004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17801b810 con 0x7fe18015acd0 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178020070 con 0x7fe18015acd0 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18006c8e0 con 0x7fe18015acd0 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17801bbb0 con 0x7fe18015acd0 2023-05-21T16:54:55.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18015ba30 con 0x7fe18015acd0 2023-05-21T16:54:55.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800cb2b0 con 0x7fe18015acd0 2023-05-21T16:54:55.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe17801bd10 con 0x7fe18015acd0 2023-05-21T16:54:55.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe176ffd700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe164066320 0x7fe1640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe178022070 con 0x7fe18015acd0 2023-05-21T16:54:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe18637d700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe164066320 0x7fe1640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.536+0000 7fe18637d700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe164066320 0x7fe1640687d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe17c000f60 tx=0x7fe17c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.548+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe178053510 con 0x7fe18015acd0 2023-05-21T16:54:55.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.708+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1800ca1d0 con 0x7fe18015acd0 2023-05-21T16:54:55.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.708+0000 7fe176ffd700 1 -- 172.21.15.46:0/65774930 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe178056b30 con 0x7fe18015acd0 2023-05-21T16:54:55.714 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:55.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe164066320 msgr2=0x7fe1640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe164066320 0x7fe1640687d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe17c000f60 tx=0x7fe17c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 msgr2=0x7fe1800b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 0x7fe1800b3ab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe178014040 tx=0x7fe178004af0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 shutdown_connections 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe164066320 0x7fe1640687d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe18015acd0 0x7fe1800b3ab0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1800cae30 0x7fe1800c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 --2- 172.21.15.46:0/65774930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1800ade90 0x7fe18014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 >> 172.21.15.46:0/65774930 conn(0x7fe1800cf720 msgr2=0x7fe1800b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:55.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 shutdown_connections 2023-05-21T16:54:55.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.712+0000 7fe18737f700 1 -- 172.21.15.46:0/65774930 wait complete. 2023-05-21T16:54:55.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:54:55.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 Processor -- start 2023-05-21T16:54:55.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 -- start start 2023-05-21T16:54:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bf815c8a0 0x7f6bf80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf80cf460 0x7f6bf80b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bf80b49d0 0x7f6bf80b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf80b53b0 con 0x7f6bf815c8a0 2023-05-21T16:54:55.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf806af50 con 0x7f6bf80b49d0 2023-05-21T16:54:55.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.828+0000 7f6c002b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf815cc70 con 0x7f6bf80cf460 2023-05-21T16:54:55.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe051700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bf815c8a0 0x7f6bf80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bf80b49d0 0x7f6bf80b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe051700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bf815c8a0 0x7f6bf80cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55812/0 (socket says 172.21.15.46:55812) 2023-05-21T16:54:55.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe051700 1 -- 172.21.15.46:0/2281105191 learned_addr learned my addr 172.21.15.46:0/2281105191 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfd850700 1 --2- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf80cf460 0x7f6bf80b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 -- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf80cf460 msgr2=0x7f6bf80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 --2- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf80cf460 0x7f6bf80b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 -- 172.21.15.46:0/2281105191 >> v2:172.21.15.46:3300/0 conn(0x7f6bf815c8a0 msgr2=0x7f6bf80cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 --2- 172.21.15.46:0/2281105191 >> v2:172.21.15.46:3300/0 conn(0x7f6bf815c8a0 0x7f6bf80cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 -- 172.21.15.46:0/2281105191 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf806a990 con 0x7f6bf80b49d0 2023-05-21T16:54:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfe852700 1 --2- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80b49d0 0x7f6bf80b4e70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bf808c210 tx=0x7f6bf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a9c825147eec39a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfd04f700 1 -- 172.21.15.46:0/2281105191 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000e070 con 0x7f6bf80b49d0 2023-05-21T16:54:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfd04f700 1 -- 172.21.15.46:0/2281105191 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000bb20 con 0x7f6bf80b49d0 2023-05-21T16:54:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6bfd04f700 1 -- 172.21.15.46:0/2281105191 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0012430 con 0x7f6bf80b49d0 2023-05-21T16:54:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 -- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80b49d0 msgr2=0x7f6bf80b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 --2- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80b49d0 0x7f6bf80b4e70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bf808c210 tx=0x7f6bf000b330 comp rx=0 tx=0).stop 2023-05-21T16:54:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 -- 172.21.15.46:0/2281105191 shutdown_connections 2023-05-21T16:54:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 --2- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80b49d0 0x7f6bf80b4e70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 --2- 172.21.15.46:0/2281105191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf80cf460 0x7f6bf80b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 --2- 172.21.15.46:0/2281105191 >> v2:172.21.15.46:3300/0 conn(0x7f6bf815c8a0 0x7f6bf80cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 -- 172.21.15.46:0/2281105191 >> 172.21.15.46:0/2281105191 conn(0x7f6bf806cce0 msgr2=0x7f6bf80d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 -- 172.21.15.46:0/2281105191 shutdown_connections 2023-05-21T16:54:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.832+0000 7f6c002b5700 1 -- 172.21.15.46:0/2281105191 wait complete. 2023-05-21T16:54:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 Processor -- start 2023-05-21T16:54:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 -- start start 2023-05-21T16:54:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf80b49d0 0x7f6bf814a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80cf460 0x7f6bf814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf815c8a0 0x7f6bf815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf815e7f0 con 0x7f6bf80b49d0 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf814b380 con 0x7f6bf80cf460 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf815e510 con 0x7f6bf815c8a0 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfe051700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf80b49d0 0x7f6bf814a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfe051700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf80b49d0 0x7f6bf814a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55820/0 (socket says 172.21.15.46:55820) 2023-05-21T16:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfe051700 1 -- 172.21.15.46:0/4284635771 learned_addr learned my addr 172.21.15.46:0/4284635771 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80cf460 0x7f6bf814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfe852700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf815c8a0 0x7f6bf815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 -- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf815c8a0 msgr2=0x7f6bf815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf815c8a0 0x7f6bf815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 -- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf80b49d0 msgr2=0x7f6bf814a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf80b49d0 0x7f6bf814a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 -- 172.21.15.46:0/4284635771 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0009a70 con 0x7f6bf80cf460 2023-05-21T16:54:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bfd850700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80cf460 0x7f6bf814ae40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e900 tx=0x7f6bec00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec013680 con 0x7f6bf80cf460 2023-05-21T16:54:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec0137e0 con 0x7f6bf80cf460 2023-05-21T16:54:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf806b2c0 con 0x7f6bf80cf460 2023-05-21T16:54:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec013b50 con 0x7f6bf80cf460 2023-05-21T16:54:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.836+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf806ac70 con 0x7f6bf80cf460 2023-05-21T16:54:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.840+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf806b5a0 con 0x7f6bf80cf460 2023-05-21T16:54:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.840+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bec013cb0 con 0x7f6bf80cf460 2023-05-21T16:54:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.840+0000 7f6bf6ffd700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6be40662f0 0x7f6be40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:55.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.840+0000 7f6bfe051700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6be40662f0 0x7f6be40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:55.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.840+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bec083fd0 con 0x7f6bf80cf460 2023-05-21T16:54:55.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.840+0000 7f6bfe051700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6be40662f0 0x7f6be40687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6be8006fd0 tx=0x7f6be80092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:55.848+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6bec0513b0 con 0x7f6bf80cf460 2023-05-21T16:54:56.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.024+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6bf8074200 con 0x7f6bf80cf460 2023-05-21T16:54:56.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.028+0000 7f6bf6ffd700 1 -- 172.21.15.46:0/4284635771 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6bec017020 con 0x7f6bf80cf460 2023-05-21T16:54:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6be40662f0 msgr2=0x7f6be40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6be40662f0 0x7f6be40687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6be8006fd0 tx=0x7f6be80092e0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80cf460 msgr2=0x7f6bf814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80cf460 0x7f6bf814ae40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e900 tx=0x7f6bec00ec10 comp rx=0 tx=0).stop 2023-05-21T16:54:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 shutdown_connections 2023-05-21T16:54:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6be40662f0 0x7f6be40687a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bf815c8a0 0x7f6bf815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf80cf460 0x7f6bf814ae40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 --2- 172.21.15.46:0/4284635771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf80b49d0 0x7f6bf814a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 >> 172.21.15.46:0/4284635771 conn(0x7f6bf806cce0 msgr2=0x7f6bf80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 shutdown_connections 2023-05-21T16:54:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.032+0000 7f6c002b5700 1 -- 172.21.15.46:0/4284635771 wait complete. 2023-05-21T16:54:56.038 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:54:56.054 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:54:56.054 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:56.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:56.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac7fff700 1 Processor -- start 2023-05-21T16:54:56.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac7fff700 1 -- start start 2023-05-21T16:54:56.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ac8160be0 0x7f1ac81651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac7fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac80ade30 con 0x7f1ac806a420 2023-05-21T16:54:56.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac7fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac80cd210 con 0x7f1ac8069f80 2023-05-21T16:54:56.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac7fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80cc970 con 0x7f1ac8160be0 2023-05-21T16:54:56.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1ac806a420 0x7f1ac80c18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39654/0 (socket says 172.21.15.46:39654) 2023-05-21T16:54:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac77fe700 1 -- 172.21.15.46:0/795436625 learned_addr learned my addr 172.21.15.46:0/795436625 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac6ffd700 1 --2- 172.21.15.46:0/795436625 >> v2:172.21.15.142:3300/0 conn(0x7f1ac8160be0 0x7f1ac81651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac67fc700 1 -- 172.21.15.46:0/795436625 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166782808 0 0) 0x7f1ac80ade30 con 0x7f1ac806a420 2023-05-21T16:54:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac67fc700 1 -- 172.21.15.46:0/795436625 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab40035d0 con 0x7f1ac806a420 2023-05-21T16:54:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac6ffd700 1 -- 172.21.15.46:0/795436625 >> v1:172.21.15.142:6789/0 conn(0x7f1ac8069f80 legacy=0x7f1ac8070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac6ffd700 1 -- 172.21.15.46:0/795436625 >> v1:172.21.15.46:6789/0 conn(0x7f1ac806a420 legacy=0x7f1ac80c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac6ffd700 1 -- 172.21.15.46:0/795436625 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80ccc50 con 0x7f1ac8160be0 2023-05-21T16:54:56.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac67fc700 1 -- 172.21.15.46:0/795436625 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148139396 0 0) 0x7f1ac80cd210 con 0x7f1ac8069f80 2023-05-21T16:54:56.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac6ffd700 1 --2- 172.21.15.46:0/795436625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac81651c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009850 tx=0x7f1ab8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=572a292ec5445498 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac67fc700 1 -- 172.21.15.46:0/795436625 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011830 con 0x7f1ac8160be0 2023-05-21T16:54:56.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac67fc700 1 -- 172.21.15.46:0/795436625 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab8011990 con 0x7f1ac8160be0 2023-05-21T16:54:56.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.176+0000 7f1ac67fc700 1 -- 172.21.15.46:0/795436625 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011d00 con 0x7f1ac8160be0 2023-05-21T16:54:56.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- 172.21.15.46:0/795436625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 msgr2=0x7f1ac81651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/795436625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac81651c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009850 tx=0x7f1ab8009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:56.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- 172.21.15.46:0/795436625 shutdown_connections 2023-05-21T16:54:56.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/795436625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac81651c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- 172.21.15.46:0/795436625 >> 172.21.15.46:0/795436625 conn(0x7f1ac80cf720 msgr2=0x7f1ac80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:56.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- 172.21.15.46:0/795436625 shutdown_connections 2023-05-21T16:54:56.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- 172.21.15.46:0/795436625 wait complete. 2023-05-21T16:54:56.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 Processor -- start 2023-05-21T16:54:56.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- start start 2023-05-21T16:54:56.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac8069f80 0x7f1ac8157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 0x7f1ac80c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac80c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80c0c20 con 0x7f1ac806a420 2023-05-21T16:54:56.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80c32d0 con 0x7f1ac8160be0 2023-05-21T16:54:56.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80c0560 con 0x7f1ac8069f80 2023-05-21T16:54:56.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1abffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 0x7f1ac80c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1abffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 0x7f1ac80c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55834/0 (socket says 172.21.15.46:55834) 2023-05-21T16:54:56.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1abffff700 1 -- 172.21.15.46:0/3833736971 learned_addr learned my addr 172.21.15.46:0/3833736971 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:56.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac77fe700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac80c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.180+0000 7f1ac6ffd700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac8069f80 0x7f1ac8157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abffff700 1 -- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac8069f80 msgr2=0x7f1ac8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abffff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac8069f80 0x7f1ac8157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abffff700 1 -- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 msgr2=0x7f1ac80c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abffff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac80c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abffff700 1 -- 172.21.15.46:0/3833736971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80094b0 con 0x7f1ac806a420 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abffff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 0x7f1ac80c3bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00011e0 tx=0x7f1ab000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00054e0 con 0x7f1ac806a420 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00036a0 con 0x7f1ac806a420 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac8070730 con 0x7f1ac806a420 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0003a50 con 0x7f1ac806a420 2023-05-21T16:54:56.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac80ccf30 con 0x7f1ac806a420 2023-05-21T16:54:56.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac8165700 con 0x7f1ac806a420 2023-05-21T16:54:56.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.184+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ab0003bb0 con 0x7f1ac806a420 2023-05-21T16:54:56.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.188+0000 7f1abf7fe700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1aa80662f0 0x7f1aa80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.188+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ab00830c0 con 0x7f1ac806a420 2023-05-21T16:54:56.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.188+0000 7f1ac6ffd700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1aa80662f0 0x7f1aa80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.188+0000 7f1ac6ffd700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1aa80662f0 0x7f1aa80687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80090b0 tx=0x7f1ab8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.192+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1ab00505d0 con 0x7f1ac806a420 2023-05-21T16:54:56.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.360+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ac80cdc90 con 0x7f1ac806a420 2023-05-21T16:54:56.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.364+0000 7f1abf7fe700 1 -- 172.21.15.46:0/3833736971 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f1ab0003e60 con 0x7f1ac806a420 2023-05-21T16:54:56.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:56.371 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:56.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1aa80662f0 msgr2=0x7f1aa80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1aa80662f0 0x7f1aa80687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80090b0 tx=0x7f1ab8008030 comp rx=0 tx=0).stop 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 msgr2=0x7f1ac80c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 0x7f1ac80c3bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00011e0 tx=0x7f1ab000ca30 comp rx=0 tx=0).stop 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 shutdown_connections 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1aa80662f0 0x7f1aa80687a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac8160be0 0x7f1ac80c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac806a420 0x7f1ac80c3bf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 --2- 172.21.15.46:0/3833736971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac8069f80 0x7f1ac8157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 >> 172.21.15.46:0/3833736971 conn(0x7f1ac80cf720 msgr2=0x7f1ac80b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 shutdown_connections 2023-05-21T16:54:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.368+0000 7f1ac7fff700 1 -- 172.21.15.46:0/3833736971 wait complete. 2023-05-21T16:54:56.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:56.390 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edb2e4700 1 Processor -- start 2023-05-21T16:54:56.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edb2e4700 1 -- start start 2023-05-21T16:54:56.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edb2e4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ed40b5ce0 0x7f2ed40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edb2e4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed40b8ea0 con 0x7f2ed40b8ad0 2023-05-21T16:54:56.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edb2e4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed40d09d0 con 0x7f2ed40b4910 2023-05-21T16:54:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edb2e4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed40d0cb0 con 0x7f2ed40b5ce0 2023-05-21T16:54:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2eda2e2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2ed40b8ad0 0x7f2ed406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39664/0 (socket says 172.21.15.46:39664) 2023-05-21T16:54:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2eda2e2700 1 -- 172.21.15.46:0/1159486009 learned_addr learned my addr 172.21.15.46:0/1159486009 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed9ae1700 1 --2- 172.21.15.46:0/1159486009 >> v2:172.21.15.142:3300/0 conn(0x7f2ed40b5ce0 0x7f2ed40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128691956 0 0) 0x7f2ed40b8ea0 con 0x7f2ed40b8ad0 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec00035d0 con 0x7f2ed40b8ad0 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1025263071 0 0) 0x7f2ec00035d0 con 0x7f2ed40b8ad0 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 >> v2:172.21.15.142:3300/0 conn(0x7f2ed40b5ce0 msgr2=0x7f2ed40cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 --2- 172.21.15.46:0/1159486009 >> v2:172.21.15.142:3300/0 conn(0x7f2ed40b5ce0 0x7f2ed40cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 >> v1:172.21.15.142:6789/0 conn(0x7f2ed40b4910 legacy=0x7f2ed40d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40cd4f0 con 0x7f2ed40b8ad0 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f2ed0001670 con 0x7f2ed40b8ad0 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 >> v1:172.21.15.46:6789/0 conn(0x7f2ed40b8ad0 legacy=0x7f2ed406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ec0003a20 0x7f2ec0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ec0004410 0x7f2ec00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ec000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed40d0cb0 con 0x7f2ec0005170 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec000c0a0 con 0x7f2ec0004410 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec000c260 con 0x7f2ec0003a20 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2edaae3700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ec000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2eda2e2700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ec0003a20 0x7f2ec0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.508+0000 7f2ed9ae1700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ec0004410 0x7f2ec00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 -- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ec0003a20 msgr2=0x7f2ec0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ec0003a20 0x7f2ec0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 -- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ec0004410 msgr2=0x7f2ec00048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ec0004410 0x7f2ec00048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 -- 172.21.15.46:0/1159486009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00035d0 con 0x7f2ec0005170 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 -- 172.21.15.46:0/1159486009 reap_dead start 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ec000ba30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00c290 tx=0x7f2ec00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ea82f6cacf4f1e server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc001e70 con 0x7f2ec0005170 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00ce70 con 0x7f2ec0005170 2023-05-21T16:54:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2ed92e0700 1 -- 172.21.15.46:0/1159486009 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc003c40 con 0x7f2ec0005170 2023-05-21T16:54:56.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- 172.21.15.46:0/1159486009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 msgr2=0x7f2ec000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ec000ba30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00c290 tx=0x7f2ec00058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- 172.21.15.46:0/1159486009 shutdown_connections 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/1159486009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ec000ba30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- 172.21.15.46:0/1159486009 >> 172.21.15.46:0/1159486009 conn(0x7f2ed40d3ae0 msgr2=0x7f2ed40cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- 172.21.15.46:0/1159486009 shutdown_connections 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- 172.21.15.46:0/1159486009 wait complete. 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 Processor -- start 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- start start 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ed40b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ed415c1d0 0x7f2ed415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ed4160150 0x7f2ed41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed4160b10 con 0x7f2ec0005170 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed41f5020 con 0x7f2ed415c1d0 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edb2e4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed41f5300 con 0x7f2ed4160150 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2eda2e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ed40b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2eda2e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ed40b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55852/0 (socket says 172.21.15.46:55852) 2023-05-21T16:54:56.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2edaae3700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ed4160150 0x7f2ed41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2ed9ae1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ed415c1d0 0x7f2ed415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.512+0000 7f2eda2e2700 1 -- 172.21.15.46:0/45930548 learned_addr learned my addr 172.21.15.46:0/45930548 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ed9ae1700 1 -- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ed4160150 msgr2=0x7f2ed41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ed9ae1700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ed4160150 0x7f2ed41605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ed9ae1700 1 -- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 msgr2=0x7f2ed40b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ed9ae1700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ed40b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ed9ae1700 1 -- 172.21.15.46:0/45930548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40cda70 con 0x7f2ed415c1d0 2023-05-21T16:54:56.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2edaae3700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ed4160150 0x7f2ed41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ed9ae1700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ed415c1d0 0x7f2ed415a170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4011960 tx=0x7f2ec4011c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400f700 con 0x7f2ed415c1d0 2023-05-21T16:54:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed40cd790 con 0x7f2ed415c1d0 2023-05-21T16:54:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec400f860 con 0x7f2ed415c1d0 2023-05-21T16:54:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400fbf0 con 0x7f2ed415c1d0 2023-05-21T16:54:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed40cf310 con 0x7f2ed415c1d0 2023-05-21T16:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed40733b0 con 0x7f2ed415c1d0 2023-05-21T16:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.516+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ec400fd50 con 0x7f2ed415c1d0 2023-05-21T16:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.520+0000 7f2ecaffd700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2eb8066320 0x7f2eb80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.520+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ec40841b0 con 0x7f2ed415c1d0 2023-05-21T16:54:56.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.520+0000 7f2eda2e2700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2eb8066320 0x7f2eb80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.520+0000 7f2eda2e2700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2eb8066320 0x7f2eb80687d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0001180 tx=0x7f2ed0001110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.528+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2ec4051640 con 0x7f2ed415c1d0 2023-05-21T16:54:56.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.692+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ed406b3e0 con 0x7f2ed415c1d0 2023-05-21T16:54:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.692+0000 7f2ecaffd700 1 -- 172.21.15.46:0/45930548 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ec4054c60 con 0x7f2ed415c1d0 2023-05-21T16:54:56.699 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2eb8066320 msgr2=0x7f2eb80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2eb8066320 0x7f2eb80687d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0001180 tx=0x7f2ed0001110 comp rx=0 tx=0).stop 2023-05-21T16:54:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ed415c1d0 msgr2=0x7f2ed415a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ed415c1d0 0x7f2ed415a170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4011960 tx=0x7f2ec4011c70 comp rx=0 tx=0).stop 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 shutdown_connections 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2eb8066320 0x7f2eb80687d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ed4160150 0x7f2ed41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ed415c1d0 0x7f2ed415a170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 --2- 172.21.15.46:0/45930548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ec0005170 0x7f2ed40b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 >> 172.21.15.46:0/45930548 conn(0x7f2ed40d3ae0 msgr2=0x7f2ed40b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 shutdown_connections 2023-05-21T16:54:56.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.696+0000 7f2edb2e4700 1 -- 172.21.15.46:0/45930548 wait complete. 2023-05-21T16:54:56.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.828+0000 7fe4abf32700 1 Processor -- start 2023-05-21T16:54:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.828+0000 7fe4abf32700 1 -- start start 2023-05-21T16:54:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe4a415ca20 0x7fe4a406b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a40d28c0 0x7fe4a40b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40b5370 con 0x7fe4a40b49e0 2023-05-21T16:54:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40d0e60 con 0x7fe4a415ca20 2023-05-21T16:54:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40d1420 con 0x7fe4a40d28c0 2023-05-21T16:54:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe4a415ca20 0x7fe4a406b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe4a415ca20 0x7fe4a406b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55868/0 (socket says 172.21.15.46:55868) 2023-05-21T16:54:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 -- 172.21.15.46:0/3616952623 learned_addr learned my addr 172.21.15.46:0/3616952623 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:56.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4aa4cf700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a40d28c0 0x7fe4a40b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 -- 172.21.15.46:0/3616952623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a40d28c0 msgr2=0x7fe4a40b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:56.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a40d28c0 0x7fe4a40b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 -- 172.21.15.46:0/3616952623 >> v1:172.21.15.142:6789/0 conn(0x7fe4a40b49e0 legacy=0x7fe4a4069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 -- 172.21.15.46:0/3616952623 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40cd920 con 0x7fe4a415ca20 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4aa4cf700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a40d28c0 0x7fe4a40b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a9cce700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a415ca20 0x7fe4a406b310 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009910 tx=0x7fe4a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e326699e547dc0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a8ccc700 1 -- 172.21.15.46:0/3616952623 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000ba60 con 0x7fe4a415ca20 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a8ccc700 1 -- 172.21.15.46:0/3616952623 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000bbc0 con 0x7fe4a415ca20 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4a8ccc700 1 -- 172.21.15.46:0/3616952623 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0009e60 con 0x7fe4a415ca20 2023-05-21T16:54:56.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- 172.21.15.46:0/3616952623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a415ca20 msgr2=0x7fe4a406b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a415ca20 0x7fe4a406b310 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009910 tx=0x7fe4a0009c20 comp rx=0 tx=0).stop 2023-05-21T16:54:56.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- 172.21.15.46:0/3616952623 shutdown_connections 2023-05-21T16:54:56.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a40d28c0 0x7fe4a40b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 --2- 172.21.15.46:0/3616952623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a415ca20 0x7fe4a406b310 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- 172.21.15.46:0/3616952623 >> 172.21.15.46:0/3616952623 conn(0x7fe4a406cd50 msgr2=0x7fe4a40d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:56.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- 172.21.15.46:0/3616952623 shutdown_connections 2023-05-21T16:54:56.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.832+0000 7fe4abf32700 1 -- 172.21.15.46:0/3616952623 wait complete. 2023-05-21T16:54:56.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 Processor -- start 2023-05-21T16:54:56.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 -- start start 2023-05-21T16:54:56.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a40b49e0 0x7fe4a4154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 0x7fe4a4158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a415ca20 0x7fe4a415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4154ac0 con 0x7fe4a40d28c0 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a415a710 con 0x7fe4a40b49e0 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4abf32700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a415a9f0 con 0x7fe4a415ca20 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4a94cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 0x7fe4a4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4a94cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 0x7fe4a4158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55876/0 (socket says 172.21.15.46:55876) 2023-05-21T16:54:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4a94cd700 1 -- 172.21.15.46:0/2241251946 learned_addr learned my addr 172.21.15.46:0/2241251946 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4a9cce700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a40b49e0 0x7fe4a4154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.836+0000 7fe4aa4cf700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a415ca20 0x7fe4a415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a94cd700 1 -- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a415ca20 msgr2=0x7fe4a415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a94cd700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a415ca20 0x7fe4a415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a94cd700 1 -- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a40b49e0 msgr2=0x7fe4a4154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a94cd700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a40b49e0 0x7fe4a4154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a94cd700 1 -- 172.21.15.46:0/2241251946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0009570 con 0x7fe4a40d28c0 2023-05-21T16:54:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a94cd700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 0x7fe4a4158920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c4d0 tx=0x7fe49400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940052d0 con 0x7fe4a40d28c0 2023-05-21T16:54:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494005430 con 0x7fe4a40d28c0 2023-05-21T16:54:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a40d10b0 con 0x7fe4a40d28c0 2023-05-21T16:54:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940055a0 con 0x7fe4a40d28c0 2023-05-21T16:54:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a40cdc00 con 0x7fe4a40d28c0 2023-05-21T16:54:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4940038c0 con 0x7fe4a40d28c0 2023-05-21T16:54:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a406b850 con 0x7fe4a40d28c0 2023-05-21T16:54:56.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe49a7fc700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe4880662f0 0x7fe4880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:56.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe4a9cce700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe4880662f0 0x7fe4880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:56.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.840+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe494082ef0 con 0x7fe4a40d28c0 2023-05-21T16:54:56.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.844+0000 7fe4a9cce700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe4880662f0 0x7fe4880687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009860 tx=0x7fe4a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:56.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:56.844+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe494050370 con 0x7fe4a40d28c0 2023-05-21T16:54:57.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4a40b5370 con 0x7fe4a40d28c0 2023-05-21T16:54:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe49a7fc700 1 -- 172.21.15.46:0/2241251946 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4a40b5370 con 0x7fe4a40d28c0 2023-05-21T16:54:57.025 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe4880662f0 msgr2=0x7fe4880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe4880662f0 0x7fe4880687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009860 tx=0x7fe4a0008030 comp rx=0 tx=0).stop 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 msgr2=0x7fe4a4158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 0x7fe4a4158920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c4d0 tx=0x7fe49400c7e0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 shutdown_connections 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe4880662f0 0x7fe4880687a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4a415ca20 0x7fe4a415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4a40d28c0 0x7fe4a4158920 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 --2- 172.21.15.46:0/2241251946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a40b49e0 0x7fe4a4154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 >> 172.21.15.46:0/2241251946 conn(0x7fe4a406cd50 msgr2=0x7fe4a4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 shutdown_connections 2023-05-21T16:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.020+0000 7fe4abf32700 1 -- 172.21.15.46:0/2241251946 wait complete. 2023-05-21T16:54:57.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:57.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 Processor -- start 2023-05-21T16:54:57.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 -- start start 2023-05-21T16:54:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b8ad0 0x7f33cc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33cc0b5ce0 0x7f33cc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33cc0b4910 0x7f33cc0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0b52f0 con 0x7f33cc0b5ce0 2023-05-21T16:54:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0b8ea0 con 0x7f33cc0b4910 2023-05-21T16:54:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cbfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0d09d0 con 0x7f33cc0b8ad0 2023-05-21T16:54:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33ca7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33cc0b5ce0 0x7f33cc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33ca7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33cc0b5ce0 0x7f33cc06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55886/0 (socket says 172.21.15.46:55886) 2023-05-21T16:54:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33ca7fc700 1 -- 172.21.15.46:0/2078630821 learned_addr learned my addr 172.21.15.46:0/2078630821 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33cb7fe700 1 --2- 172.21.15.46:0/2078630821 >> v2:172.21.15.142:3300/0 conn(0x7f33cc0b4910 0x7f33cc0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.152+0000 7f33caffd700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b8ad0 0x7f33cc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33ca7fc700 1 -- 172.21.15.46:0/2078630821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b8ad0 msgr2=0x7f33cc0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33ca7fc700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b8ad0 0x7f33cc0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33ca7fc700 1 -- 172.21.15.46:0/2078630821 >> v2:172.21.15.142:3300/0 conn(0x7f33cc0b4910 msgr2=0x7f33cc0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33ca7fc700 1 --2- 172.21.15.46:0/2078630821 >> v2:172.21.15.142:3300/0 conn(0x7f33cc0b4910 0x7f33cc0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33ca7fc700 1 -- 172.21.15.46:0/2078630821 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc0d0cb0 con 0x7f33cc0b5ce0 2023-05-21T16:54:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33caffd700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b8ad0 0x7f33cc0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33ca7fc700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b5ce0 0x7f33cc06a990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33cc08a640 tx=0x7f33bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ed096bd0596dd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33c9ffb700 1 -- 172.21.15.46:0/2078630821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc011830 con 0x7f33cc0b5ce0 2023-05-21T16:54:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33c9ffb700 1 -- 172.21.15.46:0/2078630821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc011990 con 0x7f33cc0b5ce0 2023-05-21T16:54:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33c9ffb700 1 -- 172.21.15.46:0/2078630821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc011d20 con 0x7f33cc0b5ce0 2023-05-21T16:54:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- 172.21.15.46:0/2078630821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b5ce0 msgr2=0x7f33cc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b5ce0 0x7f33cc06a990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33cc08a640 tx=0x7f33bc009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- 172.21.15.46:0/2078630821 shutdown_connections 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- 172.21.15.46:0/2078630821 >> v2:172.21.15.142:3300/0 conn(0x7f33cc0b4910 0x7f33cc0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b5ce0 0x7f33cc06a990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- 172.21.15.46:0/2078630821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b8ad0 0x7f33cc0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- 172.21.15.46:0/2078630821 >> 172.21.15.46:0/2078630821 conn(0x7f33cc0d3ae0 msgr2=0x7f33cc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- 172.21.15.46:0/2078630821 shutdown_connections 2023-05-21T16:54:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- 172.21.15.46:0/2078630821 wait complete. 2023-05-21T16:54:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 Processor -- start 2023-05-21T16:54:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- start start 2023-05-21T16:54:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 0x7f33cc1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b5ce0 0x7f33cc15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc0b8ad0 0x7f33cc0b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc1f5390 con 0x7f33cc0b4910 2023-05-21T16:54:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc160990 con 0x7f33cc0b8ad0 2023-05-21T16:54:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33cbfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc1603d0 con 0x7f33cc0b5ce0 2023-05-21T16:54:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33caffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 0x7f33cc1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33caffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 0x7f33cc1f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55896/0 (socket says 172.21.15.46:55896) 2023-05-21T16:54:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.156+0000 7f33caffd700 1 -- 172.21.15.46:0/3634829763 learned_addr learned my addr 172.21.15.46:0/3634829763 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33ca7fc700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b5ce0 0x7f33cc15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33cb7fe700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc0b8ad0 0x7f33cc0b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33caffd700 1 -- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b5ce0 msgr2=0x7f33cc15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33caffd700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b5ce0 0x7f33cc15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33caffd700 1 -- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc0b8ad0 msgr2=0x7f33cc0b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33caffd700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc0b8ad0 0x7f33cc0b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33caffd700 1 -- 172.21.15.46:0/3634829763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc009570 con 0x7f33cc0b4910 2023-05-21T16:54:57.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33caffd700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 0x7f33cc1f5820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e760 tx=0x7f33c000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000c070 con 0x7f33cc0b4910 2023-05-21T16:54:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c0004250 con 0x7f33cc0b4910 2023-05-21T16:54:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00036c0 con 0x7f33cc0b4910 2023-05-21T16:54:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc0cd790 con 0x7f33cc0b4910 2023-05-21T16:54:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc0cd4f0 con 0x7f33cc0b4910 2023-05-21T16:54:57.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc0cda70 con 0x7f33cc0b4910 2023-05-21T16:54:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.160+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33c0003820 con 0x7f33cc0b4910 2023-05-21T16:54:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.164+0000 7f33b37fe700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33b80662f0 0x7f33b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.164+0000 7f33ca7fc700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33b80662f0 0x7f33b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.164+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33c0083940 con 0x7f33cc0b4910 2023-05-21T16:54:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.164+0000 7f33ca7fc700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33b80662f0 0x7f33b80687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f33bc000c00 tx=0x7f33bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.172+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f33c0050e50 con 0x7f33cc0b4910 2023-05-21T16:54:57.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.332+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33cc0d2760 con 0x7f33cc0b4910 2023-05-21T16:54:57.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33b37fe700 1 -- 172.21.15.46:0/3634829763 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33c00094e0 con 0x7f33cc0b4910 2023-05-21T16:54:57.341 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:57.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33b80662f0 msgr2=0x7f33b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33b80662f0 0x7f33b80687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f33bc000c00 tx=0x7f33bc008030 comp rx=0 tx=0).stop 2023-05-21T16:54:57.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 msgr2=0x7f33cc1f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 0x7f33cc1f5820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e760 tx=0x7f33c000ea70 comp rx=0 tx=0).stop 2023-05-21T16:54:57.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 shutdown_connections 2023-05-21T16:54:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33b80662f0 0x7f33b80687a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc0b8ad0 0x7f33cc0b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc0b5ce0 0x7f33cc15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 --2- 172.21.15.46:0/3634829763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33cc0b4910 0x7f33cc1f5820 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 >> 172.21.15.46:0/3634829763 conn(0x7f33cc0d3ae0 msgr2=0x7f33cc0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 shutdown_connections 2023-05-21T16:54:57.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.336+0000 7f33cbfff700 1 -- 172.21.15.46:0/3634829763 wait complete. 2023-05-21T16:54:57.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 Processor -- start 2023-05-21T16:54:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 -- start start 2023-05-21T16:54:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a5c06c760 0x7f9a5c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a5c0c9cd0 0x7f9a5c0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c06b9d0 con 0x7f9a5c15dbb0 2023-05-21T16:54:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c06b450 con 0x7f9a5c06c760 2023-05-21T16:54:57.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.472+0000 7f9a5b59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c159a90 con 0x7f9a5c0c9cd0 2023-05-21T16:54:57.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a5c06c760 0x7f9a5c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a5c06c760 0x7f9a5c15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55906/0 (socket says 172.21.15.46:55906) 2023-05-21T16:54:57.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 -- 172.21.15.46:0/1874172923 learned_addr learned my addr 172.21.15.46:0/1874172923 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:57.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5ad9d700 1 --2- 172.21.15.46:0/1874172923 >> v2:172.21.15.142:3300/0 conn(0x7f9a5c0c9cd0 0x7f9a5c0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 -- 172.21.15.46:0/1874172923 >> v2:172.21.15.142:3300/0 conn(0x7f9a5c0c9cd0 msgr2=0x7f9a5c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 --2- 172.21.15.46:0/1874172923 >> v2:172.21.15.142:3300/0 conn(0x7f9a5c0c9cd0 0x7f9a5c0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 -- 172.21.15.46:0/1874172923 >> v1:172.21.15.46:6789/0 conn(0x7f9a5c15dbb0 legacy=0x7f9a5c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 -- 172.21.15.46:0/1874172923 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c06b6f0 con 0x7f9a5c06c760 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5a59c700 1 --2- 172.21.15.46:0/1874172923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c15a830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0c5a60 tx=0x7f9a4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc1829233c21eab server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5959a700 1 -- 172.21.15.46:0/1874172923 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00b8a0 con 0x7f9a5c06c760 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5959a700 1 -- 172.21.15.46:0/1874172923 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c00ba00 con 0x7f9a5c06c760 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5959a700 1 -- 172.21.15.46:0/1874172923 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00bd90 con 0x7f9a5c06c760 2023-05-21T16:54:57.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 -- 172.21.15.46:0/1874172923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 msgr2=0x7f9a5c15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/1874172923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c15a830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0c5a60 tx=0x7f9a4c009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 -- 172.21.15.46:0/1874172923 shutdown_connections 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/1874172923 >> v2:172.21.15.142:3300/0 conn(0x7f9a5c0c9cd0 0x7f9a5c0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/1874172923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c15a830 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 -- 172.21.15.46:0/1874172923 >> 172.21.15.46:0/1874172923 conn(0x7f9a5c0cf720 msgr2=0x7f9a5c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 -- 172.21.15.46:0/1874172923 shutdown_connections 2023-05-21T16:54:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.476+0000 7f9a5b59e700 1 -- 172.21.15.46:0/1874172923 wait complete. 2023-05-21T16:54:57.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 Processor -- start 2023-05-21T16:54:57.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 -- start start 2023-05-21T16:54:57.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a5c0c9cd0 0x7f9a5c1667b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a5c15dbb0 0x7f9a5c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c166cf0 con 0x7f9a5c06c760 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c14df80 con 0x7f9a5c0c9cd0 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c14e260 con 0x7f9a5c15dbb0 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c14d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55910/0 (socket says 172.21.15.46:55910) 2023-05-21T16:54:57.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 -- 172.21.15.46:0/141317814 learned_addr learned my addr 172.21.15.46:0/141317814 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5ad9d700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a5c15dbb0 0x7f9a5c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a59d9b700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a5c0c9cd0 0x7f9a5c1667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 -- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a5c15dbb0 msgr2=0x7f9a5c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a5c15dbb0 0x7f9a5c145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 -- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a5c0c9cd0 msgr2=0x7f9a5c1667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a5c0c9cd0 0x7f9a5c1667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 -- 172.21.15.46:0/141317814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c009570 con 0x7f9a5c06c760 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5ad9d700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a5c15dbb0 0x7f9a5c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a59d9b700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a5c0c9cd0 0x7f9a5c1667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5a59c700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c14d870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c071960 tx=0x7f9a4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0038c0 con 0x7f9a5c06c760 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c01f070 con 0x7f9a5c06c760 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c15a030 con 0x7f9a5c06c760 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c003c60 con 0x7f9a5c06c760 2023-05-21T16:54:57.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.480+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c159d50 con 0x7f9a5c06c760 2023-05-21T16:54:57.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.484+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c15a310 con 0x7f9a5c06c760 2023-05-21T16:54:57.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.484+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a4c026480 con 0x7f9a5c06c760 2023-05-21T16:54:57.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.484+0000 7f9a52ffd700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9a3c0662f0 0x7f9a3c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.484+0000 7f9a59d9b700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9a3c0662f0 0x7f9a3c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.484+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a4c021070 con 0x7f9a5c06c760 2023-05-21T16:54:57.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.484+0000 7f9a59d9b700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9a3c0662f0 0x7f9a3c0687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c1598c0 tx=0x7f9a44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.488+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9a4c052df0 con 0x7f9a5c06c760 2023-05-21T16:54:57.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.652+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a5c0733b0 con 0x7f9a5c06c760 2023-05-21T16:54:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a52ffd700 1 -- 172.21.15.46:0/141317814 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a4c056410 con 0x7f9a5c06c760 2023-05-21T16:54:57.660 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9a3c0662f0 msgr2=0x7f9a3c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9a3c0662f0 0x7f9a3c0687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c1598c0 tx=0x7f9a44009040 comp rx=0 tx=0).stop 2023-05-21T16:54:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 msgr2=0x7f9a5c14d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c14d870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c071960 tx=0x7f9a4c004770 comp rx=0 tx=0).stop 2023-05-21T16:54:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 shutdown_connections 2023-05-21T16:54:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9a3c0662f0 0x7f9a3c0687a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a5c15dbb0 0x7f9a5c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a5c0c9cd0 0x7f9a5c1667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 --2- 172.21.15.46:0/141317814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a5c06c760 0x7f9a5c14d870 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 >> 172.21.15.46:0/141317814 conn(0x7f9a5c0cf720 msgr2=0x7f9a5c15c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 shutdown_connections 2023-05-21T16:54:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.656+0000 7f9a5b59e700 1 -- 172.21.15.46:0/141317814 wait complete. 2023-05-21T16:54:57.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:54:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.784+0000 7f4a56304700 1 Processor -- start 2023-05-21T16:54:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.784+0000 7f4a56304700 1 -- start start 2023-05-21T16:54:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4a5006d0f0 0x7f4a5015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500ca190 con 0x7f4a5015a5f0 2023-05-21T16:54:57.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500ae890 con 0x7f4a500b1d60 2023-05-21T16:54:57.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55302700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4a5015a5f0 0x7f4a500b1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39692/0 (socket says 172.21.15.46:39692) 2023-05-21T16:54:57.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a500af4a0 con 0x7f4a5006d0f0 2023-05-21T16:54:57.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55302700 1 -- 172.21.15.46:0/2142605900 learned_addr learned my addr 172.21.15.46:0/2142605900 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:57.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55b03700 1 --2- 172.21.15.46:0/2142605900 >> v2:172.21.15.46:3300/0 conn(0x7f4a5006d0f0 0x7f4a5015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55b03700 1 -- 172.21.15.46:0/2142605900 >> v1:172.21.15.142:6789/0 conn(0x7f4a500b1d60 legacy=0x7f4a500ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55b03700 1 -- 172.21.15.46:0/2142605900 >> v1:172.21.15.46:6789/0 conn(0x7f4a5015a5f0 legacy=0x7f4a500b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a47fff700 1 -- 172.21.15.46:0/2142605900 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982800213 0 0) 0x7f4a500ae890 con 0x7f4a500b1d60 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55b03700 1 -- 172.21.15.46:0/2142605900 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500aeb70 con 0x7f4a5006d0f0 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a55b03700 1 --2- 172.21.15.46:0/2142605900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5006d0f0 0x7f4a5015eb20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009d90 tx=0x7f4a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98dc86ff090b005 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a47fff700 1 -- 172.21.15.46:0/2142605900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800e070 con 0x7f4a5006d0f0 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a47fff700 1 -- 172.21.15.46:0/2142605900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800bbd0 con 0x7f4a5006d0f0 2023-05-21T16:54:57.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a47fff700 1 -- 172.21.15.46:0/2142605900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48012430 con 0x7f4a5006d0f0 2023-05-21T16:54:57.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- 172.21.15.46:0/2142605900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5006d0f0 msgr2=0x7f4a5015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 --2- 172.21.15.46:0/2142605900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5006d0f0 0x7f4a5015eb20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009d90 tx=0x7f4a4800b330 comp rx=0 tx=0).stop 2023-05-21T16:54:57.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- 172.21.15.46:0/2142605900 shutdown_connections 2023-05-21T16:54:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 --2- 172.21.15.46:0/2142605900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5006d0f0 0x7f4a5015eb20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- 172.21.15.46:0/2142605900 >> 172.21.15.46:0/2142605900 conn(0x7f4a500cfbd0 msgr2=0x7f4a500cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- 172.21.15.46:0/2142605900 shutdown_connections 2023-05-21T16:54:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.788+0000 7f4a56304700 1 -- 172.21.15.46:0/2142605900 wait complete. 2023-05-21T16:54:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.792+0000 7f4a56304700 1 Processor -- start 2023-05-21T16:54:57.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.792+0000 7f4a56304700 1 -- start start 2023-05-21T16:54:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.792+0000 7f4a56304700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a5006d0f0 0x7f4a50143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.792+0000 7f4a56304700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 0x7f4a5015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.792+0000 7f4a56304700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5015a5f0 0x7f4a5015d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a56304700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c83f0 con 0x7f4a500b1d60 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a56304700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c86d0 con 0x7f4a5006d0f0 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a56304700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c89b0 con 0x7f4a5015a5f0 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 0x7f4a5015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 0x7f4a5015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55928/0 (socket says 172.21.15.46:55928) 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 -- 172.21.15.46:0/2399258691 learned_addr learned my addr 172.21.15.46:0/2399258691 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a55302700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a5006d0f0 0x7f4a50143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a55b03700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5015a5f0 0x7f4a5015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 -- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5015a5f0 msgr2=0x7f4a5015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5015a5f0 0x7f4a5015d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 -- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a5006d0f0 msgr2=0x7f4a50143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a5006d0f0 0x7f4a50143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 -- 172.21.15.46:0/2399258691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009a70 con 0x7f4a500b1d60 2023-05-21T16:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a55b03700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5015a5f0 0x7f4a5015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a54b01700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 0x7f4a5015cbf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4a400011e0 tx=0x7f4a4000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400054e0 con 0x7f4a500b1d60 2023-05-21T16:54:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a400036a0 con 0x7f4a500b1d60 2023-05-21T16:54:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a500ca3e0 con 0x7f4a500b1d60 2023-05-21T16:54:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40003a50 con 0x7f4a500b1d60 2023-05-21T16:54:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a500aee50 con 0x7f4a500b1d60 2023-05-21T16:54:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5015a9c0 con 0x7f4a500b1d60 2023-05-21T16:54:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.796+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a40003bb0 con 0x7f4a500b1d60 2023-05-21T16:54:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.800+0000 7f4a45ffb700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a340662f0 0x7f4a340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.800+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a40083270 con 0x7f4a500b1d60 2023-05-21T16:54:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.800+0000 7f4a55302700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a340662f0 0x7f4a340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.800+0000 7f4a55302700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a340662f0 0x7f4a340687a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005930 tx=0x7f4a4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.804+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4a400506f0 con 0x7f4a500b1d60 2023-05-21T16:54:57.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.976+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a50073910 con 0x7f4a500b1d60 2023-05-21T16:54:57.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.980+0000 7f4a45ffb700 1 -- 172.21.15.46:0/2399258691 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a40003e60 con 0x7f4a500b1d60 2023-05-21T16:54:57.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a340662f0 msgr2=0x7f4a340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a340662f0 0x7f4a340687a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005930 tx=0x7f4a4c009040 comp rx=0 tx=0).stop 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 msgr2=0x7f4a5015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 0x7f4a5015cbf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4a400011e0 tx=0x7f4a4000ca30 comp rx=0 tx=0).stop 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 shutdown_connections 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4a340662f0 0x7f4a340687a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5015a5f0 0x7f4a5015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a500b1d60 0x7f4a5015cbf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 --2- 172.21.15.46:0/2399258691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a5006d0f0 0x7f4a50143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:57.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 >> 172.21.15.46:0/2399258691 conn(0x7f4a500cfbd0 msgr2=0x7f4a50158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:57.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 shutdown_connections 2023-05-21T16:54:57.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:57.984+0000 7f4a56304700 1 -- 172.21.15.46:0/2399258691 wait complete. 2023-05-21T16:54:57.990 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:54:58.003 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2023-05-21T16:54:58.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:58.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-21T16:54:58.036 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:54:58.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:54:58.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:54:58.037 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-21T16:54:58.097 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:54:58.097 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:58.104 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:54:58.104 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:54:58.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:54:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 Processor -- start 2023-05-21T16:54:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 -- start start 2023-05-21T16:54:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 0x7ff2a40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2a40b4910 0x7ff2a40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40b8ea0 con 0x7ff2a40b5ce0 2023-05-21T16:54:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40b52f0 con 0x7ff2a40b4910 2023-05-21T16:54:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2ab3a9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40d09d0 con 0x7ff2a40b8ad0 2023-05-21T16:54:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a9ba6700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff2a40b5ce0 0x7ff2a406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39696/0 (socket says 172.21.15.46:39696) 2023-05-21T16:54:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a9ba6700 1 -- 172.21.15.46:0/593246292 learned_addr learned my addr 172.21.15.46:0/593246292 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aaba8700 1 --2- 172.21.15.46:0/593246292 >> v2:172.21.15.142:3300/0 conn(0x7ff2a40b4910 0x7ff2a40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 0x7ff2a40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272169758 0 0) 0x7ff2a40b8ea0 con 0x7ff2a40b5ce0 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2900035d0 con 0x7ff2a40b5ce0 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057460316 0 0) 0x7ff2900035d0 con 0x7ff2a40b5ce0 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 msgr2=0x7ff2a40cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 0x7ff2a40cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 >> v2:172.21.15.142:3300/0 conn(0x7ff2a40b4910 msgr2=0x7ff2a40b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 --2- 172.21.15.46:0/593246292 >> v2:172.21.15.142:3300/0 conn(0x7ff2a40b4910 0x7ff2a40b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40d0cb0 con 0x7ff2a40b5ce0 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7ff294001670 con 0x7ff2a40b5ce0 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 >> v1:172.21.15.46:6789/0 conn(0x7ff2a40b5ce0 legacy=0x7ff2a406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff290003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 0x7ff290004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff290004db0 0x7ff290005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40d09d0 con 0x7ff290003a20 2023-05-21T16:54:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29000ba30 con 0x7ff290004db0 2023-05-21T16:54:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29000bb70 con 0x7ff2a40b8ad0 2023-05-21T16:54:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff290003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aaba8700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff290004db0 0x7ff290005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a9ba6700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 0x7ff290004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 msgr2=0x7ff290004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a40b8ad0 0x7ff290004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff290004db0 msgr2=0x7ff290005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff290004db0 0x7ff290005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/593246292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900035d0 con 0x7ff290003a20 2023-05-21T16:54:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff290003e30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009b70 tx=0x7ff2900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d469db3f91d014d server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.268+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000e6c0 con 0x7ff290003a20 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a000e820 con 0x7ff290003a20 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2a93a5700 1 -- 172.21.15.46:0/593246292 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000eb90 con 0x7ff290003a20 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/593246292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 msgr2=0x7ff290003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/593246292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff290003e30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009b70 tx=0x7ff2900058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2aaba8700 1 -- 172.21.15.46:0/593246292 reap_dead start 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/593246292 shutdown_connections 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/593246292 >> 172.21.15.46:0/593246292 conn(0x7ff2a40d3ae0 msgr2=0x7ff2a40cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/593246292 shutdown_connections 2023-05-21T16:54:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/593246292 wait complete. 2023-05-21T16:54:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 Processor -- start 2023-05-21T16:54:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.272+0000 7ff2ab3a9700 1 -- start start 2023-05-21T16:54:58.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff2a40b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a414ff60 0x7ff2a41503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a415d150 0x7ff2a415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415eb40 con 0x7ff290003a20 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4150910 con 0x7ff2a415d150 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415dec0 con 0x7ff2a414ff60 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff2a40b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff2a40b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55942/0 (socket says 172.21.15.46:55942) 2023-05-21T16:54:58.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/62694180 learned_addr learned my addr 172.21.15.46:0/62694180 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2a9ba6700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a414ff60 0x7ff2a41503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aaba8700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a415d150 0x7ff2a415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a414ff60 msgr2=0x7ff2a41503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a414ff60 0x7ff2a41503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a415d150 msgr2=0x7ff2a415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a415d150 0x7ff2a415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 -- 172.21.15.46:0/62694180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40cd790 con 0x7ff290003a20 2023-05-21T16:54:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2aa3a7700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff2a40b74e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff290004740 tx=0x7ff2a00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000e6c0 con 0x7ff290003a20 2023-05-21T16:54:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a0013d30 con 0x7ff290003a20 2023-05-21T16:54:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a40cd4f0 con 0x7ff290003a20 2023-05-21T16:54:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0013ea0 con 0x7ff290003a20 2023-05-21T16:54:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.276+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a40cda70 con 0x7ff290003a20 2023-05-21T16:54:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.280+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a415edb0 con 0x7ff290003a20 2023-05-21T16:54:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.280+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff2a0004270 con 0x7ff290003a20 2023-05-21T16:54:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.280+0000 7ff29affd700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff2880662f0 0x7ff2880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.280+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2a00853e0 con 0x7ff290003a20 2023-05-21T16:54:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.280+0000 7ff2a9ba6700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff2880662f0 0x7ff2880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.280+0000 7ff2a9ba6700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff2880662f0 0x7ff2880687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff294000c00 tx=0x7ff2940079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.288+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff2a00528f0 con 0x7ff290003a20 2023-05-21T16:54:58.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.456+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a4073400 con 0x7ff290003a20 2023-05-21T16:54:58.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff29affd700 1 -- 172.21.15.46:0/62694180 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7ff2a0004520 con 0x7ff290003a20 2023-05-21T16:54:58.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:54:58.465 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:19.143526+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:54:58.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff2880662f0 msgr2=0x7ff2880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff2880662f0 0x7ff2880687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff294000c00 tx=0x7ff2940079a0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 msgr2=0x7ff2a40b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff2a40b74e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff290004740 tx=0x7ff2a00047e0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 shutdown_connections 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff2880662f0 0x7ff2880687a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2a415d150 0x7ff2a415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2a414ff60 0x7ff2a41503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 --2- 172.21.15.46:0/62694180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff290003a20 0x7ff2a40b74e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 >> 172.21.15.46:0/62694180 conn(0x7ff2a40d3ae0 msgr2=0x7ff2a406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 shutdown_connections 2023-05-21T16:54:58.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.460+0000 7ff2ab3a9700 1 -- 172.21.15.46:0/62694180 wait complete. 2023-05-21T16:54:58.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:54:58.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:54:58.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 Processor -- start 2023-05-21T16:54:58.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 -- start start 2023-05-21T16:54:58.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00cc8d0 0x7fb5c00ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5c00ccd50 0x7fb5c00ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00af330 con 0x7fb5c00ca730 2023-05-21T16:54:58.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c015cf70 con 0x7fb5c00ccd50 2023-05-21T16:54:58.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.596+0000 7fb5c62ec700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015de40 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c5aeb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5c00ccd50 0x7fb5c00ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c5aeb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5c00ccd50 0x7fb5c00ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:49752/0 (socket says 172.21.15.46:49752) 2023-05-21T16:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c5aeb700 1 -- 172.21.15.46:0/3864804507 learned_addr learned my addr 172.21.15.46:0/3864804507 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c4ae9700 1 --2- 172.21.15.46:0/3864804507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00cc8d0 0x7fb5c00ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3864804507 >> v2:172.21.15.142:3300/0 conn(0x7fb5c00ccd50 msgr2=0x7fb5c00ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c4ae9700 1 --2- 172.21.15.46:0/3864804507 >> v2:172.21.15.142:3300/0 conn(0x7fb5c00ccd50 0x7fb5c00ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3864804507 >> v1:172.21.15.142:6789/0 conn(0x7fb5c00ca730 legacy=0x7fb5c00cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3864804507 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c015d230 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c4ae9700 1 --2- 172.21.15.46:0/3864804507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00cc8d0 0x7fb5c00ce2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009850 tx=0x7fb5a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3846a293699d3629 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5bffff700 1 -- 172.21.15.46:0/3864804507 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011830 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5bffff700 1 -- 172.21.15.46:0/3864804507 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8011990 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5bffff700 1 -- 172.21.15.46:0/3864804507 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011d40 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3864804507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00cc8d0 msgr2=0x7fb5c00ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3864804507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00cc8d0 0x7fb5c00ce2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009850 tx=0x7fb5a8009b60 comp rx=0 tx=0).stop 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3864804507 shutdown_connections 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3864804507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00cc8d0 0x7fb5c00ce2d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3864804507 >> v2:172.21.15.142:3300/0 conn(0x7fb5c00ccd50 0x7fb5c00ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3864804507 >> 172.21.15.46:0/3864804507 conn(0x7fb5c006d930 msgr2=0x7fb5c006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3864804507 shutdown_connections 2023-05-21T16:54:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.600+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3864804507 wait complete. 2023-05-21T16:54:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 Processor -- start 2023-05-21T16:54:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 -- start start 2023-05-21T16:54:58.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00ca730 0x7fb5c0147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 0x7fb5c0155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c00ccd50 0x7fb5c014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00c4190 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c01f26b0 con 0x7fb5c00ccd50 2023-05-21T16:54:58.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c62ec700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00c3e60 con 0x7fb5c00ca730 2023-05-21T16:54:58.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 0x7fb5c0155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 0x7fb5c0155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55952/0 (socket says 172.21.15.46:55952) 2023-05-21T16:54:58.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3147643210 learned_addr learned my addr 172.21.15.46:0/3147643210 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:58.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c52ea700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00ca730 0x7fb5c0147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c5aeb700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c00ccd50 0x7fb5c014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00ca730 msgr2=0x7fb5c0147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00ca730 0x7fb5c0147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c00ccd50 msgr2=0x7fb5c014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c00ccd50 0x7fb5c014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 -- 172.21.15.46:0/3147643210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a80094b0 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c5aeb700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c00ccd50 0x7fb5c014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.604+0000 7fb5c4ae9700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 0x7fb5c0155110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80090b0 tx=0x7fb5a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8004480 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a801f070 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c015d7f0 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8003900 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c015d510 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c015dad0 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5a8021030 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5bdffb700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb5a00662f0 0x7fb5a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5a8085230 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.608+0000 7fb5c52ea700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb5a00662f0 0x7fb5a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.612+0000 7fb5c52ea700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb5a00662f0 0x7fb5a00687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80012e0 tx=0x7fb5b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.616+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb5a8052910 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5c0073cb0 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5bdffb700 1 -- 172.21.15.46:0/3147643210 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5a8055f30 con 0x7fb5c00cc8d0 2023-05-21T16:54:58.786 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:54:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb5a00662f0 msgr2=0x7fb5a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb5a00662f0 0x7fb5a00687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80012e0 tx=0x7fb5b8009040 comp rx=0 tx=0).stop 2023-05-21T16:54:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 msgr2=0x7fb5c0155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 0x7fb5c0155110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80090b0 tx=0x7fb5a8004770 comp rx=0 tx=0).stop 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 shutdown_connections 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb5a00662f0 0x7fb5a00687a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5c00ccd50 0x7fb5c014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5c00cc8d0 0x7fb5c0155110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 --2- 172.21.15.46:0/3147643210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5c00ca730 0x7fb5c0147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.780+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 >> 172.21.15.46:0/3147643210 conn(0x7fb5c006d930 msgr2=0x7fb5c00b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.784+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 shutdown_connections 2023-05-21T16:54:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.784+0000 7fb5c62ec700 1 -- 172.21.15.46:0/3147643210 wait complete. 2023-05-21T16:54:58.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:54:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d0a925700 1 Processor -- start 2023-05-21T16:54:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d0a925700 1 -- start start 2023-05-21T16:54:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d0a925700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d040b8ad0 0x7f6d040cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d0a925700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040b8ea0 con 0x7f6d040b5ce0 2023-05-21T16:54:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d0a925700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040d09d0 con 0x7f6d040b4910 2023-05-21T16:54:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d0a925700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040d0cb0 con 0x7f6d040b8ad0 2023-05-21T16:54:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d09122700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6d040b5ce0 0x7f6d0406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39702/0 (socket says 172.21.15.46:39702) 2023-05-21T16:54:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d09122700 1 -- 172.21.15.46:0/2331389420 learned_addr learned my addr 172.21.15.46:0/2331389420 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:58.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d09923700 1 --2- 172.21.15.46:0/2331389420 >> v2:172.21.15.142:3300/0 conn(0x7f6d040b8ad0 0x7f6d040cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994485240 0 0) 0x7f6d040b8ea0 con 0x7f6d040b5ce0 2023-05-21T16:54:58.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf00035d0 con 0x7f6d040b5ce0 2023-05-21T16:54:58.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729150135 0 0) 0x7f6cf00035d0 con 0x7f6d040b5ce0 2023-05-21T16:54:58.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 >> v2:172.21.15.142:3300/0 conn(0x7f6d040b8ad0 msgr2=0x7f6d040cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 --2- 172.21.15.46:0/2331389420 >> v2:172.21.15.142:3300/0 conn(0x7f6d040b8ad0 0x7f6d040cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 >> v1:172.21.15.142:6789/0 conn(0x7f6d040b4910 legacy=0x7f6d040d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040cd4f0 con 0x7f6d040b5ce0 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f6d00001670 con 0x7f6d040b5ce0 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 >> v1:172.21.15.46:6789/0 conn(0x7f6d040b5ce0 legacy=0x7f6d0406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0003a20 0x7f6cf0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf0004410 0x7f6cf00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0005170 0x7f6cf000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040d0cb0 con 0x7f6cf0003a20 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf000c0a0 con 0x7f6cf0004410 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf000c260 con 0x7f6cf0005170 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.912+0000 7f6d09923700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0003a20 0x7f6cf0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a124700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0005170 0x7f6cf000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09122700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf0004410 0x7f6cf00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09923700 1 -- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0005170 msgr2=0x7f6cf000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09923700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0005170 0x7f6cf000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09923700 1 -- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf0004410 msgr2=0x7f6cf00048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:58.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09923700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf0004410 0x7f6cf00048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09923700 1 -- 172.21.15.46:0/2331389420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00035d0 con 0x7f6cf0003a20 2023-05-21T16:54:58.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a124700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0005170 0x7f6cf000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:58.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a124700 1 -- 172.21.15.46:0/2331389420 reap_dead start 2023-05-21T16:54:58.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d09923700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0003a20 0x7f6cf0003df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009b70 tx=0x7f6cf00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee80c080d3ce9d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400e6c0 con 0x7f6cf0003a20 2023-05-21T16:54:58.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400e820 con 0x7f6cf0003a20 2023-05-21T16:54:58.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d08921700 1 -- 172.21.15.46:0/2331389420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400eb90 con 0x7f6cf0003a20 2023-05-21T16:54:58.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 -- 172.21.15.46:0/2331389420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0003a20 msgr2=0x7f6cf0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0003a20 0x7f6cf0003df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009b70 tx=0x7f6cf00058a0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 -- 172.21.15.46:0/2331389420 shutdown_connections 2023-05-21T16:54:58.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 --2- 172.21.15.46:0/2331389420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0003a20 0x7f6cf0003df0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 -- 172.21.15.46:0/2331389420 >> 172.21.15.46:0/2331389420 conn(0x7f6d040d3ae0 msgr2=0x7f6d040cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:58.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 -- 172.21.15.46:0/2331389420 shutdown_connections 2023-05-21T16:54:58.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 -- 172.21.15.46:0/2331389420 wait complete. 2023-05-21T16:54:58.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 Processor -- start 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.916+0000 7f6d0a925700 1 -- start start 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0003a20 0x7f6d040c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 0x7f6d040cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0415fd60 0x7f6d0415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04160700 con 0x7f6d0415af30 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041609e0 con 0x7f6d0415fd60 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0415c0a0 con 0x7f6cf0003a20 2023-05-21T16:54:58.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 0x7f6d040cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 0x7f6d040cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55970/0 (socket says 172.21.15.46:55970) 2023-05-21T16:54:58.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 -- 172.21.15.46:0/3327596992 learned_addr learned my addr 172.21.15.46:0/3327596992 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:58.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a124700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0415fd60 0x7f6d0415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09923700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0003a20 0x7f6d040c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 -- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0003a20 msgr2=0x7f6d040c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0003a20 0x7f6d040c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 -- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0415fd60 msgr2=0x7f6d0415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0415fd60 0x7f6d0415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 -- 172.21.15.46:0/3327596992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040cda70 con 0x7f6d0415af30 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a124700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0415fd60 0x7f6d0415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d09122700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 0x7f6d040cc4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d00001200 tx=0x7f6d0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00005e00 con 0x7f6d0415af30 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000c780 con 0x7f6d0415af30 2023-05-21T16:54:58.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d040cd790 con 0x7f6d0415af30 2023-05-21T16:54:58.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000cb30 con 0x7f6d0415af30 2023-05-21T16:54:58.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.920+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d040cf310 con 0x7f6d0415af30 2023-05-21T16:54:58.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.924+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d040733b0 con 0x7f6d0415af30 2023-05-21T16:54:58.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.924+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d0000cc90 con 0x7f6d0415af30 2023-05-21T16:54:58.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.924+0000 7f6cfa7fc700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6ce8066320 0x7f6ce80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:58.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.924+0000 7f6d09923700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6ce8066320 0x7f6ce80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:58.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.924+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d00083b90 con 0x7f6d0415af30 2023-05-21T16:54:58.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.924+0000 7f6d09923700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6ce8066320 0x7f6ce80687d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40090b0 tx=0x7f6cf4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:58.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:58.932+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6d00050f70 con 0x7f6d0415af30 2023-05-21T16:54:59.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.092+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d0406b3e0 con 0x7f6d0415af30 2023-05-21T16:54:59.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.092+0000 7f6cfa7fc700 1 -- 172.21.15.46:0/3327596992 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d00054590 con 0x7f6d0415af30 2023-05-21T16:54:59.100 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:54:59.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6ce8066320 msgr2=0x7f6ce80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6ce8066320 0x7f6ce80687d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40090b0 tx=0x7f6cf4008030 comp rx=0 tx=0).stop 2023-05-21T16:54:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 msgr2=0x7f6d040cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 0x7f6d040cc4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6d00001200 tx=0x7f6d0000ee80 comp rx=0 tx=0).stop 2023-05-21T16:54:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 shutdown_connections 2023-05-21T16:54:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6ce8066320 0x7f6ce80687d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d0415fd60 0x7f6d0415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d0415af30 0x7f6d040cc4e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 --2- 172.21.15.46:0/3327596992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf0003a20 0x7f6d040c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 >> 172.21.15.46:0/3327596992 conn(0x7f6d040d3ae0 msgr2=0x7f6d0415b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 shutdown_connections 2023-05-21T16:54:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.096+0000 7f6d0a925700 1 -- 172.21.15.46:0/3327596992 wait complete. 2023-05-21T16:54:59.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:54:59.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.228+0000 7faf3f59e700 1 Processor -- start 2023-05-21T16:54:59.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.228+0000 7faf3f59e700 1 -- start start 2023-05-21T16:54:59.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.228+0000 7faf3f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf4006c760 0x7faf4015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf4015dbb0 0x7faf4006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4006b9d0 con 0x7faf40069f80 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4006b450 con 0x7faf4015dbb0 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf40159a90 con 0x7faf4006c760 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3dd9b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf4015dbb0 0x7faf4006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf4006c760 0x7faf4015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf4006c760 0x7faf4015a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:49806/0 (socket says 172.21.15.46:49806) 2023-05-21T16:54:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 -- 172.21.15.46:0/3011386644 learned_addr learned my addr 172.21.15.46:0/3011386644 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:59.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 -- 172.21.15.46:0/3011386644 >> v2:172.21.15.46:3300/0 conn(0x7faf4015dbb0 msgr2=0x7faf4006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:54:59.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 --2- 172.21.15.46:0/3011386644 >> v2:172.21.15.46:3300/0 conn(0x7faf4015dbb0 0x7faf4006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 -- 172.21.15.46:0/3011386644 >> v1:172.21.15.142:6789/0 conn(0x7faf40069f80 legacy=0x7faf4006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 -- 172.21.15.46:0/3011386644 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4006d070 con 0x7faf4006c760 2023-05-21T16:54:59.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3dd9b700 1 --2- 172.21.15.46:0/3011386644 >> v2:172.21.15.46:3300/0 conn(0x7faf4015dbb0 0x7faf4006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3e59c700 1 --2- 172.21.15.46:0/3011386644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4006c760 0x7faf4015a830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf4006c3c0 tx=0x7faf30009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c4b676343b63920 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3d59a700 1 -- 172.21.15.46:0/3011386644 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011830 con 0x7faf4006c760 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3d59a700 1 -- 172.21.15.46:0/3011386644 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011990 con 0x7faf4006c760 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3d59a700 1 -- 172.21.15.46:0/3011386644 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011d20 con 0x7faf4006c760 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- 172.21.15.46:0/3011386644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4006c760 msgr2=0x7faf4015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 --2- 172.21.15.46:0/3011386644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4006c760 0x7faf4015a830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf4006c3c0 tx=0x7faf30009bf0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- 172.21.15.46:0/3011386644 shutdown_connections 2023-05-21T16:54:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 --2- 172.21.15.46:0/3011386644 >> v2:172.21.15.46:3300/0 conn(0x7faf4015dbb0 0x7faf4006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 --2- 172.21.15.46:0/3011386644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4006c760 0x7faf4015a830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- 172.21.15.46:0/3011386644 >> 172.21.15.46:0/3011386644 conn(0x7faf400cf720 msgr2=0x7faf400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:59.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- 172.21.15.46:0/3011386644 shutdown_connections 2023-05-21T16:54:59.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.232+0000 7faf3f59e700 1 -- 172.21.15.46:0/3011386644 wait complete. 2023-05-21T16:54:59.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 Processor -- start 2023-05-21T16:54:59.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 -- start start 2023-05-21T16:54:59.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf40069f80 0x7faf400b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 0x7faf40155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4015dbb0 0x7faf400b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400b48a0 con 0x7faf4006c760 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400b2f60 con 0x7faf4015dbb0 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf400b2390 con 0x7faf40069f80 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 0x7faf40155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf40069f80 0x7faf400b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 0x7faf40155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55990/0 (socket says 172.21.15.46:55990) 2023-05-21T16:54:59.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 -- 172.21.15.46:0/175623970 learned_addr learned my addr 172.21.15.46:0/175623970 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:59.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3ed9d700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4015dbb0 0x7faf400b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 -- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf40069f80 msgr2=0x7faf400b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf40069f80 0x7faf400b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 -- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4015dbb0 msgr2=0x7faf400b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4015dbb0 0x7faf400b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 -- 172.21.15.46:0/175623970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280094b0 con 0x7faf4006c760 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3ed9d700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4015dbb0 0x7faf400b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3dd9b700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 0x7faf40155880 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf2800ebe0 tx=0x7faf2800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28009770 con 0x7faf4006c760 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2800c850 con 0x7faf4006c760 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf30009570 con 0x7faf4006c760 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800cbe0 con 0x7faf4006c760 2023-05-21T16:54:59.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.236+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf40159d50 con 0x7faf4006c760 2023-05-21T16:54:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.240+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4006b6f0 con 0x7faf4006c760 2023-05-21T16:54:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.240+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf2800cd40 con 0x7faf4006c760 2023-05-21T16:54:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.240+0000 7faf36ffd700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faf20066320 0x7faf200687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.240+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf28083c90 con 0x7faf4006c760 2023-05-21T16:54:59.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.240+0000 7faf3e59c700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faf20066320 0x7faf200687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.240+0000 7faf3e59c700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faf20066320 0x7faf200687d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faf30000c00 tx=0x7faf30020040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.248+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faf28051110 con 0x7faf4006c760 2023-05-21T16:54:59.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.412+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf4015a030 con 0x7faf4006c760 2023-05-21T16:54:59.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.412+0000 7faf36ffd700 1 -- 172.21.15.46:0/175623970 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf28054730 con 0x7faf4006c760 2023-05-21T16:54:59.418 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faf20066320 msgr2=0x7faf200687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faf20066320 0x7faf200687d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faf30000c00 tx=0x7faf30020040 comp rx=0 tx=0).stop 2023-05-21T16:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 msgr2=0x7faf40155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 0x7faf40155880 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf2800ebe0 tx=0x7faf2800eef0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 shutdown_connections 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faf20066320 0x7faf200687d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf4015dbb0 0x7faf400b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf4006c760 0x7faf40155880 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 --2- 172.21.15.46:0/175623970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf40069f80 0x7faf400b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 >> 172.21.15.46:0/175623970 conn(0x7faf400cf720 msgr2=0x7faf4015a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 shutdown_connections 2023-05-21T16:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.416+0000 7faf3f59e700 1 -- 172.21.15.46:0/175623970 wait complete. 2023-05-21T16:54:59.433 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:54:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7430ea700 1 Processor -- start 2023-05-21T16:54:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7430ea700 1 -- start start 2023-05-21T16:54:59.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7430ea700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b5020 0x7fa73c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7430ea700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0b8ea0 con 0x7fa73c0b8ad0 2023-05-21T16:54:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7430ea700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0d09d0 con 0x7fa73c0b5ce0 2023-05-21T16:54:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7430ea700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0d0cb0 con 0x7fa73c0b5020 2023-05-21T16:54:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7420e8700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa73c0b8ad0 0x7fa73c06a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39708/0 (socket says 172.21.15.46:39708) 2023-05-21T16:54:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7420e8700 1 -- 172.21.15.46:0/1687668056 learned_addr learned my addr 172.21.15.46:0/1687668056 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7428e9700 1 --2- 172.21.15.46:0/1687668056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b5020 0x7fa73c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.548+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081439660 0 0) 0x7fa73c0b8ea0 con 0x7fa73c0b8ad0 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7280035d0 con 0x7fa73c0b8ad0 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618868807 0 0) 0x7fa73c0d09d0 con 0x7fa73c0b5ce0 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c0b8ea0 con 0x7fa73c0b5ce0 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7428e9700 1 -- 172.21.15.46:0/1687668056 >> v1:172.21.15.142:6789/0 conn(0x7fa73c0b5ce0 legacy=0x7fa73c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7428e9700 1 -- 172.21.15.46:0/1687668056 >> v1:172.21.15.46:6789/0 conn(0x7fa73c0b8ad0 legacy=0x7fa73c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7428e9700 1 -- 172.21.15.46:0/1687668056 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0cd4f0 con 0x7fa73c0b5020 2023-05-21T16:54:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7428e9700 1 --2- 172.21.15.46:0/1687668056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b5020 0x7fa73c0cf310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa734009dc0 tx=0x7fa73400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce80e6d3a76a3de server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400e070 con 0x7fa73c0b5020 2023-05-21T16:54:59.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400bb20 con 0x7fa73c0b5020 2023-05-21T16:54:59.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7410e6700 1 -- 172.21.15.46:0/1687668056 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734012430 con 0x7fa73c0b5020 2023-05-21T16:54:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 -- 172.21.15.46:0/1687668056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b5020 msgr2=0x7fa73c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 --2- 172.21.15.46:0/1687668056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b5020 0x7fa73c0cf310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa734009dc0 tx=0x7fa73400b330 comp rx=0 tx=0).stop 2023-05-21T16:54:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 -- 172.21.15.46:0/1687668056 shutdown_connections 2023-05-21T16:54:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 --2- 172.21.15.46:0/1687668056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b5020 0x7fa73c0cf310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 -- 172.21.15.46:0/1687668056 >> 172.21.15.46:0/1687668056 conn(0x7fa73c0d3ae0 msgr2=0x7fa73c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:59.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 -- 172.21.15.46:0/1687668056 shutdown_connections 2023-05-21T16:54:59.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 -- 172.21.15.46:0/1687668056 wait complete. 2023-05-21T16:54:59.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.552+0000 7fa7430ea700 1 Processor -- start 2023-05-21T16:54:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 -- start start 2023-05-21T16:54:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 0x7fa73c0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c0b5ce0 0x7fa73c0cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b8ad0 0x7fa73c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c7ff0 con 0x7fa73c0b5020 2023-05-21T16:54:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0ccdc0 con 0x7fa73c0b5ce0 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c7650 con 0x7fa73c0b8ad0 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 0x7fa73c0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 0x7fa73c0cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55996/0 (socket says 172.21.15.46:55996) 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 -- 172.21.15.46:0/4075663373 learned_addr learned my addr 172.21.15.46:0/4075663373 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7428e9700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b8ad0 0x7fa73c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7418e7700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c0b5ce0 0x7fa73c0cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 -- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b8ad0 msgr2=0x7fa73c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b8ad0 0x7fa73c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 -- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c0b5ce0 msgr2=0x7fa73c0cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c0b5ce0 0x7fa73c0cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 -- 172.21.15.46:0/4075663373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009a70 con 0x7fa73c0b5020 2023-05-21T16:54:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7420e8700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 0x7fa73c0cac40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c500 tx=0x7fa73000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730005d90 con 0x7fa73c0b5020 2023-05-21T16:54:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300070d0 con 0x7fa73c0b5020 2023-05-21T16:54:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0cda70 con 0x7fa73c0b5020 2023-05-21T16:54:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730007460 con 0x7fa73c0b5020 2023-05-21T16:54:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.556+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0cd790 con 0x7fa73c0b5020 2023-05-21T16:54:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.560+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7300075c0 con 0x7fa73c0b5020 2023-05-21T16:54:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.560+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c167550 con 0x7fa73c0b5020 2023-05-21T16:54:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.560+0000 7fa72effd700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa7200662f0 0x7fa7200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.560+0000 7fa7418e7700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa7200662f0 0x7fa7200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.560+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa730083270 con 0x7fa73c0b5020 2023-05-21T16:54:59.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.560+0000 7fa7418e7700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa7200662f0 0x7fa7200687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa738007fd0 tx=0x7fa738009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.564+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa7300506f0 con 0x7fa73c0b5020 2023-05-21T16:54:59.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.728+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa73c0733b0 con 0x7fa73c0b5020 2023-05-21T16:54:59.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.728+0000 7fa72effd700 1 -- 172.21.15.46:0/4075663373 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa730053d10 con 0x7fa73c0b5020 2023-05-21T16:54:59.736 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:54:59.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa7200662f0 msgr2=0x7fa7200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa7200662f0 0x7fa7200687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa738007fd0 tx=0x7fa738009040 comp rx=0 tx=0).stop 2023-05-21T16:54:59.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 msgr2=0x7fa73c0cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 0x7fa73c0cac40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c500 tx=0x7fa73000c8c0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 shutdown_connections 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa7200662f0 0x7fa7200687a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa73c0b8ad0 0x7fa73c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c0b5ce0 0x7fa73c0cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 --2- 172.21.15.46:0/4075663373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa73c0b5020 0x7fa73c0cac40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 >> 172.21.15.46:0/4075663373 conn(0x7fa73c0d3ae0 msgr2=0x7fa73c0b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:59.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 shutdown_connections 2023-05-21T16:54:59.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.732+0000 7fa7430ea700 1 -- 172.21.15.46:0/4075663373 wait complete. 2023-05-21T16:54:59.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:54:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73edf19700 1 Processor -- start 2023-05-21T16:54:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73edf19700 1 -- start start 2023-05-21T16:54:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73edf19700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73e806a420 0x7f73e80c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73edf19700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80ade30 con 0x7f73e8160be0 2023-05-21T16:54:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73edf19700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80cd210 con 0x7f73e8069f80 2023-05-21T16:54:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73edf19700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e80cc970 con 0x7f73e806a420 2023-05-21T16:54:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ecf17700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f73e8160be0 0x7f73e81651c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39712/0 (socket says 172.21.15.46:39712) 2023-05-21T16:54:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ecf17700 1 -- 172.21.15.46:0/488914434 learned_addr learned my addr 172.21.15.46:0/488914434 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:54:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ed718700 1 --2- 172.21.15.46:0/488914434 >> v2:172.21.15.142:3300/0 conn(0x7f73e806a420 0x7f73e80c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73e77fe700 1 -- 172.21.15.46:0/488914434 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133371856 0 0) 0x7f73e80ade30 con 0x7f73e8160be0 2023-05-21T16:54:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73e77fe700 1 -- 172.21.15.46:0/488914434 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d40035d0 con 0x7f73e8160be0 2023-05-21T16:54:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73e77fe700 1 -- 172.21.15.46:0/488914434 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1987576238 0 0) 0x7f73d40035d0 con 0x7f73e8160be0 2023-05-21T16:54:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ed718700 1 -- 172.21.15.46:0/488914434 >> v1:172.21.15.142:6789/0 conn(0x7f73e8069f80 legacy=0x7f73e8070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ed718700 1 -- 172.21.15.46:0/488914434 >> v1:172.21.15.46:6789/0 conn(0x7f73e8160be0 legacy=0x7f73e81651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ed718700 1 -- 172.21.15.46:0/488914434 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80ccc50 con 0x7f73e806a420 2023-05-21T16:54:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73ed718700 1 --2- 172.21.15.46:0/488914434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e806a420 0x7f73e80c18a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009880 tx=0x7f73e0009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0abc8f619814f3b server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73e77fe700 1 -- 172.21.15.46:0/488914434 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0001670 con 0x7f73e806a420 2023-05-21T16:54:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73e77fe700 1 -- 172.21.15.46:0/488914434 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0010590 con 0x7f73e806a420 2023-05-21T16:54:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.856+0000 7f73e77fe700 1 -- 172.21.15.46:0/488914434 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0010940 con 0x7f73e806a420 2023-05-21T16:54:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 -- 172.21.15.46:0/488914434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e806a420 msgr2=0x7f73e80c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 --2- 172.21.15.46:0/488914434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e806a420 0x7f73e80c18a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009880 tx=0x7f73e0009b90 comp rx=0 tx=0).stop 2023-05-21T16:54:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 -- 172.21.15.46:0/488914434 shutdown_connections 2023-05-21T16:54:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 --2- 172.21.15.46:0/488914434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e806a420 0x7f73e80c18a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 -- 172.21.15.46:0/488914434 >> 172.21.15.46:0/488914434 conn(0x7f73e80cf720 msgr2=0x7f73e80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:54:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 -- 172.21.15.46:0/488914434 shutdown_connections 2023-05-21T16:54:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 -- 172.21.15.46:0/488914434 wait complete. 2023-05-21T16:54:59.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 Processor -- start 2023-05-21T16:54:59.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.860+0000 7f73edf19700 1 -- start start 2023-05-21T16:54:59.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e8069f80 0x7f73e80c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73e806a420 0x7f73e8162480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 0x7f73e80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80c2be0 con 0x7f73e8160be0 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80c33c0 con 0x7f73e8069f80 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81620b0 con 0x7f73e806a420 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 0x7f73e80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 0x7f73e80c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56008/0 (socket says 172.21.15.46:56008) 2023-05-21T16:54:59.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 -- 172.21.15.46:0/4068923977 learned_addr learned my addr 172.21.15.46:0/4068923977 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:54:59.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ecf17700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e8069f80 0x7f73e80c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73e7fff700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73e806a420 0x7f73e8162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 -- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73e806a420 msgr2=0x7f73e8162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73e806a420 0x7f73e8162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 -- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e8069f80 msgr2=0x7f73e80c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:54:59.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e8069f80 0x7f73e80c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:54:59.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 -- 172.21.15.46:0/4068923977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00094b0 con 0x7f73e8160be0 2023-05-21T16:54:59.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73ed718700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 0x7f73e80c49b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ee0 tx=0x7f73e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0004450 con 0x7f73e8160be0 2023-05-21T16:54:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8070730 con 0x7f73e8160be0 2023-05-21T16:54:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e00045d0 con 0x7f73e8160be0 2023-05-21T16:54:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0003900 con 0x7f73e8160be0 2023-05-21T16:54:59.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.864+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e80ccf30 con 0x7f73e8160be0 2023-05-21T16:54:59.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.868+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e80ae1a0 con 0x7f73e8160be0 2023-05-21T16:54:59.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.868+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73e0003a60 con 0x7f73e8160be0 2023-05-21T16:54:59.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.868+0000 7f73e57fa700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73c80662f0 0x7f73c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:54:59.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.868+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f73e0085240 con 0x7f73e8160be0 2023-05-21T16:54:59.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.868+0000 7f73ecf17700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73c80662f0 0x7f73c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:54:59.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.868+0000 7f73ecf17700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73c80662f0 0x7f73c80687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73d0000f60 tx=0x7f73d0001e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:54:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:54:59.876+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f73e0052690 con 0x7f73e8160be0 2023-05-21T16:55:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.052+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73e80733b0 con 0x7f73e8160be0 2023-05-21T16:55:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73e57fa700 1 -- 172.21.15.46:0/4068923977 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73e0055cb0 con 0x7f73e8160be0 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73c80662f0 msgr2=0x7f73c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73c80662f0 0x7f73c80687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73d0000f60 tx=0x7f73d0001e20 comp rx=0 tx=0).stop 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 msgr2=0x7f73e80c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 0x7f73e80c49b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ee0 tx=0x7f73e0004770 comp rx=0 tx=0).stop 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 shutdown_connections 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f73c80662f0 0x7f73c80687a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73e8160be0 0x7f73e80c49b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73e806a420 0x7f73e8162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 --2- 172.21.15.46:0/4068923977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73e8069f80 0x7f73e80c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 >> 172.21.15.46:0/4068923977 conn(0x7f73e80cf720 msgr2=0x7f73e80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:00.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 shutdown_connections 2023-05-21T16:55:00.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.056+0000 7f73edf19700 1 -- 172.21.15.46:0/4068923977 wait complete. 2023-05-21T16:55:00.065 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:55:00.075 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:55:00.076 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:55:00.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:00.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 Processor -- start 2023-05-21T16:55:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 -- start start 2023-05-21T16:55:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f596015d460 0x7f5960070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5960070ad0 0x7f59600ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5960159df0 con 0x7f5960158d90 2023-05-21T16:55:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596015a280 con 0x7f596015d460 2023-05-21T16:55:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5960070f10 con 0x7f5960070ad0 2023-05-21T16:55:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595e7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f596015d460 0x7f5960070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595effd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5960158d90 0x7f59600ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39718/0 (socket says 172.21.15.46:39718) 2023-05-21T16:55:00.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595effd700 1 -- 172.21.15.46:0/62110324 learned_addr learned my addr 172.21.15.46:0/62110324 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:00.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.188+0000 7f595f7fe700 1 --2- 172.21.15.46:0/62110324 >> v2:172.21.15.142:3300/0 conn(0x7f5960070ad0 0x7f59600ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595e7fc700 1 -- 172.21.15.46:0/62110324 >> v2:172.21.15.142:3300/0 conn(0x7f5960070ad0 msgr2=0x7f59600ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:00.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595e7fc700 1 --2- 172.21.15.46:0/62110324 >> v2:172.21.15.142:3300/0 conn(0x7f5960070ad0 0x7f59600ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595e7fc700 1 -- 172.21.15.46:0/62110324 >> v1:172.21.15.46:6789/0 conn(0x7f5960158d90 legacy=0x7f59600ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595dffb700 1 -- 172.21.15.46:0/62110324 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025683699 0 0) 0x7f5960159df0 con 0x7f5960158d90 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595e7fc700 1 -- 172.21.15.46:0/62110324 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600cd730 con 0x7f596015d460 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595e7fc700 1 --2- 172.21.15.46:0/62110324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596015d460 0x7f5960070590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5960159d60 tx=0x7f595800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f60ded4c4081c78 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595dffb700 1 -- 172.21.15.46:0/62110324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800f070 con 0x7f596015d460 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595dffb700 1 -- 172.21.15.46:0/62110324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800a2e0 con 0x7f596015d460 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595dffb700 1 -- 172.21.15.46:0/62110324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800cb50 con 0x7f596015d460 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- 172.21.15.46:0/62110324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596015d460 msgr2=0x7f5960070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 --2- 172.21.15.46:0/62110324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596015d460 0x7f5960070590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5960159d60 tx=0x7f595800c330 comp rx=0 tx=0).stop 2023-05-21T16:55:00.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- 172.21.15.46:0/62110324 shutdown_connections 2023-05-21T16:55:00.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 --2- 172.21.15.46:0/62110324 >> v2:172.21.15.142:3300/0 conn(0x7f5960070ad0 0x7f59600ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 --2- 172.21.15.46:0/62110324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f596015d460 0x7f5960070590 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- 172.21.15.46:0/62110324 >> 172.21.15.46:0/62110324 conn(0x7f59600cf720 msgr2=0x7f59600cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:00.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- 172.21.15.46:0/62110324 shutdown_connections 2023-05-21T16:55:00.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- 172.21.15.46:0/62110324 wait complete. 2023-05-21T16:55:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 Processor -- start 2023-05-21T16:55:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- start start 2023-05-21T16:55:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 0x7f59600b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5960158d90 0x7f596014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596015d460 0x7f59600af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600b14f0 con 0x7f5960070ad0 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600b3420 con 0x7f596015d460 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.192+0000 7f595ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600b3700 con 0x7f5960158d90 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 0x7f59600b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 0x7f59600b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56034/0 (socket says 172.21.15.46:56034) 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 -- 172.21.15.46:0/4008164981 learned_addr learned my addr 172.21.15.46:0/4008164981 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595f7fe700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596015d460 0x7f59600af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595e7fc700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5960158d90 0x7f596014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 -- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5960158d90 msgr2=0x7f596014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5960158d90 0x7f596014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 -- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596015d460 msgr2=0x7f59600af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596015d460 0x7f59600af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 -- 172.21.15.46:0/4008164981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595800ab80 con 0x7f5960070ad0 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595effd700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 0x7f59600b2d40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f594800c580 tx=0x7f594800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948004ca0 con 0x7f5960070ad0 2023-05-21T16:55:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5948004e20 con 0x7f5960070ad0 2023-05-21T16:55:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59601597a0 con 0x7f5960070ad0 2023-05-21T16:55:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948007310 con 0x7f5960070ad0 2023-05-21T16:55:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59601594c0 con 0x7f5960070ad0 2023-05-21T16:55:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.196+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5960159a80 con 0x7f5960070ad0 2023-05-21T16:55:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.200+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5948007470 con 0x7f5960070ad0 2023-05-21T16:55:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.200+0000 7f59577fe700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5940066340 0x7f59400687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.200+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5948084060 con 0x7f5960070ad0 2023-05-21T16:55:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.200+0000 7f595e7fc700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5940066340 0x7f59400687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.200+0000 7f595e7fc700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5940066340 0x7f59400687f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f595800a470 tx=0x7f595800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.204+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5948051480 con 0x7f5960070ad0 2023-05-21T16:55:00.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.368+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59600733b0 con 0x7f5960070ad0 2023-05-21T16:55:00.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.372+0000 7f59577fe700 1 -- 172.21.15.46:0/4008164981 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f5948007720 con 0x7f5960070ad0 2023-05-21T16:55:00.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:00.379 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:54:59.739204+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:00.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.372+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5940066340 msgr2=0x7f59400687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.372+0000 7f595ffff700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5940066340 0x7f59400687f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f595800a470 tx=0x7f595800a000 comp rx=0 tx=0).stop 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 msgr2=0x7f59600b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 0x7f59600b2d40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f594800c580 tx=0x7f594800c890 comp rx=0 tx=0).stop 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 shutdown_connections 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5940066340 0x7f59400687f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596015d460 0x7f59600af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5960158d90 0x7f596014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 --2- 172.21.15.46:0/4008164981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5960070ad0 0x7f59600b2d40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 >> 172.21.15.46:0/4008164981 conn(0x7f59600cf720 msgr2=0x7f59600c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:00.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 shutdown_connections 2023-05-21T16:55:00.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.376+0000 7f595ffff700 1 -- 172.21.15.46:0/4008164981 wait complete. 2023-05-21T16:55:00.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:55:00.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:55:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff219d41700 1 Processor -- start 2023-05-21T16:55:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff219d41700 1 -- start start 2023-05-21T16:55:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff219d41700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff2140b8ad0 0x7ff2140cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff219d41700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140b8ea0 con 0x7ff2140b5ce0 2023-05-21T16:55:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff219d41700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140d09d0 con 0x7ff2140b4910 2023-05-21T16:55:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff219d41700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140d0cb0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff213fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff2140b5ce0 0x7ff21406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39734/0 (socket says 172.21.15.46:39734) 2023-05-21T16:55:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff213fff700 1 -- 172.21.15.46:0/1357523691 learned_addr learned my addr 172.21.15.46:0/1357523691 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:00.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.512+0000 7ff218d3f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff2140b8ad0 0x7ff2140cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff2137fe700 1 -- 172.21.15.46:0/1357523691 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429590473 0 0) 0x7ff2140b8ea0 con 0x7ff2140b5ce0 2023-05-21T16:55:00.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff2137fe700 1 -- 172.21.15.46:0/1357523691 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2000035d0 con 0x7ff2140b5ce0 2023-05-21T16:55:00.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff218d3f700 1 -- 172.21.15.46:0/1357523691 >> v1:172.21.15.142:6789/0 conn(0x7ff2140b4910 legacy=0x7ff2140d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff218d3f700 1 -- 172.21.15.46:0/1357523691 >> v1:172.21.15.46:6789/0 conn(0x7ff2140b5ce0 legacy=0x7ff21406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff218d3f700 1 -- 172.21.15.46:0/1357523691 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140cd4f0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff218d3f700 1 --2- 172.21.15.46:0/1357523691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff2140cf310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c8e754c876d4a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff2137fe700 1 -- 172.21.15.46:0/1357523691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc011830 con 0x7ff2140b8ad0 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff2137fe700 1 -- 172.21.15.46:0/1357523691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc011990 con 0x7ff2140b8ad0 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff2137fe700 1 -- 172.21.15.46:0/1357523691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc011d40 con 0x7ff2140b8ad0 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 -- 172.21.15.46:0/1357523691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 msgr2=0x7ff2140cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 --2- 172.21.15.46:0/1357523691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff2140cf310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 -- 172.21.15.46:0/1357523691 shutdown_connections 2023-05-21T16:55:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 --2- 172.21.15.46:0/1357523691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff2140cf310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 -- 172.21.15.46:0/1357523691 >> 172.21.15.46:0/1357523691 conn(0x7ff2140d3ae0 msgr2=0x7ff2140cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 -- 172.21.15.46:0/1357523691 shutdown_connections 2023-05-21T16:55:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.516+0000 7ff219d41700 1 -- 172.21.15.46:0/1357523691 wait complete. 2023-05-21T16:55:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 Processor -- start 2023-05-21T16:55:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 -- start start 2023-05-21T16:55:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2140b4910 0x7ff21415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2140b5ce0 0x7ff2140b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff21415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140b1870 con 0x7ff2140b8ad0 2023-05-21T16:55:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140a9960 con 0x7ff2140b5ce0 2023-05-21T16:55:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21415d090 con 0x7ff2140b4910 2023-05-21T16:55:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff21415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff21415cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56056/0 (socket says 172.21.15.46:56056) 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 -- 172.21.15.46:0/3401899048 learned_addr learned my addr 172.21.15.46:0/3401899048 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff213fff700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2140b5ce0 0x7ff2140b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff218d3f700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2140b4910 0x7ff21415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 -- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2140b4910 msgr2=0x7ff21415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2140b4910 0x7ff21415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 -- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2140b5ce0 msgr2=0x7ff2140b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2140b5ce0 0x7ff2140b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 -- 172.21.15.46:0/3401899048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0094b0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219540700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff21415cb50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00cc50 tx=0x7ff20c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00ad80 con 0x7ff2140b8ad0 2023-05-21T16:55:00.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00ce50 con 0x7ff2140b8ad0 2023-05-21T16:55:00.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c003c60 con 0x7ff2140b8ad0 2023-05-21T16:55:00.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140cda70 con 0x7ff2140b8ad0 2023-05-21T16:55:00.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.520+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2140cd790 con 0x7ff2140b8ad0 2023-05-21T16:55:00.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.524+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2140b4db0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.524+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff20c0050d0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.524+0000 7ff2117fa700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff1f40662f0 0x7ff1f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.524+0000 7ff218d3f700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff1f40662f0 0x7ff1f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.524+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff20c0848d0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.524+0000 7ff218d3f700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff1f40662f0 0x7ff1f40687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0090b0 tx=0x7ff1fc01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.532+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff20c051d80 con 0x7ff2140b8ad0 2023-05-21T16:55:00.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.692+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2140a9ad0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff2117fa700 1 -- 172.21.15.46:0/3401899048 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff20c0553a0 con 0x7ff2140b8ad0 2023-05-21T16:55:00.701 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:55:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff1f40662f0 msgr2=0x7ff1f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff1f40662f0 0x7ff1f40687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0090b0 tx=0x7ff1fc01c040 comp rx=0 tx=0).stop 2023-05-21T16:55:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 msgr2=0x7ff21415cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff21415cb50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00cc50 tx=0x7ff20c00a340 comp rx=0 tx=0).stop 2023-05-21T16:55:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 shutdown_connections 2023-05-21T16:55:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff1f40662f0 0x7ff1f40687a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2140b8ad0 0x7ff21415cb50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2140b5ce0 0x7ff2140b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 --2- 172.21.15.46:0/3401899048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2140b4910 0x7ff21415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 >> 172.21.15.46:0/3401899048 conn(0x7ff2140d3ae0 msgr2=0x7ff2140b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 shutdown_connections 2023-05-21T16:55:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.696+0000 7ff219d41700 1 -- 172.21.15.46:0/3401899048 wait complete. 2023-05-21T16:55:00.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:55:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 Processor -- start 2023-05-21T16:55:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- start start 2023-05-21T16:55:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcac00b4800 0x7fcac00b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcac00d1ac0 0x7fcac00b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac00d0d00 con 0x7fcac00b6110 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac0161520 con 0x7fcac00b4800 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac00d0fe0 con 0x7fcac00d1ac0 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcac00b4800 0x7fcac00b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcac00b4800 0x7fcac00b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56058/0 (socket says 172.21.15.46:56058) 2023-05-21T16:55:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 -- 172.21.15.46:0/1080478860 learned_addr learned my addr 172.21.15.46:0/1080478860 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 --2- 172.21.15.46:0/1080478860 >> v2:172.21.15.142:3300/0 conn(0x7fcac00d1ac0 0x7fcac00b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 -- 172.21.15.46:0/1080478860 >> v2:172.21.15.142:3300/0 conn(0x7fcac00d1ac0 msgr2=0x7fcac00b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 --2- 172.21.15.46:0/1080478860 >> v2:172.21.15.142:3300/0 conn(0x7fcac00d1ac0 0x7fcac00b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 -- 172.21.15.46:0/1080478860 >> v1:172.21.15.142:6789/0 conn(0x7fcac00b6110 legacy=0x7fcac01607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 -- 172.21.15.46:0/1080478860 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00d12c0 con 0x7fcac00b4800 2023-05-21T16:55:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 --2- 172.21.15.46:0/1080478860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b4800 0x7fcac00b4bd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcac00ce8f0 tx=0x7fcabc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cc5827522fc71c server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac51e4700 1 -- 172.21.15.46:0/1080478860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00b8a0 con 0x7fcac00b4800 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac51e4700 1 -- 172.21.15.46:0/1080478860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00ba00 con 0x7fcac00b4800 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac51e4700 1 -- 172.21.15.46:0/1080478860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00bd90 con 0x7fcac00b4800 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/1080478860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b4800 msgr2=0x7fcac00b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- 172.21.15.46:0/1080478860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b4800 0x7fcac00b4bd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcac00ce8f0 tx=0x7fcabc009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/1080478860 shutdown_connections 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- 172.21.15.46:0/1080478860 >> v2:172.21.15.142:3300/0 conn(0x7fcac00d1ac0 0x7fcac00b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- 172.21.15.46:0/1080478860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b4800 0x7fcac00b4bd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/1080478860 >> 172.21.15.46:0/1080478860 conn(0x7fcac006c170 msgr2=0x7fcac006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/1080478860 shutdown_connections 2023-05-21T16:55:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/1080478860 wait complete. 2023-05-21T16:55:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 Processor -- start 2023-05-21T16:55:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- start start 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac00b4800 0x7fcac014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 0x7fcac00c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac00d1ac0 0x7fcac00c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00c7b00 con 0x7fcac00b6110 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cbf40 con 0x7fcac00d1ac0 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cb980 con 0x7fcac00b4800 2023-05-21T16:55:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 0x7fcac00c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 0x7fcac00c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56074/0 (socket says 172.21.15.46:56074) 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 -- 172.21.15.46:0/3916073135 learned_addr learned my addr 172.21.15.46:0/3916073135 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac00b4800 0x7fcac014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac69e7700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac00d1ac0 0x7fcac00c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 -- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac00b4800 msgr2=0x7fcac014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac00b4800 0x7fcac014d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 -- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac00d1ac0 msgr2=0x7fcac00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac00d1ac0 0x7fcac00c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 -- 172.21.15.46:0/3916073135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc009570 con 0x7fcac00b6110 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac61e6700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac00b4800 0x7fcac014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac69e7700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac00d1ac0 0x7fcac00c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac59e5700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 0x7fcac00c68b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcab000d800 tx=0x7fcab000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0018070 con 0x7fcac00b6110 2023-05-21T16:55:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab0005a40 con 0x7fcac00b6110 2023-05-21T16:55:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac00b5110 con 0x7fcac00b6110 2023-05-21T16:55:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0005bf0 con 0x7fcac00b6110 2023-05-21T16:55:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.840+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac00d15a0 con 0x7fcac00b6110 2023-05-21T16:55:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.844+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac00b6590 con 0x7fcac00b6110 2023-05-21T16:55:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.844+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcab0005d50 con 0x7fcac00b6110 2023-05-21T16:55:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.844+0000 7fcab6ffd700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcaa40662f0 0x7fcaa40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.844+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcab0083ad0 con 0x7fcac00b6110 2023-05-21T16:55:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.844+0000 7fcac61e6700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcaa40662f0 0x7fcaa40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.848+0000 7fcac61e6700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcaa40662f0 0x7fcaa40687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcabc000c00 tx=0x7fcabc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:00.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:00.856+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcab0050e80 con 0x7fcac00b6110 2023-05-21T16:55:01.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.024+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcac0073cb0 con 0x7fcac00b6110 2023-05-21T16:55:01.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.024+0000 7fcab6ffd700 1 -- 172.21.15.46:0/3916073135 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcab00544a0 con 0x7fcac00b6110 2023-05-21T16:55:01.025 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:55:01.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcaa40662f0 msgr2=0x7fcaa40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcaa40662f0 0x7fcaa40687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcabc000c00 tx=0x7fcabc008030 comp rx=0 tx=0).stop 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 msgr2=0x7fcac00c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 0x7fcac00c68b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcab000d800 tx=0x7fcab000dbc0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 shutdown_connections 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcaa40662f0 0x7fcaa40687a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac00d1ac0 0x7fcac00c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcac00b6110 0x7fcac00c68b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 --2- 172.21.15.46:0/3916073135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcac00b4800 0x7fcac014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 >> 172.21.15.46:0/3916073135 conn(0x7fcac006c170 msgr2=0x7fcac00cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 shutdown_connections 2023-05-21T16:55:01.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.028+0000 7fcac71e8700 1 -- 172.21.15.46:0/3916073135 wait complete. 2023-05-21T16:55:01.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:55:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.164+0000 7f2563188700 1 Processor -- start 2023-05-21T16:55:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.164+0000 7f2563188700 1 -- start start 2023-05-21T16:55:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2554038980 0x7f2554038e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554008ac0 0x7f2554008f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2554054650 con 0x7f25540e2aa0 2023-05-21T16:55:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2554039340 con 0x7f2554038980 2023-05-21T16:55:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540e7190 con 0x7f2554008ac0 2023-05-21T16:55:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562186700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f25540e2aa0 0x7f25540e6620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39748/0 (socket says 172.21.15.46:39748) 2023-05-21T16:55:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562186700 1 -- 172.21.15.46:0/3394042836 learned_addr learned my addr 172.21.15.46:0/3394042836 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 --2- 172.21.15.46:0/3394042836 >> v2:172.21.15.142:3300/0 conn(0x7f2554038980 0x7f2554038e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562987700 1 --2- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554008ac0 0x7f2554008f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561184700 1 -- 172.21.15.46:0/3394042836 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878872233 0 0) 0x7f2554054650 con 0x7f25540e2aa0 2023-05-21T16:55:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561184700 1 -- 172.21.15.46:0/3394042836 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25480035d0 con 0x7f25540e2aa0 2023-05-21T16:55:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 -- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554008ac0 msgr2=0x7f2554008f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 --2- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554008ac0 0x7f2554008f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 -- 172.21.15.46:0/3394042836 >> v1:172.21.15.46:6789/0 conn(0x7f25540e2aa0 legacy=0x7f25540e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 -- 172.21.15.46:0/3394042836 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554007fe0 con 0x7f2554038980 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 --2- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554038980 0x7f2554038e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2558009850 tx=0x7f2558009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81bc1ba4c2bedfc server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561184700 1 -- 172.21.15.46:0/3394042836 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011830 con 0x7f2554038980 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561184700 1 -- 172.21.15.46:0/3394042836 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558011990 con 0x7f2554038980 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561184700 1 -- 172.21.15.46:0/3394042836 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011d40 con 0x7f2554038980 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554038980 msgr2=0x7f2554038e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554038980 0x7f2554038e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2558009850 tx=0x7f2558009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- 172.21.15.46:0/3394042836 shutdown_connections 2023-05-21T16:55:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554008ac0 0x7f2554008f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- 172.21.15.46:0/3394042836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554038980 0x7f2554038e00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- 172.21.15.46:0/3394042836 >> 172.21.15.46:0/3394042836 conn(0x7f2554057b90 msgr2=0x7f2554053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- 172.21.15.46:0/3394042836 shutdown_connections 2023-05-21T16:55:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- 172.21.15.46:0/3394042836 wait complete. 2023-05-21T16:55:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 Processor -- start 2023-05-21T16:55:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- start start 2023-05-21T16:55:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554008ac0 0x7f255404a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554038980 0x7f2554177c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 0x7f25540e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540e3790 con 0x7f25540e2aa0 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540e0130 con 0x7f2554008ac0 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2563188700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540e0410 con 0x7f2554038980 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562987700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 0x7f25540e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562987700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 0x7f25540e3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56076/0 (socket says 172.21.15.46:56076) 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562987700 1 -- 172.21.15.46:0/752235745 learned_addr learned my addr 172.21.15.46:0/752235745 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2562186700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554008ac0 0x7f255404a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.168+0000 7f2561985700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554038980 0x7f2554177c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562987700 1 -- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554038980 msgr2=0x7f2554177c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562987700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554038980 0x7f2554177c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562987700 1 -- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554008ac0 msgr2=0x7f255404a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562987700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554008ac0 0x7f255404a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562987700 1 -- 172.21.15.46:0/752235745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580094b0 con 0x7f25540e2aa0 2023-05-21T16:55:01.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562987700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 0x7f25540e3b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f255c04fba0 tx=0x7f255c072570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c08e070 con 0x7f25540e2aa0 2023-05-21T16:55:01.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c073bc0 con 0x7f25540e2aa0 2023-05-21T16:55:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25540085a0 con 0x7f25540e2aa0 2023-05-21T16:55:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c067100 con 0x7f25540e2aa0 2023-05-21T16:55:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540082c0 con 0x7f25540e2aa0 2023-05-21T16:55:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25540e7470 con 0x7f25540e2aa0 2023-05-21T16:55:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f255c067260 con 0x7f25540e2aa0 2023-05-21T16:55:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2552ffd700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f25400662f0 0x7f25400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f255c0fdb90 con 0x7f25540e2aa0 2023-05-21T16:55:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.172+0000 7f2562186700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f25400662f0 0x7f25400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.176+0000 7f2562186700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f25400662f0 0x7f25400687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f254c007fd0 tx=0x7f254c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.184+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f255c0caf50 con 0x7f25540e2aa0 2023-05-21T16:55:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.344+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25540059c0 con 0x7f25540e2aa0 2023-05-21T16:55:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.344+0000 7f2552ffd700 1 -- 172.21.15.46:0/752235745 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f255c0ce570 con 0x7f25540e2aa0 2023-05-21T16:55:01.352 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:55:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f25400662f0 msgr2=0x7f25400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f25400662f0 0x7f25400687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f254c007fd0 tx=0x7f254c007de0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 msgr2=0x7f25540e3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 0x7f25540e3b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f255c04fba0 tx=0x7f255c072570 comp rx=0 tx=0).stop 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 shutdown_connections 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f25400662f0 0x7f25400687a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25540e2aa0 0x7f25540e3b60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2554038980 0x7f2554177c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 --2- 172.21.15.46:0/752235745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2554008ac0 0x7f255404a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 >> 172.21.15.46:0/752235745 conn(0x7f2554057b90 msgr2=0x7f255400e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 shutdown_connections 2023-05-21T16:55:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.348+0000 7f2563188700 1 -- 172.21.15.46:0/752235745 wait complete. 2023-05-21T16:55:01.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:55:01.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 Processor -- start 2023-05-21T16:55:01.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 -- start start 2023-05-21T16:55:01.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f674c15a8d0 0x7f674c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f674c0aec10 0x7f674c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15ee10 0x7f674c0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c0cb7f0 con 0x7f674c15a8d0 2023-05-21T16:55:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c15f230 con 0x7f674c0aec10 2023-05-21T16:55:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6751e2d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c15aca0 con 0x7f674c15ee10 2023-05-21T16:55:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6750e2b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f674c15a8d0 0x7f674c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6750e2b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f674c15a8d0 0x7f674c15e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56088/0 (socket says 172.21.15.46:56088) 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f6750e2b700 1 -- 172.21.15.46:0/2100822334 learned_addr learned my addr 172.21.15.46:0/2100822334 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.488+0000 7f674bfff700 1 --2- 172.21.15.46:0/2100822334 >> v2:172.21.15.142:3300/0 conn(0x7f674c0aec10 0x7f674c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f675162c700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15ee10 0x7f674c0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6750e2b700 1 -- 172.21.15.46:0/2100822334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15ee10 msgr2=0x7f674c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6750e2b700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15ee10 0x7f674c0b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6750e2b700 1 -- 172.21.15.46:0/2100822334 >> v2:172.21.15.142:3300/0 conn(0x7f674c0aec10 msgr2=0x7f674c15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:01.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6750e2b700 1 --2- 172.21.15.46:0/2100822334 >> v2:172.21.15.142:3300/0 conn(0x7f674c0aec10 0x7f674c15e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6750e2b700 1 -- 172.21.15.46:0/2100822334 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0ca520 con 0x7f674c15a8d0 2023-05-21T16:55:01.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f674bfff700 1 --2- 172.21.15.46:0/2100822334 >> v2:172.21.15.142:3300/0 conn(0x7f674c0aec10 0x7f674c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:01.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f675162c700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15ee10 0x7f674c0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:01.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6750e2b700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c15a8d0 0x7f674c15e390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f674c06aa10 tx=0x7f6740009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ffb1bd87df1c9c server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f674b7fe700 1 -- 172.21.15.46:0/2100822334 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000b8a0 con 0x7f674c15a8d0 2023-05-21T16:55:01.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f674b7fe700 1 -- 172.21.15.46:0/2100822334 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674000ba00 con 0x7f674c15a8d0 2023-05-21T16:55:01.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f674b7fe700 1 -- 172.21.15.46:0/2100822334 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000bd90 con 0x7f674c15a8d0 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 -- 172.21.15.46:0/2100822334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c15a8d0 msgr2=0x7f674c15e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c15a8d0 0x7f674c15e390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f674c06aa10 tx=0x7f6740009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 -- 172.21.15.46:0/2100822334 shutdown_connections 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15ee10 0x7f674c0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 --2- 172.21.15.46:0/2100822334 >> v2:172.21.15.142:3300/0 conn(0x7f674c0aec10 0x7f674c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 --2- 172.21.15.46:0/2100822334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c15a8d0 0x7f674c15e390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 -- 172.21.15.46:0/2100822334 >> 172.21.15.46:0/2100822334 conn(0x7f674c06d930 msgr2=0x7f674c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 -- 172.21.15.46:0/2100822334 shutdown_connections 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 -- 172.21.15.46:0/2100822334 wait complete. 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 Processor -- start 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.492+0000 7f6751e2d700 1 -- start start 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 0x7f674c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15a8d0 0x7f674c0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c15ee10 0x7f674c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0c8450 con 0x7f674c0aec10 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0c9a00 con 0x7f674c15ee10 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0c7580 con 0x7f674c15a8d0 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 0x7f674c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 0x7f674c0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56102/0 (socket says 172.21.15.46:56102) 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 -- 172.21.15.46:0/622288668 learned_addr learned my addr 172.21.15.46:0/622288668 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f675162c700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c15ee10 0x7f674c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f674bfff700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15a8d0 0x7f674c0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 -- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15a8d0 msgr2=0x7f674c0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15a8d0 0x7f674c0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 -- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c15ee10 msgr2=0x7f674c0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c15ee10 0x7f674c0c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 -- 172.21.15.46:0/622288668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009570 con 0x7f674c0aec10 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f674bfff700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15a8d0 0x7f674c0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6750e2b700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 0x7f674c0c94c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f674000b0e0 tx=0x7f6740004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67400036c0 con 0x7f674c0aec10 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c0cae50 con 0x7f674c0aec10 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674001f070 con 0x7f674c0aec10 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740003a80 con 0x7f674c0aec10 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c0cab70 con 0x7f674c0aec10 2023-05-21T16:55:01.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.496+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c0cb130 con 0x7f674c0aec10 2023-05-21T16:55:01.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.500+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6740021030 con 0x7f674c0aec10 2023-05-21T16:55:01.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.500+0000 7f67497fa700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f67300662f0 0x7f67300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.500+0000 7f674bfff700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f67300662f0 0x7f67300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.500+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6740085420 con 0x7f674c0aec10 2023-05-21T16:55:01.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.500+0000 7f674bfff700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f67300662f0 0x7f67300687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f674c0b1e50 tx=0x7f6738008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.508+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f67400528f0 con 0x7f674c0aec10 2023-05-21T16:55:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.668+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f674c0c56d0 con 0x7f674c0aec10 2023-05-21T16:55:01.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.668+0000 7f67497fa700 1 -- 172.21.15.46:0/622288668 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6740055f10 con 0x7f674c0aec10 2023-05-21T16:55:01.671 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:55:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f67300662f0 msgr2=0x7f67300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f67300662f0 0x7f67300687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f674c0b1e50 tx=0x7f6738008040 comp rx=0 tx=0).stop 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 msgr2=0x7f674c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 0x7f674c0c94c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f674000b0e0 tx=0x7f6740004770 comp rx=0 tx=0).stop 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 shutdown_connections 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f67300662f0 0x7f67300687a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f674c15ee10 0x7f674c0c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f674c15a8d0 0x7f674c0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 --2- 172.21.15.46:0/622288668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f674c0aec10 0x7f674c0c94c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 >> 172.21.15.46:0/622288668 conn(0x7f674c06d930 msgr2=0x7f674c153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 shutdown_connections 2023-05-21T16:55:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.672+0000 7f6751e2d700 1 -- 172.21.15.46:0/622288668 wait complete. 2023-05-21T16:55:01.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:55:01.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 Processor -- start 2023-05-21T16:55:01.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- start start 2023-05-21T16:55:01.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07b8154de0 0x7f07b806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07b80caea0 0x7f07b815b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b815aea0 con 0x7f07b815b870 2023-05-21T16:55:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b815ac20 con 0x7f07b8154de0 2023-05-21T16:55:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b8071790 con 0x7f07b80caea0 2023-05-21T16:55:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07b8154de0 0x7f07b806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07b8154de0 0x7f07b806c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56112/0 (socket says 172.21.15.46:56112) 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 -- 172.21.15.46:0/3586831654 learned_addr learned my addr 172.21.15.46:0/3586831654 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b659c700 1 --2- 172.21.15.46:0/3586831654 >> v2:172.21.15.142:3300/0 conn(0x7f07b80caea0 0x7f07b815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 -- 172.21.15.46:0/3586831654 >> v2:172.21.15.142:3300/0 conn(0x7f07b80caea0 msgr2=0x7f07b815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 --2- 172.21.15.46:0/3586831654 >> v2:172.21.15.142:3300/0 conn(0x7f07b80caea0 0x7f07b815b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 -- 172.21.15.46:0/3586831654 >> v1:172.21.15.142:6789/0 conn(0x7f07b815b870 legacy=0x7f07b815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 -- 172.21.15.46:0/3586831654 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b80cb340 con 0x7f07b8154de0 2023-05-21T16:55:01.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b6d9d700 1 --2- 172.21.15.46:0/3586831654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b8154de0 0x7f07b806c760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07b80cea40 tx=0x7f07b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7cb80c5a3df2b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b5d9b700 1 -- 172.21.15.46:0/3586831654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000e070 con 0x7f07b8154de0 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b5d9b700 1 -- 172.21.15.46:0/3586831654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000b9c0 con 0x7f07b8154de0 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07b5d9b700 1 -- 172.21.15.46:0/3586831654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000bd70 con 0x7f07b8154de0 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- 172.21.15.46:0/3586831654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b8154de0 msgr2=0x7f07b806c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/3586831654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b8154de0 0x7f07b806c760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07b80cea40 tx=0x7f07b000b330 comp rx=0 tx=0).stop 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- 172.21.15.46:0/3586831654 shutdown_connections 2023-05-21T16:55:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/3586831654 >> v2:172.21.15.142:3300/0 conn(0x7f07b80caea0 0x7f07b815b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/3586831654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b8154de0 0x7f07b806c760 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- 172.21.15.46:0/3586831654 >> 172.21.15.46:0/3586831654 conn(0x7f07b80cf720 msgr2=0x7f07b80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- 172.21.15.46:0/3586831654 shutdown_connections 2023-05-21T16:55:01.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.796+0000 7f07bc9cf700 1 -- 172.21.15.46:0/3586831654 wait complete. 2023-05-21T16:55:01.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.800+0000 7f07bc9cf700 1 Processor -- start 2023-05-21T16:55:01.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.800+0000 7f07bc9cf700 1 -- start start 2023-05-21T16:55:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80caea0 0x7f07b80b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8154de0 0x7f07b8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 0x7f07b81496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b8149c10 con 0x7f07b815b870 2023-05-21T16:55:01.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80af640 con 0x7f07b80caea0 2023-05-21T16:55:01.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80b35d0 con 0x7f07b8154de0 2023-05-21T16:55:01.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 0x7f07b81496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 0x7f07b81496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56120/0 (socket says 172.21.15.46:56120) 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b6d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80caea0 0x7f07b80b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b659c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8154de0 0x7f07b8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 -- 172.21.15.46:0/2198938910 learned_addr learned my addr 172.21.15.46:0/2198938910 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 -- 172.21.15.46:0/2198938910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8154de0 msgr2=0x7f07b8149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8154de0 0x7f07b8149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 -- 172.21.15.46:0/2198938910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80caea0 msgr2=0x7f07b80b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80caea0 0x7f07b80b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 -- 172.21.15.46:0/2198938910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0009b30 con 0x7f07b815b870 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07b759e700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 0x7f07b81496d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a80016f0 tx=0x7f07a8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8013070 con 0x7f07b815b870 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a800e2e0 con 0x7f07b815b870 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b806d0b0 con 0x7f07b815b870 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80052f0 con 0x7f07b815b870 2023-05-21T16:55:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b806cdd0 con 0x7f07b815b870 2023-05-21T16:55:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.804+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b806d390 con 0x7f07b815b870 2023-05-21T16:55:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.808+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07a8005450 con 0x7f07b815b870 2023-05-21T16:55:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.808+0000 7f07af7fe700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f07980662f0 0x7f07980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.808+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f07a8087330 con 0x7f07b815b870 2023-05-21T16:55:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.808+0000 7f07b6d9d700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f07980662f0 0x7f07980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.808+0000 7f07b6d9d700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f07980662f0 0x7f07980687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000f80 tx=0x7f07b0009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.812+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f07a80546f0 con 0x7f07b815b870 2023-05-21T16:55:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.988+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07b80b3bf0 con 0x7f07b815b870 2023-05-21T16:55:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07af7fe700 1 -- 172.21.15.46:0/2198938910 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f07a8057d10 con 0x7f07b815b870 2023-05-21T16:55:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f07980662f0 msgr2=0x7f07980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f07980662f0 0x7f07980687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000f80 tx=0x7f07b0009000 comp rx=0 tx=0).stop 2023-05-21T16:55:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 msgr2=0x7f07b81496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 0x7f07b81496d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a80016f0 tx=0x7f07a8001a00 comp rx=0 tx=0).stop 2023-05-21T16:55:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 shutdown_connections 2023-05-21T16:55:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f07980662f0 0x7f07980687a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07b815b870 0x7f07b81496d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8154de0 0x7f07b8149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 --2- 172.21.15.46:0/2198938910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80caea0 0x7f07b80b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 >> 172.21.15.46:0/2198938910 conn(0x7f07b80cf720 msgr2=0x7f07b8152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 shutdown_connections 2023-05-21T16:55:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:01.992+0000 7f07bc9cf700 1 -- 172.21.15.46:0/2198938910 wait complete. 2023-05-21T16:55:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:55:02.006 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2023-05-21T16:55:02.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:02.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-21T16:55:02.018 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:55:02.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-05-21T16:55:02.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:02.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-21T16:55:02.026 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:55:02.027 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:55:02.034 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:55:02.034 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:55:02.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 Processor -- start 2023-05-21T16:55:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 -- start start 2023-05-21T16:55:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0d8160be0 0x7ff0d81651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff0d8069f80 0x7ff0d806a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80ade30 con 0x7ff0d8070c50 2023-05-21T16:55:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80cd210 con 0x7ff0d8069f80 2023-05-21T16:55:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0df42e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80cc970 con 0x7ff0d8160be0 2023-05-21T16:55:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0ddc2b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff0d8069f80 0x7ff0d806a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.200+0000 7ff0ddc2b700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff0d8069f80 0x7ff0d806a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56130/0 (socket says 172.21.15.46:56130) 2023-05-21T16:55:02.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0ddc2b700 1 -- 172.21.15.46:0/2403942817 learned_addr learned my addr 172.21.15.46:0/2403942817 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0de42c700 1 --2- 172.21.15.46:0/2403942817 >> v2:172.21.15.142:3300/0 conn(0x7ff0d8160be0 0x7ff0d81651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0ddc2b700 1 -- 172.21.15.46:0/2403942817 >> v2:172.21.15.142:3300/0 conn(0x7ff0d8160be0 msgr2=0x7ff0d81651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0ddc2b700 1 --2- 172.21.15.46:0/2403942817 >> v2:172.21.15.142:3300/0 conn(0x7ff0d8160be0 0x7ff0d81651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0ddc2b700 1 -- 172.21.15.46:0/2403942817 >> v1:172.21.15.142:6789/0 conn(0x7ff0d8070c50 legacy=0x7ff0d80c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0ddc2b700 1 -- 172.21.15.46:0/2403942817 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80ccc50 con 0x7ff0d8069f80 2023-05-21T16:55:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0ddc2b700 1 --2- 172.21.15.46:0/2403942817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d806a420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806c460 tx=0x7ff0c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5f379be0fc3e15 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0dd42a700 1 -- 172.21.15.46:0/2403942817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800e070 con 0x7ff0d8069f80 2023-05-21T16:55:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0dd42a700 1 -- 172.21.15.46:0/2403942817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800b9c0 con 0x7ff0d8069f80 2023-05-21T16:55:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0dd42a700 1 -- 172.21.15.46:0/2403942817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800bd70 con 0x7ff0d8069f80 2023-05-21T16:55:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 -- 172.21.15.46:0/2403942817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 msgr2=0x7ff0d806a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2403942817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d806a420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806c460 tx=0x7ff0c800b330 comp rx=0 tx=0).stop 2023-05-21T16:55:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 -- 172.21.15.46:0/2403942817 shutdown_connections 2023-05-21T16:55:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2403942817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d806a420 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2403942817 >> v2:172.21.15.142:3300/0 conn(0x7ff0d8160be0 0x7ff0d81651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 -- 172.21.15.46:0/2403942817 >> 172.21.15.46:0/2403942817 conn(0x7ff0d80cf720 msgr2=0x7ff0d80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 -- 172.21.15.46:0/2403942817 shutdown_connections 2023-05-21T16:55:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.204+0000 7ff0df42e700 1 -- 172.21.15.46:0/2403942817 wait complete. 2023-05-21T16:55:02.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 Processor -- start 2023-05-21T16:55:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 -- start start 2023-05-21T16:55:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d80bd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d8070c50 0x7ff0d80be030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0d8160be0 0x7ff0d815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80be810 con 0x7ff0d8069f80 2023-05-21T16:55:02.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80be570 con 0x7ff0d8070c50 2023-05-21T16:55:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80c0980 con 0x7ff0d8160be0 2023-05-21T16:55:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d80bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0ddc2b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d8070c50 0x7ff0d80be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d80bd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56142/0 (socket says 172.21.15.46:56142) 2023-05-21T16:55:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 -- 172.21.15.46:0/2719809850 learned_addr learned my addr 172.21.15.46:0/2719809850 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:02.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0dec2d700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0d8160be0 0x7ff0d815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 -- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0d8160be0 msgr2=0x7ff0d815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0d8160be0 0x7ff0d815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 -- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d8070c50 msgr2=0x7ff0d80be030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d8070c50 0x7ff0d80be030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 -- 172.21.15.46:0/2719809850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009b30 con 0x7ff0d8069f80 2023-05-21T16:55:02.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0de42c700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d80bd930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00d800 tx=0x7ff0cc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0125f0 con 0x7ff0d8069f80 2023-05-21T16:55:02.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc012750 con 0x7ff0d8069f80 2023-05-21T16:55:02.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc012ac0 con 0x7ff0d8069f80 2023-05-21T16:55:02.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8070730 con 0x7ff0d8069f80 2023-05-21T16:55:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.208+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d80ccf30 con 0x7ff0d8069f80 2023-05-21T16:55:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.212+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8165700 con 0x7ff0d8069f80 2023-05-21T16:55:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.212+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0cc012c20 con 0x7ff0d8069f80 2023-05-21T16:55:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.212+0000 7ff0d6ffd700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0c40662f0 0x7ff0c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.212+0000 7ff0ddc2b700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0c40662f0 0x7ff0c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.212+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff0cc083d80 con 0x7ff0d8069f80 2023-05-21T16:55:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.216+0000 7ff0ddc2b700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0c40662f0 0x7ff0c40687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8000f80 tx=0x7ff0c8009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.220+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff0cc051250 con 0x7ff0d8069f80 2023-05-21T16:55:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.384+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d806ddc0 con 0x7ff0d8069f80 2023-05-21T16:55:02.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0d6ffd700 1 -- 172.21.15.46:0/2719809850 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7ff0cc054870 con 0x7ff0d8069f80 2023-05-21T16:55:02.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:02.390 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:00.755376+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0c40662f0 msgr2=0x7ff0c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0c40662f0 0x7ff0c40687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8000f80 tx=0x7ff0c8009000 comp rx=0 tx=0).stop 2023-05-21T16:55:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 msgr2=0x7ff0d80bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d80bd930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00d800 tx=0x7ff0cc00db10 comp rx=0 tx=0).stop 2023-05-21T16:55:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 shutdown_connections 2023-05-21T16:55:02.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0c40662f0 0x7ff0c40687a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0d8160be0 0x7ff0d815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d8070c50 0x7ff0d80be030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 --2- 172.21.15.46:0/2719809850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d8069f80 0x7ff0d80bd930 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 >> 172.21.15.46:0/2719809850 conn(0x7ff0d80cf720 msgr2=0x7ff0d80b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 shutdown_connections 2023-05-21T16:55:02.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.388+0000 7ff0df42e700 1 -- 172.21.15.46:0/2719809850 wait complete. 2023-05-21T16:55:02.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:55:02.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:55:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 Processor -- start 2023-05-21T16:55:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 -- start start 2023-05-21T16:55:02.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b8ad0 0x7f94b80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f94b80b4910 0x7f94b80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80b8ea0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80b52f0 con 0x7f94b80b4910 2023-05-21T16:55:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.528+0000 7f94b7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80d09d0 con 0x7f94b80b8ad0 2023-05-21T16:55:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94affff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f94b80b5ce0 0x7f94b806a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39758/0 (socket says 172.21.15.46:39758) 2023-05-21T16:55:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94affff700 1 -- 172.21.15.46:0/2075164716 learned_addr learned my addr 172.21.15.46:0/2075164716 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:02.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b77fe700 1 --2- 172.21.15.46:0/2075164716 >> v2:172.21.15.46:3300/0 conn(0x7f94b80b4910 0x7f94b80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b6ffd700 1 --2- 172.21.15.46:0/2075164716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b8ad0 0x7f94b80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b77fe700 1 -- 172.21.15.46:0/2075164716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b8ad0 msgr2=0x7f94b80cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b77fe700 1 --2- 172.21.15.46:0/2075164716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b8ad0 0x7f94b80cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b77fe700 1 -- 172.21.15.46:0/2075164716 >> v1:172.21.15.46:6789/0 conn(0x7f94b80b5ce0 legacy=0x7f94b806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b77fe700 1 -- 172.21.15.46:0/2075164716 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80d0cb0 con 0x7f94b80b4910 2023-05-21T16:55:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b67fc700 1 -- 172.21.15.46:0/2075164716 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355166887 0 0) 0x7f94b80b8ea0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b77fe700 1 --2- 172.21.15.46:0/2075164716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b4910 0x7f94b80b4db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009d90 tx=0x7f94b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ee9e89321aeade server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b67fc700 1 -- 172.21.15.46:0/2075164716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000e070 con 0x7f94b80b4910 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b67fc700 1 -- 172.21.15.46:0/2075164716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b000bbd0 con 0x7f94b80b4910 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b67fc700 1 -- 172.21.15.46:0/2075164716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0012430 con 0x7f94b80b4910 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- 172.21.15.46:0/2075164716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b4910 msgr2=0x7f94b80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 --2- 172.21.15.46:0/2075164716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b4910 0x7f94b80b4db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009d90 tx=0x7f94b000b330 comp rx=0 tx=0).stop 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- 172.21.15.46:0/2075164716 shutdown_connections 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 --2- 172.21.15.46:0/2075164716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b4910 0x7f94b80b4db0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 --2- 172.21.15.46:0/2075164716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b8ad0 0x7f94b80cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- 172.21.15.46:0/2075164716 >> 172.21.15.46:0/2075164716 conn(0x7f94b80d3ae0 msgr2=0x7f94b80cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- 172.21.15.46:0/2075164716 shutdown_connections 2023-05-21T16:55:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- 172.21.15.46:0/2075164716 wait complete. 2023-05-21T16:55:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 Processor -- start 2023-05-21T16:55:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- start start 2023-05-21T16:55:02.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b4910 0x7f94b80c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 0x7f94b81f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b80b8ad0 0x7f94b8153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b81f5ee0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8157010 con 0x7f94b80b8ad0 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.532+0000 7f94b7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8160d60 con 0x7f94b80b4910 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 0x7f94b81f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 0x7f94b81f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56164/0 (socket says 172.21.15.46:56164) 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 -- 172.21.15.46:0/3380415555 learned_addr learned my addr 172.21.15.46:0/3380415555 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94b6ffd700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b4910 0x7f94b80c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94b77fe700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b80b8ad0 0x7f94b8153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 -- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b4910 msgr2=0x7f94b80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b4910 0x7f94b80c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 -- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b80b8ad0 msgr2=0x7f94b8153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b80b8ad0 0x7f94b8153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 -- 172.21.15.46:0/3380415555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0009a70 con 0x7f94b80b5ce0 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94affff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 0x7f94b81f59a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c4e0 tx=0x7f94a000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0004ca0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0004e20 con 0x7f94b80b5ce0 2023-05-21T16:55:02.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80cd790 con 0x7f94b80b5ce0 2023-05-21T16:55:02.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0007310 con 0x7f94b80b5ce0 2023-05-21T16:55:02.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b80cd4f0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.536+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80cda70 con 0x7f94b80b5ce0 2023-05-21T16:55:02.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.540+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94a0007470 con 0x7f94b80b5ce0 2023-05-21T16:55:02.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.540+0000 7f94af7fe700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f94980662f0 0x7f94980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.540+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f94a00838f0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.540+0000 7f94b6ffd700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f94980662f0 0x7f94980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.540+0000 7f94b6ffd700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f94980662f0 0x7f94980687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009a00 tx=0x7f94a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.544+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f94a0050d40 con 0x7f94b80b5ce0 2023-05-21T16:55:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.708+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94b80733b0 con 0x7f94b80b5ce0 2023-05-21T16:55:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.708+0000 7f94af7fe700 1 -- 172.21.15.46:0/3380415555 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94a0007720 con 0x7f94b80b5ce0 2023-05-21T16:55:02.712 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f94980662f0 msgr2=0x7f94980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f94980662f0 0x7f94980687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009a00 tx=0x7f94a8008040 comp rx=0 tx=0).stop 2023-05-21T16:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 msgr2=0x7f94b81f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 0x7f94b81f59a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c4e0 tx=0x7f94a000c7f0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 shutdown_connections 2023-05-21T16:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f94980662f0 0x7f94980687a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b80b8ad0 0x7f94b8153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b80b5ce0 0x7f94b81f59a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 --2- 172.21.15.46:0/3380415555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94b80b4910 0x7f94b80c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 >> 172.21.15.46:0/3380415555 conn(0x7f94b80d3ae0 msgr2=0x7f94b80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 shutdown_connections 2023-05-21T16:55:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.712+0000 7f94b7fff700 1 -- 172.21.15.46:0/3380415555 wait complete. 2023-05-21T16:55:02.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:55:02.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.848+0000 7f96ba4d4700 1 Processor -- start 2023-05-21T16:55:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.848+0000 7f96ba4d4700 1 -- start start 2023-05-21T16:55:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96b40b8ad0 0x7f96b40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b40b8ea0 con 0x7f96b40b4910 2023-05-21T16:55:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b40d09d0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b40d0cb0 con 0x7f96b40b8ad0 2023-05-21T16:55:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b94d2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96b40b8ad0 0x7f96b40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b9cd3700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f96b40b4910 0x7f96b40d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39762/0 (socket says 172.21.15.46:39762) 2023-05-21T16:55:02.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b94d2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96b40b8ad0 0x7f96b40cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56180/0 (socket says 172.21.15.46:56180) 2023-05-21T16:55:02.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b9cd3700 1 -- 172.21.15.46:0/3958394867 learned_addr learned my addr 172.21.15.46:0/3958394867 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:02.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b94d2700 1 -- 172.21.15.46:0/3958394867 >> v1:172.21.15.142:6789/0 conn(0x7f96b40b5ce0 legacy=0x7f96b406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b94d2700 1 -- 172.21.15.46:0/3958394867 >> v1:172.21.15.46:6789/0 conn(0x7f96b40b4910 legacy=0x7f96b40d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96abfff700 1 -- 172.21.15.46:0/3958394867 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463776481 0 0) 0x7f96b40d09d0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b94d2700 1 -- 172.21.15.46:0/3958394867 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40cd4f0 con 0x7f96b40b8ad0 2023-05-21T16:55:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96b94d2700 1 --2- 172.21.15.46:0/3958394867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b8ad0 0x7f96b40cf310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009850 tx=0x7f96b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e9d125239d0193 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96abfff700 1 -- 172.21.15.46:0/3958394867 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0004230 con 0x7f96b40b8ad0 2023-05-21T16:55:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96abfff700 1 -- 172.21.15.46:0/3958394867 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0004390 con 0x7f96b40b8ad0 2023-05-21T16:55:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96abfff700 1 -- 172.21.15.46:0/3958394867 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00036c0 con 0x7f96b40b8ad0 2023-05-21T16:55:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- 172.21.15.46:0/3958394867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b8ad0 msgr2=0x7f96b40cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/3958394867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b8ad0 0x7f96b40cf310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009850 tx=0x7f96b0009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- 172.21.15.46:0/3958394867 shutdown_connections 2023-05-21T16:55:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/3958394867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b8ad0 0x7f96b40cf310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- 172.21.15.46:0/3958394867 >> 172.21.15.46:0/3958394867 conn(0x7f96b40d3ae0 msgr2=0x7f96b40cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- 172.21.15.46:0/3958394867 shutdown_connections 2023-05-21T16:55:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.852+0000 7f96ba4d4700 1 -- 172.21.15.46:0/3958394867 wait complete. 2023-05-21T16:55:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 Processor -- start 2023-05-21T16:55:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 -- start start 2023-05-21T16:55:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96b40b4910 0x7f96b40b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 0x7f96b41f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96b40b8ad0 0x7f96b415e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b41f2b30 con 0x7f96b40b5ce0 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b41f1900 con 0x7f96b40b4910 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b415ee90 con 0x7f96b40b8ad0 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 0x7f96b41f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 0x7f96b41f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56186/0 (socket says 172.21.15.46:56186) 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 -- 172.21.15.46:0/1739157083 learned_addr learned my addr 172.21.15.46:0/1739157083 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b9cd3700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96b40b8ad0 0x7f96b415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b94d2700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96b40b4910 0x7f96b40b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 -- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96b40b8ad0 msgr2=0x7f96b415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96b40b8ad0 0x7f96b415e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 -- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96b40b4910 msgr2=0x7f96b40b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96b40b4910 0x7f96b40b81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 -- 172.21.15.46:0/1739157083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00094b0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96b8cd1700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 0x7f96b41f25f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f96a40011e0 tx=0x7f96a400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40054e0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a40036a0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b40cda70 con 0x7f96b40b5ce0 2023-05-21T16:55:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4003a50 con 0x7f96b40b5ce0 2023-05-21T16:55:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.856+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b40cd790 con 0x7f96b40b5ce0 2023-05-21T16:55:02.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.860+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b40b4db0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.860+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96a4003bb0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.860+0000 7f96a9ffb700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f96980662f0 0x7f96980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:02.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.860+0000 7f96b94d2700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f96980662f0 0x7f96980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:02.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.860+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f96a40833b0 con 0x7f96b40b5ce0 2023-05-21T16:55:02.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.860+0000 7f96b94d2700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f96980662f0 0x7f96980687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009850 tx=0x7f96b0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:02.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:02.864+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f96a40506d0 con 0x7f96b40b5ce0 2023-05-21T16:55:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.032+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96b40733b0 con 0x7f96b40b5ce0 2023-05-21T16:55:03.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.032+0000 7f96a9ffb700 1 -- 172.21.15.46:0/1739157083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96a4003e60 con 0x7f96b40b5ce0 2023-05-21T16:55:03.034 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:55:03.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f96980662f0 msgr2=0x7f96980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f96980662f0 0x7f96980687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009850 tx=0x7f96b0010000 comp rx=0 tx=0).stop 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 msgr2=0x7f96b41f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 0x7f96b41f25f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f96a40011e0 tx=0x7f96a400cae0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 shutdown_connections 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f96980662f0 0x7f96980687a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96b40b8ad0 0x7f96b415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40b5ce0 0x7f96b41f25f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 --2- 172.21.15.46:0/1739157083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96b40b4910 0x7f96b40b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 >> 172.21.15.46:0/1739157083 conn(0x7f96b40d3ae0 msgr2=0x7f96b40b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 shutdown_connections 2023-05-21T16:55:03.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.036+0000 7f96ba4d4700 1 -- 172.21.15.46:0/1739157083 wait complete. 2023-05-21T16:55:03.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:55:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 Processor -- start 2023-05-21T16:55:03.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 -- start start 2023-05-21T16:55:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4740b4800 0x7fd4740b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4740b62e0 0x7fd4741607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740d0d00 con 0x7fd4740d1ac0 2023-05-21T16:55:03.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd474161520 con 0x7fd4740b62e0 2023-05-21T16:55:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd47948f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740d0fe0 con 0x7fd4740b4800 2023-05-21T16:55:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4740b62e0 0x7fd4741607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd473fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4740b4800 0x7fd4740b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4740b62e0 0x7fd4741607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56190/0 (socket says 172.21.15.46:56190) 2023-05-21T16:55:03.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 -- 172.21.15.46:0/917706896 learned_addr learned my addr 172.21.15.46:0/917706896 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 -- 172.21.15.46:0/917706896 >> v2:172.21.15.142:3300/0 conn(0x7fd4740b4800 msgr2=0x7fd4740b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 --2- 172.21.15.46:0/917706896 >> v2:172.21.15.142:3300/0 conn(0x7fd4740b4800 0x7fd4740b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 -- 172.21.15.46:0/917706896 >> v1:172.21.15.142:6789/0 conn(0x7fd4740d1ac0 legacy=0x7fd4740b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 -- 172.21.15.46:0/917706896 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740d12c0 con 0x7fd4740b62e0 2023-05-21T16:55:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.176+0000 7fd478c8e700 1 --2- 172.21.15.46:0/917706896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd4741607b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd47408bd30 tx=0x7fd46c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47907a919ea7829 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd4737fe700 1 -- 172.21.15.46:0/917706896 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00e070 con 0x7fd4740b62e0 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd4737fe700 1 -- 172.21.15.46:0/917706896 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c00b910 con 0x7fd4740b62e0 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd4737fe700 1 -- 172.21.15.46:0/917706896 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00bcc0 con 0x7fd4740b62e0 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 -- 172.21.15.46:0/917706896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 msgr2=0x7fd4741607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 --2- 172.21.15.46:0/917706896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd4741607b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd47408bd30 tx=0x7fd46c00b330 comp rx=0 tx=0).stop 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 -- 172.21.15.46:0/917706896 shutdown_connections 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 --2- 172.21.15.46:0/917706896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd4741607b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 --2- 172.21.15.46:0/917706896 >> v2:172.21.15.142:3300/0 conn(0x7fd4740b4800 0x7fd4740b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 -- 172.21.15.46:0/917706896 >> 172.21.15.46:0/917706896 conn(0x7fd47406c170 msgr2=0x7fd47406c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 -- 172.21.15.46:0/917706896 shutdown_connections 2023-05-21T16:55:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 -- 172.21.15.46:0/917706896 wait complete. 2023-05-21T16:55:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 Processor -- start 2023-05-21T16:55:03.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.180+0000 7fd47948f700 1 -- start start 2023-05-21T16:55:03.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 0x7fd4740ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd474149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4740d1ac0 0x7fd4740c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414b370 con 0x7fd4740b62e0 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd474157e00 con 0x7fd4740d1ac0 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd474149940 con 0x7fd4740b4800 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd46bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd474149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 0x7fd4740ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 0x7fd4740ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46476/0 (socket says 172.21.15.46:46476) 2023-05-21T16:55:03.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 -- 172.21.15.46:0/2581740398 learned_addr learned my addr 172.21.15.46:0/2581740398 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd46bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd474149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56192/0 (socket says 172.21.15.46:56192) 2023-05-21T16:55:03.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd478c8e700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4740d1ac0 0x7fd4740c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 -- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4740d1ac0 msgr2=0x7fd4740c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4740d1ac0 0x7fd4740c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 -- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 msgr2=0x7fd474149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd474149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 -- 172.21.15.46:0/2581740398 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009b30 con 0x7fd4740b4800 2023-05-21T16:55:03.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd473fff700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 0x7fd4740ce060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd46400ea00 tx=0x7fd46400ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464009720 con 0x7fd4740b4800 2023-05-21T16:55:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46400eea0 con 0x7fd4740b4800 2023-05-21T16:55:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46400ca50 con 0x7fd4740b4800 2023-05-21T16:55:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4740b5110 con 0x7fd4740b4800 2023-05-21T16:55:03.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.184+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4740d15a0 con 0x7fd4740b4800 2023-05-21T16:55:03.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.188+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd46400cbb0 con 0x7fd4740b4800 2023-05-21T16:55:03.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.188+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4740b2480 con 0x7fd4740b4800 2023-05-21T16:55:03.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.188+0000 7fd4717fa700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd4540662f0 0x7fd4540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.188+0000 7fd46bfff700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd4540662f0 0x7fd4540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.188+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd464083c40 con 0x7fd4740b4800 2023-05-21T16:55:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.188+0000 7fd46bfff700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd4540662f0 0x7fd4540687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4741579a0 tx=0x7fd45c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.200+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd464054ba0 con 0x7fd4740b4800 2023-05-21T16:55:03.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.364+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd47414b5e0 con 0x7fd4740b4800 2023-05-21T16:55:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.364+0000 7fd4717fa700 1 -- 172.21.15.46:0/2581740398 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd464017020 con 0x7fd4740b4800 2023-05-21T16:55:03.367 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:55:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd4540662f0 msgr2=0x7fd4540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd4540662f0 0x7fd4540687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4741579a0 tx=0x7fd45c009040 comp rx=0 tx=0).stop 2023-05-21T16:55:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 msgr2=0x7fd4740ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 0x7fd4740ce060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd46400ea00 tx=0x7fd46400ed10 comp rx=0 tx=0).stop 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 shutdown_connections 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd4540662f0 0x7fd4540687a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4740d1ac0 0x7fd4740c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4740b62e0 0x7fd474149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 --2- 172.21.15.46:0/2581740398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4740b4800 0x7fd4740ce060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 >> 172.21.15.46:0/2581740398 conn(0x7fd47406c170 msgr2=0x7fd4740b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 shutdown_connections 2023-05-21T16:55:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.368+0000 7fd47948f700 1 -- 172.21.15.46:0/2581740398 wait complete. 2023-05-21T16:55:03.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:55:03.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 Processor -- start 2023-05-21T16:55:03.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 -- start start 2023-05-21T16:55:03.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa504037f90 0x7fa504052050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa5040558a0 0x7fa504053d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040e3b40 con 0x7fa50403b560 2023-05-21T16:55:03.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040e4070 con 0x7fa5040558a0 2023-05-21T16:55:03.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5130d9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa504035690 con 0x7fa504037f90 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5120d7700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa50403b560 0x7fa504037880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39774/0 (socket says 172.21.15.46:39774) 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5128d8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa5040558a0 0x7fa504053d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5120d7700 1 -- 172.21.15.46:0/3462248446 learned_addr learned my addr 172.21.15.46:0/3462248446 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5118d6700 1 --2- 172.21.15.46:0/3462248446 >> v2:172.21.15.142:3300/0 conn(0x7fa504037f90 0x7fa504052050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5110d5700 1 -- 172.21.15.46:0/3462248446 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005291602 0 0) 0x7fa5040e3b40 con 0x7fa50403b560 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5110d5700 1 -- 172.21.15.46:0/3462248446 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f80035d0 con 0x7fa50403b560 2023-05-21T16:55:03.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5128d8700 1 -- 172.21.15.46:0/3462248446 >> v2:172.21.15.142:3300/0 conn(0x7fa504037f90 msgr2=0x7fa504052050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:03.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5128d8700 1 --2- 172.21.15.46:0/3462248446 >> v2:172.21.15.142:3300/0 conn(0x7fa504037f90 0x7fa504052050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5128d8700 1 -- 172.21.15.46:0/3462248446 >> v1:172.21.15.46:6789/0 conn(0x7fa50403b560 legacy=0x7fa504037880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.504+0000 7fa5128d8700 1 -- 172.21.15.46:0/3462248446 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504050bd0 con 0x7fa5040558a0 2023-05-21T16:55:03.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5128d8700 1 --2- 172.21.15.46:0/3462248446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5040558a0 0x7fa504053d00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0695d0 tx=0x7fa50c04eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7c99ce32bb9fb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5110d5700 1 -- 172.21.15.46:0/3462248446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c072490 con 0x7fa5040558a0 2023-05-21T16:55:03.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5110d5700 1 -- 172.21.15.46:0/3462248446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c0725f0 con 0x7fa5040558a0 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5110d5700 1 -- 172.21.15.46:0/3462248446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c073a80 con 0x7fa5040558a0 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 -- 172.21.15.46:0/3462248446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5040558a0 msgr2=0x7fa504053d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3462248446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5040558a0 0x7fa504053d00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0695d0 tx=0x7fa50c04eb10 comp rx=0 tx=0).stop 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 -- 172.21.15.46:0/3462248446 shutdown_connections 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3462248446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5040558a0 0x7fa504053d00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3462248446 >> v2:172.21.15.142:3300/0 conn(0x7fa504037f90 0x7fa504052050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 -- 172.21.15.46:0/3462248446 >> 172.21.15.46:0/3462248446 conn(0x7fa504052880 msgr2=0x7fa504052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:03.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 -- 172.21.15.46:0/3462248446 shutdown_connections 2023-05-21T16:55:03.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.508+0000 7fa5130d9700 1 -- 172.21.15.46:0/3462248446 wait complete. 2023-05-21T16:55:03.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 Processor -- start 2023-05-21T16:55:03.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 -- start start 2023-05-21T16:55:03.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 0x7fa50404db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50403b560 0x7fa50404a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5040558a0 0x7fa5041746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040d3d50 con 0x7fa504037f90 2023-05-21T16:55:03.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50404e7e0 con 0x7fa50403b560 2023-05-21T16:55:03.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040dfc30 con 0x7fa5040558a0 2023-05-21T16:55:03.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 0x7fa50404db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 0x7fa50404db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56210/0 (socket says 172.21.15.46:56210) 2023-05-21T16:55:03.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 -- 172.21.15.46:0/3299956125 learned_addr learned my addr 172.21.15.46:0/3299956125 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:03.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5118d6700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50403b560 0x7fa50404a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5128d8700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5040558a0 0x7fa5041746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 -- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5040558a0 msgr2=0x7fa5041746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5040558a0 0x7fa5041746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 -- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50403b560 msgr2=0x7fa50404a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50403b560 0x7fa50404a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 -- 172.21.15.46:0/3299956125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504050580 con 0x7fa504037f90 2023-05-21T16:55:03.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5120d7700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 0x7fa50404db10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa50800c730 tx=0x7fa50800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508005d90 con 0x7fa504037f90 2023-05-21T16:55:03.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080070d0 con 0x7fa504037f90 2023-05-21T16:55:03.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508007460 con 0x7fa504037f90 2023-05-21T16:55:03.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5040e3d90 con 0x7fa504037f90 2023-05-21T16:55:03.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.512+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa504050860 con 0x7fa504037f90 2023-05-21T16:55:03.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.516+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5040059c0 con 0x7fa504037f90 2023-05-21T16:55:03.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.516+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5080075c0 con 0x7fa504037f90 2023-05-21T16:55:03.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.516+0000 7fa502ffd700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa4f00662f0 0x7fa4f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.516+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa508083140 con 0x7fa504037f90 2023-05-21T16:55:03.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.516+0000 7fa5118d6700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa4f00662f0 0x7fa4f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.516+0000 7fa5118d6700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa4f00662f0 0x7fa4f00687a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa5040dcfa0 tx=0x7fa4fc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.524+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa508050610 con 0x7fa504037f90 2023-05-21T16:55:03.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.688+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa504052310 con 0x7fa504037f90 2023-05-21T16:55:03.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa502ffd700 1 -- 172.21.15.46:0/3299956125 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa508053c30 con 0x7fa504037f90 2023-05-21T16:55:03.693 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:55:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa4f00662f0 msgr2=0x7fa4f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa4f00662f0 0x7fa4f00687a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa5040dcfa0 tx=0x7fa4fc009240 comp rx=0 tx=0).stop 2023-05-21T16:55:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 msgr2=0x7fa50404db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 0x7fa50404db10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa50800c730 tx=0x7fa50800ca40 comp rx=0 tx=0).stop 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 shutdown_connections 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa4f00662f0 0x7fa4f00687a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5040558a0 0x7fa5041746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa50403b560 0x7fa50404a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 --2- 172.21.15.46:0/3299956125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa504037f90 0x7fa50404db10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 >> 172.21.15.46:0/3299956125 conn(0x7fa504052880 msgr2=0x7fa504034cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 shutdown_connections 2023-05-21T16:55:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.692+0000 7fa5130d9700 1 -- 172.21.15.46:0/3299956125 wait complete. 2023-05-21T16:55:03.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:55:03.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 Processor -- start 2023-05-21T16:55:03.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 -- start start 2023-05-21T16:55:03.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f886c0b8ad0 0x7f886c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b5ce0 0x7f886c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0b8ea0 con 0x7f886c0b4910 2023-05-21T16:55:03.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c0d09d0 con 0x7f886c0b8ad0 2023-05-21T16:55:03.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8872298700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0d0cb0 con 0x7f886c0b5ce0 2023-05-21T16:55:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8871296700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f886c0b8ad0 0x7f886c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8871296700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f886c0b8ad0 0x7f886c0cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56226/0 (socket says 172.21.15.46:56226) 2023-05-21T16:55:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8871296700 1 -- 172.21.15.46:0/3249204461 learned_addr learned my addr 172.21.15.46:0/3249204461 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.816+0000 7f8870a95700 1 --2- 172.21.15.46:0/3249204461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b5ce0 0x7f886c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8871296700 1 -- 172.21.15.46:0/3249204461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b5ce0 msgr2=0x7f886c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8871296700 1 --2- 172.21.15.46:0/3249204461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b5ce0 0x7f886c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8871296700 1 -- 172.21.15.46:0/3249204461 >> v1:172.21.15.142:6789/0 conn(0x7f886c0b4910 legacy=0x7f886c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8871296700 1 -- 172.21.15.46:0/3249204461 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0cd4f0 con 0x7f886c0b8ad0 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8871296700 1 --2- 172.21.15.46:0/3249204461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cf310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8868009910 tx=0x7f8868009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1036e2d4c6298f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f885ffff700 1 -- 172.21.15.46:0/3249204461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868011830 con 0x7f886c0b8ad0 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f885ffff700 1 -- 172.21.15.46:0/3249204461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868011990 con 0x7f886c0b8ad0 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f885ffff700 1 -- 172.21.15.46:0/3249204461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868011d40 con 0x7f886c0b8ad0 2023-05-21T16:55:03.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 -- 172.21.15.46:0/3249204461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b8ad0 msgr2=0x7f886c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 --2- 172.21.15.46:0/3249204461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cf310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8868009910 tx=0x7f8868009c20 comp rx=0 tx=0).stop 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 -- 172.21.15.46:0/3249204461 shutdown_connections 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 --2- 172.21.15.46:0/3249204461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b5ce0 0x7f886c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 --2- 172.21.15.46:0/3249204461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cf310 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 -- 172.21.15.46:0/3249204461 >> 172.21.15.46:0/3249204461 conn(0x7f886c0d3ae0 msgr2=0x7f886c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 -- 172.21.15.46:0/3249204461 shutdown_connections 2023-05-21T16:55:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.820+0000 7f8872298700 1 -- 172.21.15.46:0/3249204461 wait complete. 2023-05-21T16:55:03.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 Processor -- start 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 -- start start 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b4910 0x7f886c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 0x7f886c0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0c9ed0 con 0x7f886c0b5ce0 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0ca120 con 0x7f886c0b8ad0 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0ca400 con 0x7f886c0b4910 2023-05-21T16:55:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 0x7f886c0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 0x7f886c0c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56234/0 (socket says 172.21.15.46:56234) 2023-05-21T16:55:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 -- 172.21.15.46:0/2357534064 learned_addr learned my addr 172.21.15.46:0/2357534064 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8871296700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b4910 0x7f886c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8871a97700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 -- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b4910 msgr2=0x7f886c1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b4910 0x7f886c1523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 -- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0b8ad0 msgr2=0x7f886c0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 -- 172.21.15.46:0/2357534064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009570 con 0x7f886c0b5ce0 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8870a95700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 0x7f886c0c90e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f886000e840 tx=0x7f886000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600095a0 con 0x7f886c0b5ce0 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860013680 con 0x7f886c0b5ce0 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c0cda70 con 0x7f886c0b5ce0 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600139f0 con 0x7f886c0b5ce0 2023-05-21T16:55:03.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.824+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c0cd790 con 0x7f886c0b5ce0 2023-05-21T16:55:03.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.828+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c06aed0 con 0x7f886c0b5ce0 2023-05-21T16:55:03.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.828+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8860013b50 con 0x7f886c0b5ce0 2023-05-21T16:55:03.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.828+0000 7f885dffb700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f88500662f0 0x7f88500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:03.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.828+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8860083c60 con 0x7f886c0b5ce0 2023-05-21T16:55:03.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.828+0000 7f8871296700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f88500662f0 0x7f88500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:03.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.828+0000 7f8871296700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f88500662f0 0x7f88500687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8868009c60 tx=0x7f8868008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:03.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:03.836+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8860051020 con 0x7f886c0b5ce0 2023-05-21T16:55:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.012+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f886c0733b0 con 0x7f886c0b5ce0 2023-05-21T16:55:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.012+0000 7f885dffb700 1 -- 172.21.15.46:0/2357534064 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8860054640 con 0x7f886c0b5ce0 2023-05-21T16:55:04.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f88500662f0 msgr2=0x7f88500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f88500662f0 0x7f88500687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8868009c60 tx=0x7f8868008030 comp rx=0 tx=0).stop 2023-05-21T16:55:04.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 msgr2=0x7f886c0c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 0x7f886c0c90e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f886000e840 tx=0x7f886000eb50 comp rx=0 tx=0).stop 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 shutdown_connections 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f88500662f0 0x7f88500687a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f886c0b8ad0 0x7f886c0cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f886c0b5ce0 0x7f886c0c90e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 --2- 172.21.15.46:0/2357534064 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f886c0b4910 0x7f886c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 >> 172.21.15.46:0/2357534064 conn(0x7f886c0d3ae0 msgr2=0x7f886c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 shutdown_connections 2023-05-21T16:55:04.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.016+0000 7f8872298700 1 -- 172.21.15.46:0/2357534064 wait complete. 2023-05-21T16:55:04.020 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:55:04.030 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-21T16:55:04.031 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-21T16:55:04.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:04.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 Processor -- start 2023-05-21T16:55:04.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 -- start start 2023-05-21T16:55:04.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd88015c430 0x7fd88015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd880160cd0 0x7fd8800c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88015d1e0 con 0x7fd8800b0d90 2023-05-21T16:55:04.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8800b11e0 con 0x7fd880160cd0 2023-05-21T16:55:04.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.144+0000 7fd87f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd880161170 con 0x7fd88015c430 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd880160cd0 0x7fd8800c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd88015c430 0x7fd88015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87dd9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd8800b0d90 0x7fd88015d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:42300/0 (socket says 172.21.15.46:42300) 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87dd9b700 1 -- 172.21.15.46:0/1723366618 learned_addr learned my addr 172.21.15.46:0/1723366618 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd880160cd0 0x7fd8800c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:50024/0 (socket says 172.21.15.46:50024) 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 -- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd88015c430 msgr2=0x7fd88015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:04.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 --2- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd88015c430 0x7fd88015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 -- 172.21.15.46:0/1723366618 >> v1:172.21.15.142:6789/0 conn(0x7fd8800b0d90 legacy=0x7fd88015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87d59a700 1 -- 172.21.15.46:0/1723366618 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172100435 0 0) 0x7fd88015d1e0 con 0x7fd8800b0d90 2023-05-21T16:55:04.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 -- 172.21.15.46:0/1723366618 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800b1450 con 0x7fd880160cd0 2023-05-21T16:55:04.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87ed9d700 1 --2- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880160cd0 0x7fd8800c98d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd878009d90 tx=0x7fd87800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2987b70276b12c server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87d59a700 1 -- 172.21.15.46:0/1723366618 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800e070 con 0x7fd880160cd0 2023-05-21T16:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87d59a700 1 -- 172.21.15.46:0/1723366618 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87800bb20 con 0x7fd880160cd0 2023-05-21T16:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87d59a700 1 -- 172.21.15.46:0/1723366618 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878012430 con 0x7fd880160cd0 2023-05-21T16:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 -- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880160cd0 msgr2=0x7fd8800c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 --2- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880160cd0 0x7fd8800c98d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd878009d90 tx=0x7fd87800b330 comp rx=0 tx=0).stop 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 -- 172.21.15.46:0/1723366618 shutdown_connections 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 --2- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880160cd0 0x7fd8800c98d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 --2- 172.21.15.46:0/1723366618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd88015c430 0x7fd88015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 -- 172.21.15.46:0/1723366618 >> 172.21.15.46:0/1723366618 conn(0x7fd8800cbd90 msgr2=0x7fd8800cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 -- 172.21.15.46:0/1723366618 shutdown_connections 2023-05-21T16:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.148+0000 7fd87f59e700 1 -- 172.21.15.46:0/1723366618 wait complete. 2023-05-21T16:55:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 Processor -- start 2023-05-21T16:55:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 -- start start 2023-05-21T16:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 0x7fd8800b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 0x7fd880159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880160cd0 0x7fd8800afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800c9a80 con 0x7fd880160cd0 2023-05-21T16:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd880159b60 con 0x7fd88015c430 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8801f4ea0 con 0x7fd8800b0d90 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880160cd0 0x7fd8800afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 0x7fd8800b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 0x7fd880159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 0x7fd8800b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:46504/0 (socket says 172.21.15.46:46504) 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 0x7fd880159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:50028/0 (socket says 172.21.15.46:50028) 2023-05-21T16:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 -- 172.21.15.46:0/2454239040 learned_addr learned my addr 172.21.15.46:0/2454239040 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:04.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 -- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 msgr2=0x7fd880159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 0x7fd880159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 -- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880160cd0 msgr2=0x7fd8800afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880160cd0 0x7fd8800afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87e59c700 1 -- 172.21.15.46:0/2454239040 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009a70 con 0x7fd8800b0d90 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.152+0000 7fd87dd9b700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 0x7fd880159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd87e59c700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 0x7fd8800b4b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd87000e9d0 tx=0x7fd87000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870009720 con 0x7fd8800b0d90 2023-05-21T16:55:04.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000ee70 con 0x7fd8800b0d90 2023-05-21T16:55:04.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000c9f0 con 0x7fd8800b0d90 2023-05-21T16:55:04.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88015ce70 con 0x7fd8800b0d90 2023-05-21T16:55:04.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8800b1730 con 0x7fd8800b0d90 2023-05-21T16:55:04.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8800733b0 con 0x7fd8800b0d90 2023-05-21T16:55:04.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.156+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd87003b080 con 0x7fd8800b0d90 2023-05-21T16:55:04.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.160+0000 7fd86effd700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8600662f0 0x7fd8600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.160+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd870083f50 con 0x7fd8800b0d90 2023-05-21T16:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.160+0000 7fd87dd9b700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8600662f0 0x7fd8600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.160+0000 7fd87dd9b700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8600662f0 0x7fd8600687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd8800cded0 tx=0x7fd874007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.168+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd870054eb0 con 0x7fd8800b0d90 2023-05-21T16:55:04.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.336+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd880072490 con 0x7fd8800b0d90 2023-05-21T16:55:04.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.336+0000 7fd86effd700 1 -- 172.21.15.46:0/2454239040 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7fd870017090 con 0x7fd8800b0d90 2023-05-21T16:55:04.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:04.341 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:00.755376+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:04.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8600662f0 msgr2=0x7fd8600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8600662f0 0x7fd8600687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd8800cded0 tx=0x7fd874007e00 comp rx=0 tx=0).stop 2023-05-21T16:55:04.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 msgr2=0x7fd8800b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 0x7fd8800b4b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd87000e9d0 tx=0x7fd87000ece0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 shutdown_connections 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8600662f0 0x7fd8600687a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880160cd0 0x7fd8800afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88015c430 0x7fd880159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 --2- 172.21.15.46:0/2454239040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8800b0d90 0x7fd8800b4b00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 >> 172.21.15.46:0/2454239040 conn(0x7fd8800cbd90 msgr2=0x7fd88006a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 shutdown_connections 2023-05-21T16:55:04.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.340+0000 7fd87f59e700 1 -- 172.21.15.46:0/2454239040 wait complete. 2023-05-21T16:55:04.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:55:04.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:55:04.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 Processor -- start 2023-05-21T16:55:04.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 -- start start 2023-05-21T16:55:04.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa580e12a0 0x7faa58037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e1670 0x7faa580e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580e0af0 con 0x7faa580e4f50 2023-05-21T16:55:04.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580e45f0 con 0x7faa580e12a0 2023-05-21T16:55:04.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa66076700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa58038080 con 0x7faa580e1670 2023-05-21T16:55:04.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa65875700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faa580e4f50 0x7faa58036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60366/0 (socket says 172.21.15.46:60366) 2023-05-21T16:55:04.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa65875700 1 -- 172.21.15.46:0/3303015530 learned_addr learned my addr 172.21.15.46:0/3303015530 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:04.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa65074700 1 --2- 172.21.15.46:0/3303015530 >> v2:172.21.15.142:3300/0 conn(0x7faa580e12a0 0x7faa58037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa64873700 1 --2- 172.21.15.46:0/3303015530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e1670 0x7faa580e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa53fff700 1 -- 172.21.15.46:0/3303015530 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947848948 0 0) 0x7faa60073190 con 0x7faa580e4f50 2023-05-21T16:55:04.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa53fff700 1 -- 172.21.15.46:0/3303015530 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c0035d0 con 0x7faa580e4f50 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa64873700 1 -- 172.21.15.46:0/3303015530 >> v2:172.21.15.142:3300/0 conn(0x7faa580e12a0 msgr2=0x7faa58037b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa64873700 1 --2- 172.21.15.46:0/3303015530 >> v2:172.21.15.142:3300/0 conn(0x7faa580e12a0 0x7faa58037b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa64873700 1 -- 172.21.15.46:0/3303015530 >> v1:172.21.15.46:6789/0 conn(0x7faa580e4f50 legacy=0x7faa58036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa64873700 1 -- 172.21.15.46:0/3303015530 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58050f00 con 0x7faa580e1670 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa65074700 1 --2- 172.21.15.46:0/3303015530 >> v2:172.21.15.142:3300/0 conn(0x7faa580e12a0 0x7faa58037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa64873700 1 --2- 172.21.15.46:0/3303015530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e1670 0x7faa580e4a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009850 tx=0x7faa5c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a04a6f8e6f4dea server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa53fff700 1 -- 172.21.15.46:0/3303015530 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c011830 con 0x7faa580e1670 2023-05-21T16:55:04.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa53fff700 1 -- 172.21.15.46:0/3303015530 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c011990 con 0x7faa580e1670 2023-05-21T16:55:04.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.476+0000 7faa53fff700 1 -- 172.21.15.46:0/3303015530 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c011d00 con 0x7faa580e1670 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- 172.21.15.46:0/3303015530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e1670 msgr2=0x7faa580e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 --2- 172.21.15.46:0/3303015530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e1670 0x7faa580e4a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009850 tx=0x7faa5c009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- 172.21.15.46:0/3303015530 shutdown_connections 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 --2- 172.21.15.46:0/3303015530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e1670 0x7faa580e4a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 --2- 172.21.15.46:0/3303015530 >> v2:172.21.15.142:3300/0 conn(0x7faa580e12a0 0x7faa58037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- 172.21.15.46:0/3303015530 >> 172.21.15.46:0/3303015530 conn(0x7faa58051770 msgr2=0x7faa58051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- 172.21.15.46:0/3303015530 shutdown_connections 2023-05-21T16:55:04.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- 172.21.15.46:0/3303015530 wait complete. 2023-05-21T16:55:04.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 Processor -- start 2023-05-21T16:55:04.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- start start 2023-05-21T16:55:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e12a0 0x7faa580dbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 0x7faa5804bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa580e4f50 0x7faa58035980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5804eb40 con 0x7faa580e1670 2023-05-21T16:55:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58175d30 con 0x7faa580e4f50 2023-05-21T16:55:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa66076700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5804c5a0 con 0x7faa580e12a0 2023-05-21T16:55:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa64873700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 0x7faa5804bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa64873700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 0x7faa5804bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53100/0 (socket says 172.21.15.46:53100) 2023-05-21T16:55:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa64873700 1 -- 172.21.15.46:0/3063962256 learned_addr learned my addr 172.21.15.46:0/3063962256 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.480+0000 7faa65074700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e12a0 0x7faa580dbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa65875700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa580e4f50 0x7faa58035980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa64873700 1 -- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e12a0 msgr2=0x7faa580dbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa64873700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e12a0 0x7faa580dbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa64873700 1 -- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa580e4f50 msgr2=0x7faa58035980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa64873700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa580e4f50 0x7faa58035980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa64873700 1 -- 172.21.15.46:0/3063962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540094b0 con 0x7faa580e1670 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa64873700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 0x7faa5804bdc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0090b0 tx=0x7faa5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c004550 con 0x7faa580e1670 2023-05-21T16:55:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c01f070 con 0x7faa580e1670 2023-05-21T16:55:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c0094b0 con 0x7faa580e1670 2023-05-21T16:55:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c003900 con 0x7faa580e1670 2023-05-21T16:55:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa58051430 con 0x7faa580e1670 2023-05-21T16:55:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa58051150 con 0x7faa580e1670 2023-05-21T16:55:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.484+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa5c003a60 con 0x7faa580e1670 2023-05-21T16:55:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.488+0000 7faa51ffb700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faa440662f0 0x7faa440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.488+0000 7faa65074700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faa440662f0 0x7faa440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.488+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faa5c021070 con 0x7faa580e1670 2023-05-21T16:55:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.488+0000 7faa65074700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faa440662f0 0x7faa440687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d80 tx=0x7faa54009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.496+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faa5c0529c0 con 0x7faa580e1670 2023-05-21T16:55:04.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.652+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa580e4210 con 0x7faa580e1670 2023-05-21T16:55:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.652+0000 7faa51ffb700 1 -- 172.21.15.46:0/3063962256 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa5c055fe0 con 0x7faa580e1670 2023-05-21T16:55:04.656 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:55:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faa440662f0 msgr2=0x7faa440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faa440662f0 0x7faa440687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d80 tx=0x7faa54009240 comp rx=0 tx=0).stop 2023-05-21T16:55:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 msgr2=0x7faa5804bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 0x7faa5804bdc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0090b0 tx=0x7faa5c004770 comp rx=0 tx=0).stop 2023-05-21T16:55:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 shutdown_connections 2023-05-21T16:55:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7faa440662f0 0x7faa440687a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa580e4f50 0x7faa58035980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa580e1670 0x7faa5804bdc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 --2- 172.21.15.46:0/3063962256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa580e12a0 0x7faa580dbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 >> 172.21.15.46:0/3063962256 conn(0x7faa58051770 msgr2=0x7faa58004d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 shutdown_connections 2023-05-21T16:55:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.656+0000 7faa66076700 1 -- 172.21.15.46:0/3063962256 wait complete. 2023-05-21T16:55:04.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:55:04.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 Processor -- start 2023-05-21T16:55:04.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 -- start start 2023-05-21T16:55:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2bc4164f70 0x7f2bc4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2bc4071410 0x7f2bc40c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40cd9c0 con 0x7f2bc4160a00 2023-05-21T16:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40c45d0 con 0x7f2bc4071410 2023-05-21T16:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc88d3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40718b0 con 0x7f2bc4164f70 2023-05-21T16:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc2d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2bc4160a00 0x7f2bc4069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60380/0 (socket says 172.21.15.46:60380) 2023-05-21T16:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc2d9d700 1 -- 172.21.15.46:0/1748435575 learned_addr learned my addr 172.21.15.46:0/1748435575 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc259c700 1 --2- 172.21.15.46:0/1748435575 >> v2:172.21.15.142:3300/0 conn(0x7f2bc4164f70 0x7f2bc4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.796+0000 7f2bc359e700 1 --2- 172.21.15.46:0/1748435575 >> v2:172.21.15.46:3300/0 conn(0x7f2bc4071410 0x7f2bc40c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc1d9b700 1 -- 172.21.15.46:0/1748435575 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664552915 0 0) 0x7f2bb4001490 con 0x7f2bc4160a00 2023-05-21T16:55:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc1d9b700 1 -- 172.21.15.46:0/1748435575 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bac0035d0 con 0x7f2bc4160a00 2023-05-21T16:55:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc259c700 1 -- 172.21.15.46:0/1748435575 >> v2:172.21.15.46:3300/0 conn(0x7f2bc4071410 msgr2=0x7f2bc40c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc259c700 1 --2- 172.21.15.46:0/1748435575 >> v2:172.21.15.46:3300/0 conn(0x7f2bc4071410 0x7f2bc40c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc259c700 1 -- 172.21.15.46:0/1748435575 >> v1:172.21.15.46:6789/0 conn(0x7f2bc4160a00 legacy=0x7f2bc4069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc259c700 1 -- 172.21.15.46:0/1748435575 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40cd120 con 0x7f2bc4164f70 2023-05-21T16:55:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc259c700 1 --2- 172.21.15.46:0/1748435575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc4070ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40cc820 tx=0x7f2bb8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bbdce94a594542e server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc1d9b700 1 -- 172.21.15.46:0/1748435575 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4001b80 con 0x7f2bc4164f70 2023-05-21T16:55:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc1d9b700 1 -- 172.21.15.46:0/1748435575 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb8010590 con 0x7f2bc4164f70 2023-05-21T16:55:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc1d9b700 1 -- 172.21.15.46:0/1748435575 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8010940 con 0x7f2bc4164f70 2023-05-21T16:55:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 -- 172.21.15.46:0/1748435575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 msgr2=0x7f2bc4070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/1748435575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc4070ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40cc820 tx=0x7f2bb8009b30 comp rx=0 tx=0).stop 2023-05-21T16:55:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 -- 172.21.15.46:0/1748435575 shutdown_connections 2023-05-21T16:55:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/1748435575 >> v2:172.21.15.46:3300/0 conn(0x7f2bc4071410 0x7f2bc40c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/1748435575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc4070ed0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 -- 172.21.15.46:0/1748435575 >> 172.21.15.46:0/1748435575 conn(0x7f2bc40cfeb0 msgr2=0x7f2bc40cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 -- 172.21.15.46:0/1748435575 shutdown_connections 2023-05-21T16:55:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 -- 172.21.15.46:0/1748435575 wait complete. 2023-05-21T16:55:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 Processor -- start 2023-05-21T16:55:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.800+0000 7f2bc88d3700 1 -- start start 2023-05-21T16:55:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bc4071410 0x7f2bc41f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 0x7f2bc414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc40b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc414ccb0 con 0x7f2bc4160a00 2023-05-21T16:55:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc41f7010 con 0x7f2bc4164f70 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40c8210 con 0x7f2bc4071410 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 0x7f2bc414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 0x7f2bc414c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53120/0 (socket says 172.21.15.46:53120) 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 -- 172.21.15.46:0/921442205 learned_addr learned my addr 172.21.15.46:0/921442205 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc2d9d700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bc4071410 0x7f2bc41f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc359e700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc40b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 -- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bc4071410 msgr2=0x7f2bc41f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bc4071410 0x7f2bc41f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 -- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 msgr2=0x7f2bc40b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc40b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 -- 172.21.15.46:0/921442205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80094b0 con 0x7f2bc4160a00 2023-05-21T16:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc2d9d700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bc4071410 0x7f2bc41f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc259c700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 0x7f2bc414c020 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8012000 tx=0x7f2bb8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8004450 con 0x7f2bc4160a00 2023-05-21T16:55:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80045b0 con 0x7f2bc4160a00 2023-05-21T16:55:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc40cd6e0 con 0x7f2bc4160a00 2023-05-21T16:55:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8003900 con 0x7f2bc4160a00 2023-05-21T16:55:04.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.804+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc40cd400 con 0x7f2bc4160a00 2023-05-21T16:55:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.808+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc40c47b0 con 0x7f2bc4160a00 2023-05-21T16:55:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.808+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bb8003a60 con 0x7f2bc4160a00 2023-05-21T16:55:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.808+0000 7f2bab7fe700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2bb00662f0 0x7f2bb00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:04.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.808+0000 7f2bc2d9d700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2bb00662f0 0x7f2bb00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:04.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.808+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2bb8085090 con 0x7f2bc4160a00 2023-05-21T16:55:04.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.808+0000 7f2bc2d9d700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2bb00662f0 0x7f2bb00687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4001f10 tx=0x7f2bb4001ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:04.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.812+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2bb8052560 con 0x7f2bc4160a00 2023-05-21T16:55:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.976+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2bc40cc850 con 0x7f2bc4160a00 2023-05-21T16:55:04.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.976+0000 7f2bab7fe700 1 -- 172.21.15.46:0/921442205 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bb8055b80 con 0x7f2bc4160a00 2023-05-21T16:55:04.979 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:55:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2bb00662f0 msgr2=0x7f2bb00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2bb00662f0 0x7f2bb00687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4001f10 tx=0x7f2bb4001ea0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 msgr2=0x7f2bc414c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 0x7f2bc414c020 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8012000 tx=0x7f2bb8004770 comp rx=0 tx=0).stop 2023-05-21T16:55:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 shutdown_connections 2023-05-21T16:55:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2bb00662f0 0x7f2bb00687a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bc4164f70 0x7f2bc40b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bc4160a00 0x7f2bc414c020 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 --2- 172.21.15.46:0/921442205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bc4071410 0x7f2bc41f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 >> 172.21.15.46:0/921442205 conn(0x7f2bc40cfeb0 msgr2=0x7f2bc415b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 shutdown_connections 2023-05-21T16:55:04.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:04.980+0000 7f2bc88d3700 1 -- 172.21.15.46:0/921442205 wait complete. 2023-05-21T16:55:04.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:55:05.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 Processor -- start 2023-05-21T16:55:05.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 -- start start 2023-05-21T16:55:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0900d2060 0x7fc0900d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0900cd3c0 con 0x7fc0900d2a30 2023-05-21T16:55:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900cdbd0 con 0x7fc0900d2060 2023-05-21T16:55:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc096375700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900d1350 con 0x7fc09015c8f0 2023-05-21T16:55:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc095b74700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc0900d2a30 0x7fc0900b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60388/0 (socket says 172.21.15.46:60388) 2023-05-21T16:55:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc095b74700 1 -- 172.21.15.46:0/2353235160 learned_addr learned my addr 172.21.15.46:0/2353235160 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc095373700 1 --2- 172.21.15.46:0/2353235160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.116+0000 7fc094b72700 1 --2- 172.21.15.46:0/2353235160 >> v2:172.21.15.142:3300/0 conn(0x7fc0900d2060 0x7fc0900d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc087fff700 1 -- 172.21.15.46:0/2353235160 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133574907 0 0) 0x7fc0900cd3c0 con 0x7fc0900d2a30 2023-05-21T16:55:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc087fff700 1 -- 172.21.15.46:0/2353235160 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07c0035d0 con 0x7fc0900d2a30 2023-05-21T16:55:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc095373700 1 -- 172.21.15.46:0/2353235160 >> v2:172.21.15.142:3300/0 conn(0x7fc0900d2060 msgr2=0x7fc0900d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc095373700 1 --2- 172.21.15.46:0/2353235160 >> v2:172.21.15.142:3300/0 conn(0x7fc0900d2060 0x7fc0900d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc095373700 1 -- 172.21.15.46:0/2353235160 >> v1:172.21.15.46:6789/0 conn(0x7fc0900d2a30 legacy=0x7fc0900b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc095373700 1 -- 172.21.15.46:0/2353235160 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0900cd610 con 0x7fc09015c8f0 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc095373700 1 --2- 172.21.15.46:0/2353235160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cefc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc080009850 tx=0x7fc080009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3082c1c2f07844 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc087fff700 1 -- 172.21.15.46:0/2353235160 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011830 con 0x7fc09015c8f0 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc087fff700 1 -- 172.21.15.46:0/2353235160 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080011990 con 0x7fc09015c8f0 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc087fff700 1 -- 172.21.15.46:0/2353235160 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011d40 con 0x7fc09015c8f0 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 -- 172.21.15.46:0/2353235160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 msgr2=0x7fc0900cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 --2- 172.21.15.46:0/2353235160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cefc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc080009850 tx=0x7fc080009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 -- 172.21.15.46:0/2353235160 shutdown_connections 2023-05-21T16:55:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 --2- 172.21.15.46:0/2353235160 >> v2:172.21.15.142:3300/0 conn(0x7fc0900d2060 0x7fc0900d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 --2- 172.21.15.46:0/2353235160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cefc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 -- 172.21.15.46:0/2353235160 >> 172.21.15.46:0/2353235160 conn(0x7fc0900d2e00 msgr2=0x7fc0900d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 -- 172.21.15.46:0/2353235160 shutdown_connections 2023-05-21T16:55:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.120+0000 7fc096375700 1 -- 172.21.15.46:0/2353235160 wait complete. 2023-05-21T16:55:05.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 Processor -- start 2023-05-21T16:55:05.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 -- start start 2023-05-21T16:55:05.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0900d2a30 0x7fc0901f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 0x7fc09015f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09015f840 con 0x7fc09015ee80 2023-05-21T16:55:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900c9ae0 con 0x7fc0900d2a30 2023-05-21T16:55:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09015fd20 con 0x7fc09015c8f0 2023-05-21T16:55:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 0x7fc09015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 0x7fc09015f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53130/0 (socket says 172.21.15.46:53130) 2023-05-21T16:55:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc094b72700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095373700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0900d2a30 0x7fc0901f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 -- 172.21.15.46:0/3612855966 learned_addr learned my addr 172.21.15.46:0/3612855966 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 -- 172.21.15.46:0/3612855966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 msgr2=0x7fc0900cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 -- 172.21.15.46:0/3612855966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0900d2a30 msgr2=0x7fc0901f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0900d2a30 0x7fc0901f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 -- 172.21.15.46:0/3612855966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800094b0 con 0x7fc09015ee80 2023-05-21T16:55:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc095b74700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 0x7fc09015f300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc08800cb40 tx=0x7fc08800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088007500 con 0x7fc09015ee80 2023-05-21T16:55:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088007660 con 0x7fc09015ee80 2023-05-21T16:55:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880079f0 con 0x7fc09015ee80 2023-05-21T16:55:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0900d1560 con 0x7fc09015ee80 2023-05-21T16:55:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.124+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0900cd930 con 0x7fc09015ee80 2023-05-21T16:55:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.128+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0900d1840 con 0x7fc09015ee80 2023-05-21T16:55:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.128+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc08801b3b0 con 0x7fc09015ee80 2023-05-21T16:55:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.128+0000 7fc085ffb700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc0740662f0 0x7fc0740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.128+0000 7fc095373700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc0740662f0 0x7fc0740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.128+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc0880837a0 con 0x7fc09015ee80 2023-05-21T16:55:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.128+0000 7fc095373700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc0740662f0 0x7fc0740687a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc0800090b0 tx=0x7fc08001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.136+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc088050bd0 con 0x7fc09015ee80 2023-05-21T16:55:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc090067ac0 con 0x7fc09015ee80 2023-05-21T16:55:05.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc085ffb700 1 -- 172.21.15.46:0/3612855966 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0880541f0 con 0x7fc09015ee80 2023-05-21T16:55:05.298 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:55:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc0740662f0 msgr2=0x7fc0740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc0740662f0 0x7fc0740687a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc0800090b0 tx=0x7fc08001c040 comp rx=0 tx=0).stop 2023-05-21T16:55:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 msgr2=0x7fc09015f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 0x7fc09015f300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc08800cb40 tx=0x7fc08800cb70 comp rx=0 tx=0).stop 2023-05-21T16:55:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 shutdown_connections 2023-05-21T16:55:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc0740662f0 0x7fc0740687a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09015ee80 0x7fc09015f300 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc09015c8f0 0x7fc0900cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 --2- 172.21.15.46:0/3612855966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0900d2a30 0x7fc0901f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 >> 172.21.15.46:0/3612855966 conn(0x7fc0900d2e00 msgr2=0x7fc0900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 shutdown_connections 2023-05-21T16:55:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.296+0000 7fc096375700 1 -- 172.21.15.46:0/3612855966 wait complete. 2023-05-21T16:55:05.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:55:05.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b1dec700 1 Processor -- start 2023-05-21T16:55:05.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b1dec700 1 -- start start 2023-05-21T16:55:05.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b1dec700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5ac162520 0x7ff5ac164900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b1dec700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac06b9d0 con 0x7ff5ac06c760 2023-05-21T16:55:05.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b1dec700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac06b450 con 0x7ff5ac15a830 2023-05-21T16:55:05.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b1dec700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac159a90 con 0x7ff5ac162520 2023-05-21T16:55:05.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b15eb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5ac162520 0x7ff5ac164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b0dea700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff5ac06c760 0x7ff5ac15dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60404/0 (socket says 172.21.15.46:60404) 2023-05-21T16:55:05.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b15eb700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5ac162520 0x7ff5ac164900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53146/0 (socket says 172.21.15.46:53146) 2023-05-21T16:55:05.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b0dea700 1 -- 172.21.15.46:0/1398514128 learned_addr learned my addr 172.21.15.46:0/1398514128 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:05.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b15eb700 1 -- 172.21.15.46:0/1398514128 >> v1:172.21.15.142:6789/0 conn(0x7ff5ac15a830 legacy=0x7ff5ac06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b15eb700 1 -- 172.21.15.46:0/1398514128 >> v1:172.21.15.46:6789/0 conn(0x7ff5ac06c760 legacy=0x7ff5ac15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b15eb700 1 -- 172.21.15.46:0/1398514128 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac06b6f0 con 0x7ff5ac162520 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5b15eb700 1 --2- 172.21.15.46:0/1398514128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac162520 0x7ff5ac164900 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2787a682d76b9511 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5ab7fe700 1 -- 172.21.15.46:0/1398514128 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400e070 con 0x7ff5ac162520 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5ab7fe700 1 -- 172.21.15.46:0/1398514128 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400bbd0 con 0x7ff5ac162520 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.436+0000 7ff5ab7fe700 1 -- 172.21.15.46:0/1398514128 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012430 con 0x7ff5ac162520 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 -- 172.21.15.46:0/1398514128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac162520 msgr2=0x7ff5ac164900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/1398514128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac162520 0x7ff5ac164900 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a400b330 comp rx=0 tx=0).stop 2023-05-21T16:55:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 -- 172.21.15.46:0/1398514128 shutdown_connections 2023-05-21T16:55:05.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/1398514128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac162520 0x7ff5ac164900 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 -- 172.21.15.46:0/1398514128 >> 172.21.15.46:0/1398514128 conn(0x7ff5ac0cf720 msgr2=0x7ff5ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:05.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 -- 172.21.15.46:0/1398514128 shutdown_connections 2023-05-21T16:55:05.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 -- 172.21.15.46:0/1398514128 wait complete. 2023-05-21T16:55:05.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 Processor -- start 2023-05-21T16:55:05.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.440+0000 7ff5b1dec700 1 -- start start 2023-05-21T16:55:05.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac06c760 0x7ff5ac147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 0x7ff5ac069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac162520 0x7ff5ac06a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1edf20 con 0x7ff5ac15a830 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1ee200 con 0x7ff5ac162520 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1ee4e0 con 0x7ff5ac06c760 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 0x7ff5ac069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 0x7ff5ac069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53160/0 (socket says 172.21.15.46:53160) 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 -- 172.21.15.46:0/3802195607 learned_addr learned my addr 172.21.15.46:0/3802195607 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:05.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b0dea700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac06c760 0x7ff5ac147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b15eb700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac162520 0x7ff5ac06a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 -- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac06c760 msgr2=0x7ff5ac147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac06c760 0x7ff5ac147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 -- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac162520 msgr2=0x7ff5ac06a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac162520 0x7ff5ac06a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 -- 172.21.15.46:0/3802195607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009a70 con 0x7ff5ac15a830 2023-05-21T16:55:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5abfff700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 0x7ff5ac069f80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c500 tx=0x7ff59800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5980052d0 con 0x7ff5ac15a830 2023-05-21T16:55:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598005430 con 0x7ff5ac15a830 2023-05-21T16:55:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac15a030 con 0x7ff5ac15a830 2023-05-21T16:55:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5980055a0 con 0x7ff5ac15a830 2023-05-21T16:55:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac159d50 con 0x7ff5ac15a830 2023-05-21T16:55:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.444+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac15a310 con 0x7ff5ac15a830 2023-05-21T16:55:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.448+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5980038e0 con 0x7ff5ac15a830 2023-05-21T16:55:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.448+0000 7ff5a97fa700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff590066320 0x7ff5900687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.448+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff598083130 con 0x7ff5ac15a830 2023-05-21T16:55:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.448+0000 7ff5b0dea700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff590066320 0x7ff5900687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.448+0000 7ff5b0dea700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff590066320 0x7ff5900687d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0005930 tx=0x7ff5a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.456+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff5980504e0 con 0x7ff5ac15a830 2023-05-21T16:55:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.616+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5ac0733b0 con 0x7ff5ac15a830 2023-05-21T16:55:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.616+0000 7ff5a97fa700 1 -- 172.21.15.46:0/3802195607 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff598053b00 con 0x7ff5ac15a830 2023-05-21T16:55:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:55:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff590066320 msgr2=0x7ff5900687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff590066320 0x7ff5900687d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0005930 tx=0x7ff5a0009040 comp rx=0 tx=0).stop 2023-05-21T16:55:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 msgr2=0x7ff5ac069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 0x7ff5ac069f80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c500 tx=0x7ff59800c810 comp rx=0 tx=0).stop 2023-05-21T16:55:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 shutdown_connections 2023-05-21T16:55:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff590066320 0x7ff5900687d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ac162520 0x7ff5ac06a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ac15a830 0x7ff5ac069f80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 --2- 172.21.15.46:0/3802195607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ac06c760 0x7ff5ac147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 >> 172.21.15.46:0/3802195607 conn(0x7ff5ac0cf720 msgr2=0x7ff5ac15ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:05.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 shutdown_connections 2023-05-21T16:55:05.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.620+0000 7ff5b1dec700 1 -- 172.21.15.46:0/3802195607 wait complete. 2023-05-21T16:55:05.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-21T16:55:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.756+0000 7f23c197c700 1 Processor -- start 2023-05-21T16:55:05.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.756+0000 7f23c197c700 1 -- start start 2023-05-21T16:55:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23bc0b4910 0x7f23bc0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0b8ea0 con 0x7f23bc0b5ce0 2023-05-21T16:55:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0b52f0 con 0x7f23bc0b4910 2023-05-21T16:55:05.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0d09d0 con 0x7f23bc0b8ad0 2023-05-21T16:55:05.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bbfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f23bc0b5ce0 0x7f23bc06a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60412/0 (socket says 172.21.15.46:60412) 2023-05-21T16:55:05.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bbfff700 1 -- 172.21.15.46:0/1472513526 learned_addr learned my addr 172.21.15.46:0/1472513526 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:05.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c097a700 1 --2- 172.21.15.46:0/1472513526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c117b700 1 --2- 172.21.15.46:0/1472513526 >> v2:172.21.15.142:3300/0 conn(0x7f23bc0b4910 0x7f23bc0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bb7fe700 1 -- 172.21.15.46:0/1472513526 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338698174 0 0) 0x7f23bc0b8ea0 con 0x7f23bc0b5ce0 2023-05-21T16:55:05.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bb7fe700 1 -- 172.21.15.46:0/1472513526 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f239c0035d0 con 0x7f23bc0b5ce0 2023-05-21T16:55:05.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c097a700 1 -- 172.21.15.46:0/1472513526 >> v2:172.21.15.142:3300/0 conn(0x7f23bc0b4910 msgr2=0x7f23bc0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:05.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c097a700 1 --2- 172.21.15.46:0/1472513526 >> v2:172.21.15.142:3300/0 conn(0x7f23bc0b4910 0x7f23bc0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c097a700 1 -- 172.21.15.46:0/1472513526 >> v1:172.21.15.46:6789/0 conn(0x7f23bc0b5ce0 legacy=0x7f23bc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c097a700 1 -- 172.21.15.46:0/1472513526 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0d0cb0 con 0x7f23bc0b8ad0 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c097a700 1 --2- 172.21.15.46:0/1472513526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc0cf310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009850 tx=0x7f23b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f5966e5cfb6f4c server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bb7fe700 1 -- 172.21.15.46:0/1472513526 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4011830 con 0x7f23bc0b8ad0 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bb7fe700 1 -- 172.21.15.46:0/1472513526 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b4011990 con 0x7f23bc0b8ad0 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23bb7fe700 1 -- 172.21.15.46:0/1472513526 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4011d40 con 0x7f23bc0b8ad0 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- 172.21.15.46:0/1472513526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 msgr2=0x7f23bc0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 --2- 172.21.15.46:0/1472513526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc0cf310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009850 tx=0x7f23b4009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- 172.21.15.46:0/1472513526 shutdown_connections 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 --2- 172.21.15.46:0/1472513526 >> v2:172.21.15.142:3300/0 conn(0x7f23bc0b4910 0x7f23bc0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 --2- 172.21.15.46:0/1472513526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc0cf310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- 172.21.15.46:0/1472513526 >> 172.21.15.46:0/1472513526 conn(0x7f23bc0d3ae0 msgr2=0x7f23bc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- 172.21.15.46:0/1472513526 shutdown_connections 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.760+0000 7f23c197c700 1 -- 172.21.15.46:0/1472513526 wait complete. 2023-05-21T16:55:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 Processor -- start 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 -- start start 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 0x7f23bc0a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23bc0b5ce0 0x7f23bc0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc15ef00 con 0x7f23bc0b4910 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc15e310 con 0x7f23bc0b5ce0 2023-05-21T16:55:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c197c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc15e560 con 0x7f23bc0b8ad0 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 0x7f23bc0a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 0x7f23bc0a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53164/0 (socket says 172.21.15.46:53164) 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 -- 172.21.15.46:0/1489754979 learned_addr learned my addr 172.21.15.46:0/1489754979 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23bbfff700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23bc0b5ce0 0x7f23bc0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c117b700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 -- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 msgr2=0x7f23bc15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 -- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23bc0b5ce0 msgr2=0x7f23bc0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.764+0000 7f23c097a700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23bc0b5ce0 0x7f23bc0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23c097a700 1 -- 172.21.15.46:0/1489754979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40094b0 con 0x7f23bc0b4910 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23c097a700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 0x7f23bc0a98a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f23b40090b0 tx=0x7f23b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4004380 con 0x7f23bc0b4910 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b401f070 con 0x7f23bc0b4910 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc0cd790 con 0x7f23bc0b4910 2023-05-21T16:55:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40036c0 con 0x7f23bc0b4910 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc0cd4f0 con 0x7f23bc0b4910 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc0cda70 con 0x7f23bc0b4910 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.768+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23b4021030 con 0x7f23bc0b4910 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.772+0000 7f23b97fa700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f23a00662f0 0x7f23a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.772+0000 7f23bbfff700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f23a00662f0 0x7f23a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.772+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f23b4085020 con 0x7f23bc0b4910 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.772+0000 7f23bbfff700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f23a00662f0 0x7f23a00687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0d2d40 tx=0x7f23a40019f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.776+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f23b4052610 con 0x7f23bc0b4910 2023-05-21T16:55:05.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.952+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23bc0733b0 con 0x7f23bc0b4910 2023-05-21T16:55:05.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.952+0000 7f23b97fa700 1 -- 172.21.15.46:0/1489754979 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f23b4055c30 con 0x7f23bc0b4910 2023-05-21T16:55:05.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f23a00662f0 msgr2=0x7f23a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f23a00662f0 0x7f23a00687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0d2d40 tx=0x7f23a40019f0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 msgr2=0x7f23bc0a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 0x7f23bc0a98a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f23b40090b0 tx=0x7f23b4004770 comp rx=0 tx=0).stop 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 shutdown_connections 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f23a00662f0 0x7f23a00687a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23bc0b8ad0 0x7f23bc15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23bc0b5ce0 0x7f23bc0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 --2- 172.21.15.46:0/1489754979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc0b4910 0x7f23bc0a98a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 >> 172.21.15.46:0/1489754979 conn(0x7f23bc0d3ae0 msgr2=0x7f23bc0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:05.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 shutdown_connections 2023-05-21T16:55:05.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:05.956+0000 7f23c197c700 1 -- 172.21.15.46:0/1489754979 wait complete. 2023-05-21T16:55:05.960 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2023-05-21T16:55:05.970 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2023-05-21T16:55:05.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:05.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-21T16:55:05.988 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:55:05.988 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-05-21T16:55:05.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:05.989 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-21T16:55:06.039 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-21T16:55:06.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:55:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 Processor -- start 2023-05-21T16:55:06.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 -- start start 2023-05-21T16:55:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff74c153b10 0x7ff74c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff74c0cc5d0 0x7ff74c0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c161380 con 0x7ff74c160400 2023-05-21T16:55:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0cd2b0 con 0x7ff74c153b10 2023-05-21T16:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff751700700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c06a690 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff74bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff74c153b10 0x7ff74c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff74bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff74c153b10 0x7ff74c15ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53178/0 (socket says 172.21.15.46:53178) 2023-05-21T16:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff74bfff700 1 -- 172.21.15.46:0/1695995765 learned_addr learned my addr 172.21.15.46:0/1695995765 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.156+0000 7ff750eff700 1 --2- 172.21.15.46:0/1695995765 >> v2:172.21.15.142:3300/0 conn(0x7ff74c0cc5d0 0x7ff74c0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74bfff700 1 -- 172.21.15.46:0/1695995765 >> v2:172.21.15.142:3300/0 conn(0x7ff74c0cc5d0 msgr2=0x7ff74c0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74bfff700 1 --2- 172.21.15.46:0/1695995765 >> v2:172.21.15.142:3300/0 conn(0x7ff74c0cc5d0 0x7ff74c0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74bfff700 1 -- 172.21.15.46:0/1695995765 >> v1:172.21.15.142:6789/0 conn(0x7ff74c160400 legacy=0x7ff74c069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74bfff700 1 -- 172.21.15.46:0/1695995765 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0ccf30 con 0x7ff74c153b10 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74bfff700 1 --2- 172.21.15.46:0/1695995765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c153b10 0x7ff74c15ce10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0ce920 tx=0x7ff740009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc328f86c61366da server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74affd700 1 -- 172.21.15.46:0/1695995765 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740011830 con 0x7ff74c153b10 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74affd700 1 -- 172.21.15.46:0/1695995765 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740011990 con 0x7ff74c153b10 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff74affd700 1 -- 172.21.15.46:0/1695995765 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740011d20 con 0x7ff74c153b10 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 -- 172.21.15.46:0/1695995765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c153b10 msgr2=0x7ff74c15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 --2- 172.21.15.46:0/1695995765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c153b10 0x7ff74c15ce10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0ce920 tx=0x7ff740009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 -- 172.21.15.46:0/1695995765 shutdown_connections 2023-05-21T16:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 --2- 172.21.15.46:0/1695995765 >> v2:172.21.15.142:3300/0 conn(0x7ff74c0cc5d0 0x7ff74c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 --2- 172.21.15.46:0/1695995765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c153b10 0x7ff74c15ce10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 -- 172.21.15.46:0/1695995765 >> 172.21.15.46:0/1695995765 conn(0x7ff74c0cf720 msgr2=0x7ff74c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 -- 172.21.15.46:0/1695995765 shutdown_connections 2023-05-21T16:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 -- 172.21.15.46:0/1695995765 wait complete. 2023-05-21T16:55:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 Processor -- start 2023-05-21T16:55:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.160+0000 7ff751700700 1 -- start start 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 0x7ff74c0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c153b10 0x7ff74c141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74c160400 0x7ff74c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1f1e70 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c142770 con 0x7ff74c153b10 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c142a50 con 0x7ff74c160400 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 0x7ff74c0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 0x7ff74c0c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53186/0 (socket says 172.21.15.46:53186) 2023-05-21T16:55:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c153b10 0x7ff74c141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 -- 172.21.15.46:0/258035259 learned_addr learned my addr 172.21.15.46:0/258035259 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff750eff700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74c160400 0x7ff74c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 -- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74c160400 msgr2=0x7ff74c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74c160400 0x7ff74c0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 -- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c153b10 msgr2=0x7ff74c141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c153b10 0x7ff74c141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 -- 172.21.15.46:0/258035259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740009570 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff74bfff700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 0x7ff74c0c4f40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff74c06e960 tx=0x7ff740004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740004450 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74001f070 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c15d720 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740003900 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.164+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c15d440 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.168+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff740003a60 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.168+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c15da00 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.168+0000 7ff748ff9700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7380662f0 0x7ff7380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.168+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff740021070 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.168+0000 7ff74b7fe700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7380662f0 0x7ff7380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.168+0000 7ff74b7fe700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7380662f0 0x7ff7380687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff74c148400 tx=0x7ff73c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.176+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff740052630 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.372+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff74c0733b0 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff748ff9700 1 -- 172.21.15.46:0/258035259 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7ff740055c50 con 0x7ff74c0cc5d0 2023-05-21T16:55:06.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:06.377 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7380662f0 msgr2=0x7ff7380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7380662f0 0x7ff7380687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff74c148400 tx=0x7ff73c009040 comp rx=0 tx=0).stop 2023-05-21T16:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 msgr2=0x7ff74c0c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 0x7ff74c0c4f40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff74c06e960 tx=0x7ff740004770 comp rx=0 tx=0).stop 2023-05-21T16:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 shutdown_connections 2023-05-21T16:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff7380662f0 0x7ff7380687a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff74c160400 0x7ff74c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff74c153b10 0x7ff74c141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 --2- 172.21.15.46:0/258035259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff74c0cc5d0 0x7ff74c0c4f40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 >> 172.21.15.46:0/258035259 conn(0x7ff74c0cf720 msgr2=0x7ff74c15ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 shutdown_connections 2023-05-21T16:55:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.376+0000 7ff751700700 1 -- 172.21.15.46:0/258035259 wait complete. 2023-05-21T16:55:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:55:06.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:06.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 Processor -- start 2023-05-21T16:55:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- start start 2023-05-21T16:55:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f247c160910 0x7f247c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f247c160ce0 0x7f247c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c070350 0x7f247c070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c070cd0 con 0x7f247c160910 2023-05-21T16:55:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c0cf3a0 con 0x7f247c160ce0 2023-05-21T16:55:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0cf680 con 0x7f247c070350 2023-05-21T16:55:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f247c160910 0x7f247c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f247c160910 0x7f247c0ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53198/0 (socket says 172.21.15.46:53198) 2023-05-21T16:55:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 -- 172.21.15.46:0/3844008984 learned_addr learned my addr 172.21.15.46:0/3844008984 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f24814ef700 1 --2- 172.21.15.46:0/3844008984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c070350 0x7f247c070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2473fff700 1 --2- 172.21.15.46:0/3844008984 >> v2:172.21.15.142:3300/0 conn(0x7f247c160ce0 0x7f247c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 -- 172.21.15.46:0/3844008984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c070350 msgr2=0x7f247c070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 --2- 172.21.15.46:0/3844008984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c070350 0x7f247c070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 -- 172.21.15.46:0/3844008984 >> v2:172.21.15.142:3300/0 conn(0x7f247c160ce0 msgr2=0x7f247c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 --2- 172.21.15.46:0/3844008984 >> v2:172.21.15.142:3300/0 conn(0x7f247c160ce0 0x7f247c0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 -- 172.21.15.46:0/3844008984 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0cf960 con 0x7f247c160910 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2473fff700 1 --2- 172.21.15.46:0/3844008984 >> v2:172.21.15.142:3300/0 conn(0x7f247c160ce0 0x7f247c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2480cee700 1 --2- 172.21.15.46:0/3844008984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c160910 0x7f247c0ce830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f247c0cd5f0 tx=0x7f2478009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2788a3dc5a1f13 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f24737fe700 1 -- 172.21.15.46:0/3844008984 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800b8a0 con 0x7f247c160910 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f24737fe700 1 -- 172.21.15.46:0/3844008984 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247800ba00 con 0x7f247c160910 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f24737fe700 1 -- 172.21.15.46:0/3844008984 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800bd90 con 0x7f247c160910 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- 172.21.15.46:0/3844008984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c160910 msgr2=0x7f247c0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- 172.21.15.46:0/3844008984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c160910 0x7f247c0ce830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f247c0cd5f0 tx=0x7f2478009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- 172.21.15.46:0/3844008984 shutdown_connections 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- 172.21.15.46:0/3844008984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c070350 0x7f247c070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- 172.21.15.46:0/3844008984 >> v2:172.21.15.142:3300/0 conn(0x7f247c160ce0 0x7f247c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 --2- 172.21.15.46:0/3844008984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c160910 0x7f247c0ce830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- 172.21.15.46:0/3844008984 >> 172.21.15.46:0/3844008984 conn(0x7f247c0d0c60 msgr2=0x7f247c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:06.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.508+0000 7f2481cf0700 1 -- 172.21.15.46:0/3844008984 shutdown_connections 2023-05-21T16:55:06.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.512+0000 7f2481cf0700 1 -- 172.21.15.46:0/3844008984 wait complete. 2023-05-21T16:55:06.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.512+0000 7f2481cf0700 1 Processor -- start 2023-05-21T16:55:06.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.512+0000 7f2481cf0700 1 -- start start 2023-05-21T16:55:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 0x7f247c0b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f247c160910 0x7f247c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c160ce0 0x7f247c1f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1f7240 con 0x7f247c070350 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1f74d0 con 0x7f247c160910 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0b4ec0 con 0x7f247c160ce0 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 0x7f247c0b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 0x7f247c0b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53212/0 (socket says 172.21.15.46:53212) 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 -- 172.21.15.46:0/848122224 learned_addr learned my addr 172.21.15.46:0/848122224 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2473fff700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f247c160910 0x7f247c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f24814ef700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c160ce0 0x7f247c1f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 -- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c160ce0 msgr2=0x7f247c1f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c160ce0 0x7f247c1f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 -- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f247c160910 msgr2=0x7f247c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f247c160910 0x7f247c0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 -- 172.21.15.46:0/848122224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478009570 con 0x7f247c070350 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2480cee700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 0x7f247c0b6790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2478000c00 tx=0x7f2478004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24780038c0 con 0x7f247c070350 2023-05-21T16:55:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247801e070 con 0x7f247c070350 2023-05-21T16:55:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c0cff20 con 0x7f247c070350 2023-05-21T16:55:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478003c80 con 0x7f247c070350 2023-05-21T16:55:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c0cfc40 con 0x7f247c070350 2023-05-21T16:55:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.516+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c067ac0 con 0x7f247c070350 2023-05-21T16:55:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.520+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2478011420 con 0x7f247c070350 2023-05-21T16:55:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.520+0000 7f24717fa700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2468066320 0x7f24680687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.520+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2478020070 con 0x7f247c070350 2023-05-21T16:55:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.520+0000 7f2473fff700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2468066320 0x7f24680687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.520+0000 7f2473fff700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2468066320 0x7f24680687d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f247c0b6cd0 tx=0x7f246c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.528+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2478052810 con 0x7f247c070350 2023-05-21T16:55:06.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.696+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f247c0c4460 con 0x7f247c070350 2023-05-21T16:55:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f24717fa700 1 -- 172.21.15.46:0/848122224 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f2478055e30 con 0x7f247c070350 2023-05-21T16:55:06.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:06.702 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:00.755376+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2468066320 msgr2=0x7f24680687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2468066320 0x7f24680687d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f247c0b6cd0 tx=0x7f246c008040 comp rx=0 tx=0).stop 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 msgr2=0x7f247c0b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 0x7f247c0b6790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2478000c00 tx=0x7f2478004770 comp rx=0 tx=0).stop 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 shutdown_connections 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f2468066320 0x7f24680687d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f247c160ce0 0x7f247c1f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f247c160910 0x7f247c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 --2- 172.21.15.46:0/848122224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f247c070350 0x7f247c0b6790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 >> 172.21.15.46:0/848122224 conn(0x7f247c0d0c60 msgr2=0x7f247c0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 shutdown_connections 2023-05-21T16:55:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.700+0000 7f2481cf0700 1 -- 172.21.15.46:0/848122224 wait complete. 2023-05-21T16:55:06.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:54:16.591016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:54:17.138805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:55:06.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:55:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.836+0000 7f7978da4700 1 Processor -- start 2023-05-21T16:55:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.836+0000 7f7978da4700 1 -- start start 2023-05-21T16:55:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f797406b280 0x7f79740715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79740ccc60 con 0x7f7974071b00 2023-05-21T16:55:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797406b7b0 con 0x7f797415ca60 2023-05-21T16:55:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7974071fa0 con 0x7f797406b280 2023-05-21T16:55:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f797406b280 0x7f79740715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f797406b280 0x7f79740715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53220/0 (socket says 172.21.15.46:53220) 2023-05-21T16:55:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 -- 172.21.15.46:0/3625283650 learned_addr learned my addr 172.21.15.46:0/3625283650 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 -- 172.21.15.46:0/3625283650 >> v1:172.21.15.142:6789/0 conn(0x7f797415ca60 legacy=0x7f797415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 -- 172.21.15.46:0/3625283650 >> v1:172.21.15.46:6789/0 conn(0x7f7974071b00 legacy=0x7f7974158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 -- 172.21.15.46:0/3625283650 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740cceb0 con 0x7f797406b280 2023-05-21T16:55:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f796bfff700 1 --2- 172.21.15.46:0/3625283650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f797406b280 0x7f79740715c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f795c00aab0 tx=0x7f795c00adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86adbaa6d4bd7d51 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7971d9b700 1 -- 172.21.15.46:0/3625283650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00cb70 con 0x7f797406b280 2023-05-21T16:55:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7971d9b700 1 -- 172.21.15.46:0/3625283650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00ccd0 con 0x7f797406b280 2023-05-21T16:55:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7971d9b700 1 -- 172.21.15.46:0/3625283650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c018620 con 0x7f797406b280 2023-05-21T16:55:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- 172.21.15.46:0/3625283650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f797406b280 msgr2=0x7f79740715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 --2- 172.21.15.46:0/3625283650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f797406b280 0x7f79740715c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f795c00aab0 tx=0x7f795c00adc0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- 172.21.15.46:0/3625283650 shutdown_connections 2023-05-21T16:55:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 --2- 172.21.15.46:0/3625283650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f797406b280 0x7f79740715c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- 172.21.15.46:0/3625283650 >> 172.21.15.46:0/3625283650 conn(0x7f79740cf090 msgr2=0x7f79740cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- 172.21.15.46:0/3625283650 shutdown_connections 2023-05-21T16:55:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.840+0000 7f7978da4700 1 -- 172.21.15.46:0/3625283650 wait complete. 2023-05-21T16:55:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 Processor -- start 2023-05-21T16:55:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 -- start start 2023-05-21T16:55:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f797406b280 0x7f797415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 0x7f7974099480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f797415ca60 0x7f79740b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7974098f60 con 0x7f7974071b00 2023-05-21T16:55:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797415b760 con 0x7f797415ca60 2023-05-21T16:55:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7978da4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79740aef80 con 0x7f797406b280 2023-05-21T16:55:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 0x7f7974099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 0x7f7974099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53224/0 (socket says 172.21.15.46:53224) 2023-05-21T16:55:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 -- 172.21.15.46:0/2972578621 learned_addr learned my addr 172.21.15.46:0/2972578621 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f797259c700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f797406b280 0x7f797415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f7972d9d700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f797415ca60 0x7f79740b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 -- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f797406b280 msgr2=0x7f797415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f797406b280 0x7f797415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 -- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f797415ca60 msgr2=0x7f79740b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f797415ca60 0x7f79740b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 -- 172.21.15.46:0/2972578621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c00a710 con 0x7f7974071b00 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.844+0000 7f796bfff700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 0x7f7974099480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f795c00ae00 tx=0x7f795c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c01e070 con 0x7f7974071b00 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00cec0 con 0x7f7974071b00 2023-05-21T16:55:06.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79740cd470 con 0x7f7974071b00 2023-05-21T16:55:06.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c003b30 con 0x7f7974071b00 2023-05-21T16:55:06.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79740cd190 con 0x7f7974071b00 2023-05-21T16:55:06.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797415d540 con 0x7f7974071b00 2023-05-21T16:55:06.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.848+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f795c003c90 con 0x7f7974071b00 2023-05-21T16:55:06.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.852+0000 7f796affd700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79540662f0 0x7f79540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:06.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.852+0000 7f797259c700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79540662f0 0x7f79540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:06.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.852+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f795c0861b0 con 0x7f7974071b00 2023-05-21T16:55:06.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.852+0000 7f797259c700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79540662f0 0x7f79540687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79740cd6d0 tx=0x7f7964009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:06.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:06.860+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f795c053680 con 0x7f7974071b00 2023-05-21T16:55:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.020+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7974073cb0 con 0x7f7974071b00 2023-05-21T16:55:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.020+0000 7f796affd700 1 -- 172.21.15.46:0/2972578621 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f795c056ca0 con 0x7f7974071b00 2023-05-21T16:55:07.024 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:55:07.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79540662f0 msgr2=0x7f79540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79540662f0 0x7f79540687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79740cd6d0 tx=0x7f7964009040 comp rx=0 tx=0).stop 2023-05-21T16:55:07.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 msgr2=0x7f7974099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 0x7f7974099480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f795c00ae00 tx=0x7f795c004770 comp rx=0 tx=0).stop 2023-05-21T16:55:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 shutdown_connections 2023-05-21T16:55:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79540662f0 0x7f79540687a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f797415ca60 0x7f79740b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7974071b00 0x7f7974099480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 --2- 172.21.15.46:0/2972578621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f797406b280 0x7f797415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 >> 172.21.15.46:0/2972578621 conn(0x7f79740cf090 msgr2=0x7f79741e25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 shutdown_connections 2023-05-21T16:55:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.024+0000 7f7978da4700 1 -- 172.21.15.46:0/2972578621 wait complete. 2023-05-21T16:55:07.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:55:07.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800d1e0700 1 Processor -- start 2023-05-21T16:55:07.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800d1e0700 1 -- start start 2023-05-21T16:55:07.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800d1e0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8008157470 0x7f800806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800d1e0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80080cd670 con 0x7f80080b1c30 2023-05-21T16:55:07.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800d1e0700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800806cb10 con 0x7f800815a8e0 2023-05-21T16:55:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800d1e0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800806cdf0 con 0x7f8008157470 2023-05-21T16:55:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800c9df700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f80080b1c30 0x7f80080cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60430/0 (socket says 172.21.15.46:60430) 2023-05-21T16:55:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800c9df700 1 -- 172.21.15.46:0/32626422 learned_addr learned my addr 172.21.15.46:0/32626422 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8007fff700 1 --2- 172.21.15.46:0/32626422 >> v2:172.21.15.142:3300/0 conn(0x7f8008157470 0x7f800806c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945339284 0 0) 0x7f80080cd670 con 0x7f80080b1c30 2023-05-21T16:55:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff00035d0 con 0x7f80080b1c30 2023-05-21T16:55:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942214745 0 0) 0x7f800806cb10 con 0x7f800815a8e0 2023-05-21T16:55:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80080cd670 con 0x7f800815a8e0 2023-05-21T16:55:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519692701 0 0) 0x7f7ff00035d0 con 0x7f80080b1c30 2023-05-21T16:55:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 >> v2:172.21.15.142:3300/0 conn(0x7f8008157470 msgr2=0x7f800806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 --2- 172.21.15.46:0/32626422 >> v2:172.21.15.142:3300/0 conn(0x7f8008157470 0x7f800806c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 >> v1:172.21.15.142:6789/0 conn(0x7f800815a8e0 legacy=0x7f80080b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800806d0d0 con 0x7f80080b1c30 2023-05-21T16:55:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f8000001670 con 0x7f80080b1c30 2023-05-21T16:55:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8007fff700 1 --2- 172.21.15.46:0/32626422 >> v2:172.21.15.142:3300/0 conn(0x7f8008157470 0x7f800806c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 >> v1:172.21.15.46:6789/0 conn(0x7f80080b1c30 legacy=0x7f80080cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0003bb0 0x7f7ff0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ff0004870 0x7f7ff0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff0005220 0x7f7ff000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800806cdf0 con 0x7f7ff0005220 2023-05-21T16:55:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff000c080 con 0x7f7ff0003bb0 2023-05-21T16:55:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff000c240 con 0x7f7ff0004870 2023-05-21T16:55:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f800c9df700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff0005220 0x7f7ff000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f80077fe700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ff0004870 0x7f7ff0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.160+0000 7f8007fff700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0003bb0 0x7f7ff0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f80077fe700 1 -- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0003bb0 msgr2=0x7f7ff0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f80077fe700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0003bb0 0x7f7ff0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f80077fe700 1 -- 172.21.15.46:0/32626422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff0005220 msgr2=0x7f7ff000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f80077fe700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ff0005220 0x7f7ff000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f80077fe700 1 -- 172.21.15.46:0/32626422 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00035d0 con 0x7f7ff0004870 2023-05-21T16:55:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800c9df700 1 -- 172.21.15.46:0/32626422 reap_dead start 2023-05-21T16:55:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f80077fe700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ff0004870 0x7f7ff0004ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0019f0 tx=0x7f7ff00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3dcc78db7f2c2db server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0052d0 con 0x7f7ff0004870 2023-05-21T16:55:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc005450 con 0x7f7ff0004870 2023-05-21T16:55:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f8006ffd700 1 -- 172.21.15.46:0/32626422 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00eaa0 con 0x7f7ff0004870 2023-05-21T16:55:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 -- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ff0004870 msgr2=0x7f7ff0004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ff0004870 0x7f7ff0004ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0019f0 tx=0x7f7ff00058a0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 -- 172.21.15.46:0/32626422 shutdown_connections 2023-05-21T16:55:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 --2- 172.21.15.46:0/32626422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ff0004870 0x7f7ff0004ce0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 -- 172.21.15.46:0/32626422 >> 172.21.15.46:0/32626422 conn(0x7f800806d930 msgr2=0x7f800806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 -- 172.21.15.46:0/32626422 shutdown_connections 2023-05-21T16:55:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.164+0000 7f800d1e0700 1 -- 172.21.15.46:0/32626422 wait complete. 2023-05-21T16:55:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 Processor -- start 2023-05-21T16:55:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 -- start start 2023-05-21T16:55:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0004870 0x7f8008151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 0x7f8008157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f800814fdb0 0x7f8008150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008151f90 con 0x7f8008151b20 2023-05-21T16:55:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008150760 con 0x7f7ff0004870 2023-05-21T16:55:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80080c6430 con 0x7f800814fdb0 2023-05-21T16:55:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 0x7f8008157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f8007fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0004870 0x7f8008151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800c9df700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f800814fdb0 0x7f8008150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 0x7f8008157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53244/0 (socket says 172.21.15.46:53244) 2023-05-21T16:55:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 -- 172.21.15.46:0/659134086 learned_addr learned my addr 172.21.15.46:0/659134086 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 -- 172.21.15.46:0/659134086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f800814fdb0 msgr2=0x7f8008150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f800814fdb0 0x7f8008150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 -- 172.21.15.46:0/659134086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0004870 msgr2=0x7f8008151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0004870 0x7f8008151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 -- 172.21.15.46:0/659134086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80080b1520 con 0x7f8008151b20 2023-05-21T16:55:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f80077fe700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 0x7f8008157b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e5d0 tx=0x7f7ffc0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00ec70 con 0x7f8008151b20 2023-05-21T16:55:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc00edf0 con 0x7f8008151b20 2023-05-21T16:55:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80080cd8c0 con 0x7f8008151b20 2023-05-21T16:55:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc007280 con 0x7f8008151b20 2023-05-21T16:55:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.168+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80080b16b0 con 0x7f8008151b20 2023-05-21T16:55:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.172+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8008073cb0 con 0x7f8008151b20 2023-05-21T16:55:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.172+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ffc0073e0 con 0x7f8008151b20 2023-05-21T16:55:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.172+0000 7f8004ff9700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ff40662f0 0x7f7ff40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.172+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ffc085830 con 0x7f8008151b20 2023-05-21T16:55:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.172+0000 7f8007fff700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ff40662f0 0x7f7ff40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.172+0000 7f8007fff700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ff40662f0 0x7f7ff40687a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8014590 tx=0x7f7ff800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.180+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7ffc052d40 con 0x7f8008151b20 2023-05-21T16:55:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f800806bde0 con 0x7f8008151b20 2023-05-21T16:55:07.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f8004ff9700 1 -- 172.21.15.46:0/659134086 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ffc056360 con 0x7f8008151b20 2023-05-21T16:55:07.350 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:55:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ff40662f0 msgr2=0x7f7ff40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ff40662f0 0x7f7ff40687a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8014590 tx=0x7f7ff800b040 comp rx=0 tx=0).stop 2023-05-21T16:55:07.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 msgr2=0x7f8008157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 0x7f8008157b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e5d0 tx=0x7f7ffc0012d0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 shutdown_connections 2023-05-21T16:55:07.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ff40662f0 0x7f7ff40687a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f800814fdb0 0x7f8008150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8008151b20 0x7f8008157b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 --2- 172.21.15.46:0/659134086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ff0004870 0x7f8008151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 >> 172.21.15.46:0/659134086 conn(0x7f800806d930 msgr2=0x7f8008159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:07.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 shutdown_connections 2023-05-21T16:55:07.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.348+0000 7f800d1e0700 1 -- 172.21.15.46:0/659134086 wait complete. 2023-05-21T16:55:07.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-21T16:55:07.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.484+0000 7f490a1b3700 1 Processor -- start 2023-05-21T16:55:07.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.484+0000 7f490a1b3700 1 -- start start 2023-05-21T16:55:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f490a1b3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49040b8ad0 0x7f49040cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f490a1b3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49040b4910 0x7f49040b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f490a1b3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040b8ea0 con 0x7f49040b5ce0 2023-05-21T16:55:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f490a1b3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49040b52f0 con 0x7f49040b4910 2023-05-21T16:55:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f490a1b3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040d09d0 con 0x7f49040b8ad0 2023-05-21T16:55:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f49040b5ce0 0x7f490406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60438/0 (socket says 172.21.15.46:60438) 2023-05-21T16:55:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 -- 172.21.15.46:0/455877352 learned_addr learned my addr 172.21.15.46:0/455877352 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:07.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49091b1700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49040b8ad0 0x7f49040cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49099b2700 1 --2- 172.21.15.46:0/455877352 >> v2:172.21.15.142:3300/0 conn(0x7f49040b4910 0x7f49040b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183747850 0 0) 0x7f49040b8ea0 con 0x7f49040b5ce0 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f00035d0 con 0x7f49040b5ce0 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241892523 0 0) 0x7f48f00035d0 con 0x7f49040b5ce0 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49040b8ad0 msgr2=0x7f49040cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49040b8ad0 0x7f49040cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 >> v2:172.21.15.142:3300/0 conn(0x7f49040b4910 msgr2=0x7f49040b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 --2- 172.21.15.46:0/455877352 >> v2:172.21.15.142:3300/0 conn(0x7f49040b4910 0x7f49040b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040d0cb0 con 0x7f49040b5ce0 2023-05-21T16:55:07.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f48f4001670 con 0x7f49040b5ce0 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 >> v1:172.21.15.46:6789/0 conn(0x7f49040b5ce0 legacy=0x7f490406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0003a20 0x7f48f0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f0004450 0x7f48f0004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f0005020 0x7f48f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040d09d0 con 0x7f48f0004450 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f000bf70 con 0x7f48f0003a20 2023-05-21T16:55:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f000c0b0 con 0x7f48f0005020 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49091b1700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49040b8ad0 0x7f49040cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f0004450 0x7f48f0004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49091b1700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0003a20 0x7f48f0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49099b2700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f0005020 0x7f48f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 -- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f0005020 msgr2=0x7f48f000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f0005020 0x7f48f000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 -- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0003a20 msgr2=0x7f48f0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:07.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0003a20 0x7f48f0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 -- 172.21.15.46:0/455877352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00035d0 con 0x7f48f0004450 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49091b1700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0003a20 0x7f48f0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49099b2700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f0005020 0x7f48f000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f49089b0700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f0004450 0x7f48f0004910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48f400c320 tx=0x7f48f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560dc9f3ee559b66 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400ce60 con 0x7f48f0004450 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4005980 con 0x7f48f0004450 2023-05-21T16:55:07.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.488+0000 7f48fbfff700 1 -- 172.21.15.46:0/455877352 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005d30 con 0x7f48f0004450 2023-05-21T16:55:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 -- 172.21.15.46:0/455877352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f0004450 msgr2=0x7f48f0004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 --2- 172.21.15.46:0/455877352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f0004450 0x7f48f0004910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48f400c320 tx=0x7f48f00058a0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f49099b2700 1 -- 172.21.15.46:0/455877352 reap_dead start 2023-05-21T16:55:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 -- 172.21.15.46:0/455877352 shutdown_connections 2023-05-21T16:55:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 -- 172.21.15.46:0/455877352 >> 172.21.15.46:0/455877352 conn(0x7f49040d3ae0 msgr2=0x7f49040cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:07.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 -- 172.21.15.46:0/455877352 shutdown_connections 2023-05-21T16:55:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 -- 172.21.15.46:0/455877352 wait complete. 2023-05-21T16:55:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 Processor -- start 2023-05-21T16:55:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.492+0000 7f490a1b3700 1 -- start start 2023-05-21T16:55:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0004450 0x7f49040aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 0x7f490415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f490415f2a0 0x7f490415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490415ee80 con 0x7f49040a9960 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040aa820 con 0x7f48f0004450 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49040a9dd0 con 0x7f490415f2a0 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 0x7f490415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 0x7f490415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53254/0 (socket says 172.21.15.46:53254) 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 -- 172.21.15.46:0/3996261054 learned_addr learned my addr 172.21.15.46:0/3996261054 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:07.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49091b1700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0004450 0x7f49040aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49099b2700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f490415f2a0 0x7f490415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 -- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f490415f2a0 msgr2=0x7f490415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f490415f2a0 0x7f490415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 -- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0004450 msgr2=0x7f49040aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0004450 0x7f49040aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 -- 172.21.15.46:0/3996261054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040cd790 con 0x7f49040a9960 2023-05-21T16:55:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f49089b0700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 0x7f490415a310 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48f4000c00 tx=0x7f48f4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005ea0 con 0x7f49040a9960 2023-05-21T16:55:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f400ceb0 con 0x7f49040a9960 2023-05-21T16:55:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040cd4f0 con 0x7f49040a9960 2023-05-21T16:55:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4004cc0 con 0x7f49040a9960 2023-05-21T16:55:07.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040cda70 con 0x7f49040a9960 2023-05-21T16:55:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.496+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49040733b0 con 0x7f49040a9960 2023-05-21T16:55:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.500+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48f40070d0 con 0x7f49040a9960 2023-05-21T16:55:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.500+0000 7f48f9ffb700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f48e8066320 0x7f48e80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.500+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f48f40852d0 con 0x7f49040a9960 2023-05-21T16:55:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.500+0000 7f49091b1700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f48e8066320 0x7f48e80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.500+0000 7f49091b1700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f48e8066320 0x7f48e80687d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f490415c080 tx=0x7f4900008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.508+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48f4052840 con 0x7f49040a9960 2023-05-21T16:55:07.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49040d1e90 con 0x7f49040a9960 2023-05-21T16:55:07.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f48f9ffb700 1 -- 172.21.15.46:0/3996261054 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48f4007dc0 con 0x7f49040a9960 2023-05-21T16:55:07.674 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-21T16:55:07.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f48e8066320 msgr2=0x7f48e80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f48e8066320 0x7f48e80687d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f490415c080 tx=0x7f4900008040 comp rx=0 tx=0).stop 2023-05-21T16:55:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 msgr2=0x7f490415a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 0x7f490415a310 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48f4000c00 tx=0x7f48f4001a00 comp rx=0 tx=0).stop 2023-05-21T16:55:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 shutdown_connections 2023-05-21T16:55:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f48e8066320 0x7f48e80687d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f490415f2a0 0x7f490415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49040a9960 0x7f490415a310 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 --2- 172.21.15.46:0/3996261054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f0004450 0x7f49040aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 >> 172.21.15.46:0/3996261054 conn(0x7f49040d3ae0 msgr2=0x7f4904069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:07.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 shutdown_connections 2023-05-21T16:55:07.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.672+0000 7f490a1b3700 1 -- 172.21.15.46:0/3996261054 wait complete. 2023-05-21T16:55:07.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-21T16:55:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6908b22700 1 Processor -- start 2023-05-21T16:55:07.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6908b22700 1 -- start start 2023-05-21T16:55:07.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6908b22700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6904145380 0x7f6904070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6908b22700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690406f1d0 con 0x7f69040c40c0 2023-05-21T16:55:07.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6908b22700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6904145c10 con 0x7f6904145750 2023-05-21T16:55:07.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6908b22700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6904161000 con 0x7f6904145380 2023-05-21T16:55:07.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f69037fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6904145380 0x7f6904070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6903fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f69040c40c0 0x7f690406eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60454/0 (socket says 172.21.15.46:60454) 2023-05-21T16:55:07.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.816+0000 7f6903fff700 1 -- 172.21.15.46:0/1294234314 learned_addr learned my addr 172.21.15.46:0/1294234314 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:07.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69037fe700 1 -- 172.21.15.46:0/1294234314 >> v1:172.21.15.142:6789/0 conn(0x7f6904145750 legacy=0x7f690406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69037fe700 1 -- 172.21.15.46:0/1294234314 >> v1:172.21.15.46:6789/0 conn(0x7f69040c40c0 legacy=0x7f690406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69037fe700 1 -- 172.21.15.46:0/1294234314 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904160240 con 0x7f6904145380 2023-05-21T16:55:07.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69037fe700 1 --2- 172.21.15.46:0/1294234314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145380 0x7f6904070ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009850 tx=0x7f68f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8700360e21bb2011 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69027fc700 1 -- 172.21.15.46:0/1294234314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4011830 con 0x7f6904145380 2023-05-21T16:55:07.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69027fc700 1 -- 172.21.15.46:0/1294234314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4011990 con 0x7f6904145380 2023-05-21T16:55:07.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f69027fc700 1 -- 172.21.15.46:0/1294234314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4011d20 con 0x7f6904145380 2023-05-21T16:55:07.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 -- 172.21.15.46:0/1294234314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145380 msgr2=0x7f6904070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 --2- 172.21.15.46:0/1294234314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145380 0x7f6904070ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009850 tx=0x7f68f4009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 -- 172.21.15.46:0/1294234314 shutdown_connections 2023-05-21T16:55:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 --2- 172.21.15.46:0/1294234314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145380 0x7f6904070ed0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 -- 172.21.15.46:0/1294234314 >> 172.21.15.46:0/1294234314 conn(0x7f69040cfeb0 msgr2=0x7f69040cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 -- 172.21.15.46:0/1294234314 shutdown_connections 2023-05-21T16:55:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.820+0000 7f6908b22700 1 -- 172.21.15.46:0/1294234314 wait complete. 2023-05-21T16:55:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 Processor -- start 2023-05-21T16:55:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 -- start start 2023-05-21T16:55:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69040c40c0 0x7f69040b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6904145380 0x7f69040b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 0x7f69041f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69040c6960 con 0x7f6904145750 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69040c6c40 con 0x7f6904145380 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69040c6f20 con 0x7f69040c40c0 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 0x7f69041f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 0x7f69041f5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53274/0 (socket says 172.21.15.46:53274) 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 -- 172.21.15.46:0/3203525858 learned_addr learned my addr 172.21.15.46:0/3203525858 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f69037fe700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69040c40c0 0x7f69040b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6902ffd700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6904145380 0x7f69040b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 -- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69040c40c0 msgr2=0x7f69040b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69040c40c0 0x7f69040b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 -- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6904145380 msgr2=0x7f69040b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6904145380 0x7f69040b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 -- 172.21.15.46:0/3203525858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40094b0 con 0x7f6904145750 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6903fff700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 0x7f69041f5aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00caa0 tx=0x7f68fc00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc007480 con 0x7f6904145750 2023-05-21T16:55:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc0075e0 con 0x7f6904145750 2023-05-21T16:55:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6904160800 con 0x7f6904145750 2023-05-21T16:55:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc007950 con 0x7f6904145750 2023-05-21T16:55:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.824+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904160520 con 0x7f6904145750 2023-05-21T16:55:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.828+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6904160ae0 con 0x7f6904145750 2023-05-21T16:55:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.828+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68fc01b3b0 con 0x7f6904145750 2023-05-21T16:55:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.828+0000 7f68ebfff700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68f00662f0 0x7f68f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.828+0000 7f69037fe700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68f00662f0 0x7f68f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:07.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.828+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f68fc0834c0 con 0x7f6904145750 2023-05-21T16:55:07.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.828+0000 7f69037fe700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68f00662f0 0x7f68f00687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f68f4014040 tx=0x7f68f401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:07.836+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f68fc0509b0 con 0x7f6904145750 2023-05-21T16:55:08.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.000+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6904073cb0 con 0x7f6904145750 2023-05-21T16:55:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.000+0000 7f68ebfff700 1 -- 172.21.15.46:0/3203525858 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68fc053fd0 con 0x7f6904145750 2023-05-21T16:55:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-21T16:55:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68f00662f0 msgr2=0x7f68f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68f00662f0 0x7f68f00687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f68f4014040 tx=0x7f68f401c040 comp rx=0 tx=0).stop 2023-05-21T16:55:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 msgr2=0x7f69041f5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 0x7f69041f5aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00caa0 tx=0x7f68fc00cad0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 shutdown_connections 2023-05-21T16:55:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f68f00662f0 0x7f68f00687a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6904145750 0x7f69041f5aa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6904145380 0x7f69040b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 --2- 172.21.15.46:0/3203525858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69040c40c0 0x7f69040b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 >> 172.21.15.46:0/3203525858 conn(0x7f69040cfeb0 msgr2=0x7f690406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 shutdown_connections 2023-05-21T16:55:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.004+0000 7f6908b22700 1 -- 172.21.15.46:0/3203525858 wait complete. 2023-05-21T16:55:08.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:55:08.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 Processor -- start 2023-05-21T16:55:08.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 -- start start 2023-05-21T16:55:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e415e630 0x7f40e415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40e40709d0 0x7f40e415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e406db30 con 0x7f40e40ccf10 2023-05-21T16:55:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40cd4a0 con 0x7f40e40709d0 2023-05-21T16:55:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40eb043700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40cb2d0 con 0x7f40e415e630 2023-05-21T16:55:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.124+0000 7f40e9840700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f40e40ccf10 0x7f40e40702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60464/0 (socket says 172.21.15.46:60464) 2023-05-21T16:55:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40e9840700 1 -- 172.21.15.46:0/3931240390 learned_addr learned my addr 172.21.15.46:0/3931240390 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea041700 1 --2- 172.21.15.46:0/3931240390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e415e630 0x7f40e415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea842700 1 --2- 172.21.15.46:0/3931240390 >> v2:172.21.15.142:3300/0 conn(0x7f40e40709d0 0x7f40e415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40e903f700 1 -- 172.21.15.46:0/3931240390 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36724074 0 0) 0x7f40e406db30 con 0x7f40e40ccf10 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40e903f700 1 -- 172.21.15.46:0/3931240390 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d00035d0 con 0x7f40e40ccf10 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea041700 1 -- 172.21.15.46:0/3931240390 >> v2:172.21.15.142:3300/0 conn(0x7f40e40709d0 msgr2=0x7f40e415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea041700 1 --2- 172.21.15.46:0/3931240390 >> v2:172.21.15.142:3300/0 conn(0x7f40e40709d0 0x7f40e415ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea041700 1 -- 172.21.15.46:0/3931240390 >> v1:172.21.15.46:6789/0 conn(0x7f40e40ccf10 legacy=0x7f40e40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea041700 1 -- 172.21.15.46:0/3931240390 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40cb5b0 con 0x7f40e415e630 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40ea041700 1 --2- 172.21.15.46:0/3931240390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e415e630 0x7f40e415ea00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009850 tx=0x7f40d4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2684abab06671b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40e903f700 1 -- 172.21.15.46:0/3931240390 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4011830 con 0x7f40e415e630 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40e903f700 1 -- 172.21.15.46:0/3931240390 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4011990 con 0x7f40e415e630 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40e903f700 1 -- 172.21.15.46:0/3931240390 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4011d40 con 0x7f40e415e630 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 -- 172.21.15.46:0/3931240390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e415e630 msgr2=0x7f40e415ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 --2- 172.21.15.46:0/3931240390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e415e630 0x7f40e415ea00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009850 tx=0x7f40d4009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 -- 172.21.15.46:0/3931240390 shutdown_connections 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 --2- 172.21.15.46:0/3931240390 >> v2:172.21.15.142:3300/0 conn(0x7f40e40709d0 0x7f40e415ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 --2- 172.21.15.46:0/3931240390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e415e630 0x7f40e415ea00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 -- 172.21.15.46:0/3931240390 >> 172.21.15.46:0/3931240390 conn(0x7f40e40cd6f0 msgr2=0x7f40e40cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 -- 172.21.15.46:0/3931240390 shutdown_connections 2023-05-21T16:55:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.128+0000 7f40eb043700 1 -- 172.21.15.46:0/3931240390 wait complete. 2023-05-21T16:55:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 Processor -- start 2023-05-21T16:55:08.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 -- start start 2023-05-21T16:55:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40e40709d0 0x7f40e40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40ccf10 0x7f40e40af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 0x7f40e415d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40af550 con 0x7f40e40709d0 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c93e0 con 0x7f40e415e630 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c96c0 con 0x7f40e40ccf10 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 0x7f40e415d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40e9840700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40ccf10 0x7f40e40af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 0x7f40e415d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:52518/0 (socket says 172.21.15.46:52518) 2023-05-21T16:55:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea041700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40e40709d0 0x7f40e40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 -- 172.21.15.46:0/2626030677 learned_addr learned my addr 172.21.15.46:0/2626030677 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 -- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40ccf10 msgr2=0x7f40e40af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40ccf10 0x7f40e40af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 -- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40e40709d0 msgr2=0x7f40e40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40e40709d0 0x7f40e40c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 -- 172.21.15.46:0/2626030677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40094b0 con 0x7f40e415e630 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40ea842700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 0x7f40e415d760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00efc0 tx=0x7f40dc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc009ea0 con 0x7f40e415e630 2023-05-21T16:55:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00f040 con 0x7f40e415e630 2023-05-21T16:55:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc014480 con 0x7f40e415e630 2023-05-21T16:55:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40d0930 con 0x7f40e415e630 2023-05-21T16:55:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.132+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40cb890 con 0x7f40e415e630 2023-05-21T16:55:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.136+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40b5ae0 con 0x7f40e415e630 2023-05-21T16:55:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.136+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40dc0145e0 con 0x7f40e415e630 2023-05-21T16:55:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.136+0000 7f40daffd700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40c80662f0 0x7f40c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.136+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f40dc084880 con 0x7f40e415e630 2023-05-21T16:55:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.136+0000 7f40ea041700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40c80662f0 0x7f40c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.140+0000 7f40ea041700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40c80662f0 0x7f40c80687a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f40d40090b0 tx=0x7f40d401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.148+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f40dc051cc0 con 0x7f40e415e630 2023-05-21T16:55:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.348+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e40733b0 con 0x7f40e415e630 2023-05-21T16:55:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.348+0000 7f40daffd700 1 -- 172.21.15.46:0/2626030677 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f40dc018090 con 0x7f40e415e630 2023-05-21T16:55:08.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:08.353 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:55:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40c80662f0 msgr2=0x7f40c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40c80662f0 0x7f40c80687a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f40d40090b0 tx=0x7f40d401c040 comp rx=0 tx=0).stop 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 msgr2=0x7f40e415d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 0x7f40e415d760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00efc0 tx=0x7f40dc00c3a0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 shutdown_connections 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f40c80662f0 0x7f40c80687a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40e415e630 0x7f40e415d760 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40e40ccf10 0x7f40e40af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 --2- 172.21.15.46:0/2626030677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40e40709d0 0x7f40e40c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 >> 172.21.15.46:0/2626030677 conn(0x7f40e40cd6f0 msgr2=0x7f40e415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 shutdown_connections 2023-05-21T16:55:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.352+0000 7f40eb043700 1 -- 172.21.15.46:0/2626030677 wait complete. 2023-05-21T16:55:08.356 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:55:08.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:08.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 Processor -- start 2023-05-21T16:55:08.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 -- start start 2023-05-21T16:55:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ef8158d90 0x7f7ef815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef80ccec0 0x7f7ef8070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef8159df0 con 0x7f7ef8070ad0 2023-05-21T16:55:08.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef8070f50 con 0x7f7ef8158d90 2023-05-21T16:55:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef815a280 con 0x7f7ef80ccec0 2023-05-21T16:55:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef77fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7ef8070ad0 0x7f7ef80ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60470/0 (socket says 172.21.15.46:60470) 2023-05-21T16:55:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef77fe700 1 -- 172.21.15.46:0/2806223648 learned_addr learned my addr 172.21.15.46:0/2806223648 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef67fc700 1 --2- 172.21.15.46:0/2806223648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef80ccec0 0x7f7ef8070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef6ffd700 1 --2- 172.21.15.46:0/2806223648 >> v2:172.21.15.142:3300/0 conn(0x7f7ef8158d90 0x7f7ef815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef5ffb700 1 -- 172.21.15.46:0/2806223648 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463777370 0 0) 0x7f7ef8159df0 con 0x7f7ef8070ad0 2023-05-21T16:55:08.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef5ffb700 1 -- 172.21.15.46:0/2806223648 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee00035d0 con 0x7f7ef8070ad0 2023-05-21T16:55:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef67fc700 1 -- 172.21.15.46:0/2806223648 >> v2:172.21.15.142:3300/0 conn(0x7f7ef8158d90 msgr2=0x7f7ef815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef67fc700 1 --2- 172.21.15.46:0/2806223648 >> v2:172.21.15.142:3300/0 conn(0x7f7ef8158d90 0x7f7ef815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef67fc700 1 -- 172.21.15.46:0/2806223648 >> v1:172.21.15.46:6789/0 conn(0x7f7ef8070ad0 legacy=0x7f7ef80ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef67fc700 1 -- 172.21.15.46:0/2806223648 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80cd730 con 0x7f7ef80ccec0 2023-05-21T16:55:08.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef67fc700 1 --2- 172.21.15.46:0/2806223648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef80ccec0 0x7f7ef8070590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009d90 tx=0x7f7ee800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba2543afe06b6d01 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.484+0000 7f7ef5ffb700 1 -- 172.21.15.46:0/2806223648 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800e070 con 0x7f7ef80ccec0 2023-05-21T16:55:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef5ffb700 1 -- 172.21.15.46:0/2806223648 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee800bb20 con 0x7f7ef80ccec0 2023-05-21T16:55:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef5ffb700 1 -- 172.21.15.46:0/2806223648 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8012430 con 0x7f7ef80ccec0 2023-05-21T16:55:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- 172.21.15.46:0/2806223648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef80ccec0 msgr2=0x7f7ef8070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/2806223648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef80ccec0 0x7f7ef8070590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009d90 tx=0x7f7ee800b330 comp rx=0 tx=0).stop 2023-05-21T16:55:08.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- 172.21.15.46:0/2806223648 shutdown_connections 2023-05-21T16:55:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/2806223648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef80ccec0 0x7f7ef8070590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/2806223648 >> v2:172.21.15.142:3300/0 conn(0x7f7ef8158d90 0x7f7ef815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- 172.21.15.46:0/2806223648 >> 172.21.15.46:0/2806223648 conn(0x7f7ef80cf720 msgr2=0x7f7ef80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- 172.21.15.46:0/2806223648 shutdown_connections 2023-05-21T16:55:08.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- 172.21.15.46:0/2806223648 wait complete. 2023-05-21T16:55:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 Processor -- start 2023-05-21T16:55:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- start start 2023-05-21T16:55:08.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef8070ad0 0x7f7ef80c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 0x7f7ef814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef8158d90 0x7f7ef80c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef814d9f0 con 0x7f7ef80ccec0 2023-05-21T16:55:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80c3c60 con 0x7f7ef8070ad0 2023-05-21T16:55:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.488+0000 7f7ef7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80c3f40 con 0x7f7ef8158d90 2023-05-21T16:55:08.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 0x7f7ef814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 0x7f7ef814d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53284/0 (socket says 172.21.15.46:53284) 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 -- 172.21.15.46:0/1451570586 learned_addr learned my addr 172.21.15.46:0/1451570586 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef6ffd700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef8070ad0 0x7f7ef80c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef77fe700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef8158d90 0x7f7ef80c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 -- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef8158d90 msgr2=0x7f7ef80c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef8158d90 0x7f7ef80c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 -- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef8070ad0 msgr2=0x7f7ef80c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef8070ad0 0x7f7ef80c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 -- 172.21.15.46:0/1451570586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8009a70 con 0x7f7ef80ccec0 2023-05-21T16:55:08.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef67fc700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 0x7f7ef814d4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8014040 tx=0x7f7ee8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8012430 con 0x7f7ef80ccec0 2023-05-21T16:55:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8020070 con 0x7f7ef80ccec0 2023-05-21T16:55:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef81597a0 con 0x7f7ef80ccec0 2023-05-21T16:55:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8004280 con 0x7f7ef80ccec0 2023-05-21T16:55:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef81594c0 con 0x7f7ef80ccec0 2023-05-21T16:55:08.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.492+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ee80043e0 con 0x7f7ef80ccec0 2023-05-21T16:55:08.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.496+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef8159a80 con 0x7f7ef80ccec0 2023-05-21T16:55:08.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.496+0000 7f7edf7fe700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ee40662f0 0x7f7ee40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.496+0000 7f7ef6ffd700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ee40662f0 0x7f7ee40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.496+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ee8022070 con 0x7f7ef80ccec0 2023-05-21T16:55:08.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.496+0000 7f7ef6ffd700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ee40662f0 0x7f7ee40687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009b50 tx=0x7f7eec009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.504+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7ee8053100 con 0x7f7ef80ccec0 2023-05-21T16:55:08.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.668+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ef80ce1a0 con 0x7f7ef80ccec0 2023-05-21T16:55:08.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.672+0000 7f7edf7fe700 1 -- 172.21.15.46:0/1451570586 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7f7ee8056720 con 0x7f7ef80ccec0 2023-05-21T16:55:08.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:08.675 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:00.755376+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ee40662f0 msgr2=0x7f7ee40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ee40662f0 0x7f7ee40687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009b50 tx=0x7f7eec009240 comp rx=0 tx=0).stop 2023-05-21T16:55:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 msgr2=0x7f7ef814d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 0x7f7ef814d4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8014040 tx=0x7f7ee8004af0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 shutdown_connections 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7ee40662f0 0x7f7ee40687a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ef8158d90 0x7f7ef80c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ef80ccec0 0x7f7ef814d4b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 --2- 172.21.15.46:0/1451570586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef8070ad0 0x7f7ef80c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 >> 172.21.15.46:0/1451570586 conn(0x7f7ef80cf720 msgr2=0x7f7ef80ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 shutdown_connections 2023-05-21T16:55:08.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.676+0000 7f7ef7fff700 1 -- 172.21.15.46:0/1451570586 wait complete. 2023-05-21T16:55:08.690 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-21T16:55:08.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:55:08.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.804+0000 7fd6f4b55700 1 Processor -- start 2023-05-21T16:55:08.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.804+0000 7fd6f4b55700 1 -- start start 2023-05-21T16:55:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.804+0000 7fd6f4b55700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6f015ccd0 0x7fd6f00aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.804+0000 7fd6f4b55700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00ccb70 con 0x7fd6f00affa0 2023-05-21T16:55:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.804+0000 7fd6f4b55700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f006d370 con 0x7fd6f00af1a0 2023-05-21T16:55:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.804+0000 7fd6f4b55700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00d07a0 con 0x7fd6f015ccd0 2023-05-21T16:55:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6eed9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd6f00affa0 0x7fd6f00ce430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60484/0 (socket says 172.21.15.46:60484) 2023-05-21T16:55:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6eed9d700 1 -- 172.21.15.46:0/2609039494 learned_addr learned my addr 172.21.15.46:0/2609039494 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:08.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/2609039494 >> v2:172.21.15.142:3300/0 conn(0x7fd6f015ccd0 0x7fd6f00aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330545268 0 0) 0x7fd6f00ccb70 con 0x7fd6f00affa0 2023-05-21T16:55:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80035d0 con 0x7fd6f00affa0 2023-05-21T16:55:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4002270661 0 0) 0x7fd6d80035d0 con 0x7fd6f00affa0 2023-05-21T16:55:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 >> v2:172.21.15.142:3300/0 conn(0x7fd6f015ccd0 msgr2=0x7fd6f00aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 --2- 172.21.15.46:0/2609039494 >> v2:172.21.15.142:3300/0 conn(0x7fd6f015ccd0 0x7fd6f00aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 >> v1:172.21.15.142:6789/0 conn(0x7fd6f00af1a0 legacy=0x7fd6f00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00d0a80 con 0x7fd6f00affa0 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7fd6e80019f0 con 0x7fd6f00affa0 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 >> v1:172.21.15.46:6789/0 conn(0x7fd6f00affa0 legacy=0x7fd6f00ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6d8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6d8004870 0x7fd6d8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6d8005220 0x7fd6d800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00d07a0 con 0x7fd6d8003a20 2023-05-21T16:55:08.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d800c1b0 con 0x7fd6d8005220 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d800c370 con 0x7fd6d8004870 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/2609039494 >> v2:172.21.15.142:3300/0 conn(0x7fd6f015ccd0 0x7fd6f00aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6eed9d700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6d8005220 0x7fd6d800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6edd9b700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6d8004870 0x7fd6d8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6d8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 -- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6d8004870 msgr2=0x7fd6d8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6d8004870 0x7fd6d8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 -- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6d8005220 msgr2=0x7fd6d800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6d8005220 0x7fd6d800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 -- 172.21.15.46:0/2609039494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80035d0 con 0x7fd6d8003a20 2023-05-21T16:55:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6eed9d700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6d8005220 0x7fd6d800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6eed9d700 1 -- 172.21.15.46:0/2609039494 reap_dead start 2023-05-21T16:55:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6d8003df0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009cf0 tx=0x7fd6d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a8452686070c99 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4004030 con 0x7fd6d8003a20 2023-05-21T16:55:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4004190 con 0x7fd6d8003a20 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6ed59a700 1 -- 172.21.15.46:0/2609039494 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4004500 con 0x7fd6d8003a20 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6f4b55700 1 -- 172.21.15.46:0/2609039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 msgr2=0x7fd6d8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.808+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6d8003df0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009cf0 tx=0x7fd6d80058a0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 -- 172.21.15.46:0/2609039494 shutdown_connections 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/2609039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6d8003df0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 -- 172.21.15.46:0/2609039494 >> 172.21.15.46:0/2609039494 conn(0x7fd6f00b2d30 msgr2=0x7fd6f00b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 -- 172.21.15.46:0/2609039494 shutdown_connections 2023-05-21T16:55:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 -- 172.21.15.46:0/2609039494 wait complete. 2023-05-21T16:55:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 Processor -- start 2023-05-21T16:55:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.812+0000 7fd6f4b55700 1 -- start start 2023-05-21T16:55:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6f00cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f0152ee0 0x7fd6f0152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f01e76b0 0x7fd6f01e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00d0410 con 0x7fd6d8003a20 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01e8060 con 0x7fd6f0152ee0 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0152ca0 con 0x7fd6f01e76b0 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6f00cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6f00cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53304/0 (socket says 172.21.15.46:53304) 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 -- 172.21.15.46:0/4187173353 learned_addr learned my addr 172.21.15.46:0/4187173353 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6eed9d700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f01e76b0 0x7fd6f01e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6edd9b700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f0152ee0 0x7fd6f0152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 -- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f01e76b0 msgr2=0x7fd6f01e7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f01e76b0 0x7fd6f01e7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 -- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f0152ee0 msgr2=0x7fd6f0152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f0152ee0 0x7fd6f0152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 -- 172.21.15.46:0/4187173353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f015d0a0 con 0x7fd6d8003a20 2023-05-21T16:55:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6ee59c700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6f00cfed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400fc70 tx=0x7fd6e40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4004030 con 0x7fd6d8003a20 2023-05-21T16:55:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40036c0 con 0x7fd6d8003a20 2023-05-21T16:55:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f00cc800 con 0x7fd6d8003a20 2023-05-21T16:55:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4003a50 con 0x7fd6d8003a20 2023-05-21T16:55:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f00b0c90 con 0x7fd6d8003a20 2023-05-21T16:55:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f0073cb0 con 0x7fd6d8003a20 2023-05-21T16:55:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.816+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6e4003bb0 con 0x7fd6d8003a20 2023-05-21T16:55:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.820+0000 7fd6deffd700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd6d00662f0 0x7fd6d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.820+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd6e4084ec0 con 0x7fd6d8003a20 2023-05-21T16:55:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.820+0000 7fd6edd9b700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd6d00662f0 0x7fd6d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.820+0000 7fd6edd9b700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd6d00662f0 0x7fd6d00687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00b35a0 tx=0x7fd6e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:08.828+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd6e4052390 con 0x7fd6d8003a20 2023-05-21T16:55:09.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.028+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f00ce6d0 con 0x7fd6d8003a20 2023-05-21T16:55:09.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.028+0000 7fd6deffd700 1 -- 172.21.15.46:0/4187173353 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fd6e4029020 con 0x7fd6d8003a20 2023-05-21T16:55:09.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:09.030 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:55:09.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.028+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd6d00662f0 msgr2=0x7fd6d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.028+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd6d00662f0 0x7fd6d00687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00b35a0 tx=0x7fd6e0009040 comp rx=0 tx=0).stop 2023-05-21T16:55:09.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.028+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 msgr2=0x7fd6f00cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.028+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6f00cfed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400fc70 tx=0x7fd6e40047e0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 shutdown_connections 2023-05-21T16:55:09.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd6d00662f0 0x7fd6d00687a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6f01e76b0 0x7fd6f01e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6f0152ee0 0x7fd6f0152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 --2- 172.21.15.46:0/4187173353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6d8003a20 0x7fd6f00cfed0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 >> 172.21.15.46:0/4187173353 conn(0x7fd6f00b2d30 msgr2=0x7fd6f00acb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:09.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 shutdown_connections 2023-05-21T16:55:09.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.032+0000 7fd6f4b55700 1 -- 172.21.15.46:0/4187173353 wait complete. 2023-05-21T16:55:09.034 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:55:09.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:55:09.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 Processor -- start 2023-05-21T16:55:09.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- start start 2023-05-21T16:55:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb4c0e12a0 0x7fcb4c037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c0e0af0 con 0x7fcb4c0e1670 2023-05-21T16:55:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c050f00 con 0x7fcb4c036770 2023-05-21T16:55:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c0e45f0 con 0x7fcb4c0e12a0 2023-05-21T16:55:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb51d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcb4c0e1670 0x7fcb4c0e4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60492/0 (socket says 172.21.15.46:60492) 2023-05-21T16:55:09.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb51d9b700 1 -- 172.21.15.46:0/1162997977 learned_addr learned my addr 172.21.15.46:0/1162997977 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5259c700 1 --2- 172.21.15.46:0/1162997977 >> v2:172.21.15.46:3300/0 conn(0x7fcb4c0e12a0 0x7fcb4c037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5159a700 1 -- 172.21.15.46:0/1162997977 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195523268 0 0) 0x7fcb44001110 con 0x7fcb4c0e1670 2023-05-21T16:55:09.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5159a700 1 -- 172.21.15.46:0/1162997977 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb400035d0 con 0x7fcb4c0e1670 2023-05-21T16:55:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5259c700 1 -- 172.21.15.46:0/1162997977 >> v1:172.21.15.142:6789/0 conn(0x7fcb4c036770 legacy=0x7fcb4c04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5159a700 1 -- 172.21.15.46:0/1162997977 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587745825 0 0) 0x7fcb4c050f00 con 0x7fcb4c036770 2023-05-21T16:55:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5259c700 1 -- 172.21.15.46:0/1162997977 >> v1:172.21.15.46:6789/0 conn(0x7fcb4c0e1670 legacy=0x7fcb4c0e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5259c700 1 -- 172.21.15.46:0/1162997977 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c051150 con 0x7fcb4c0e12a0 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5259c700 1 --2- 172.21.15.46:0/1162997977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c037b40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009850 tx=0x7fcb3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118b32cc4d3ba843 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5159a700 1 -- 172.21.15.46:0/1162997977 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44001800 con 0x7fcb4c0e12a0 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5159a700 1 -- 172.21.15.46:0/1162997977 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c010590 con 0x7fcb4c0e12a0 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5159a700 1 -- 172.21.15.46:0/1162997977 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c010940 con 0x7fcb4c0e12a0 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- 172.21.15.46:0/1162997977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c0e12a0 msgr2=0x7fcb4c037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 --2- 172.21.15.46:0/1162997977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c037b40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009850 tx=0x7fcb3c009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- 172.21.15.46:0/1162997977 shutdown_connections 2023-05-21T16:55:09.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 --2- 172.21.15.46:0/1162997977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c037b40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- 172.21.15.46:0/1162997977 >> 172.21.15.46:0/1162997977 conn(0x7fcb4c051770 msgr2=0x7fcb4c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:09.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- 172.21.15.46:0/1162997977 shutdown_connections 2023-05-21T16:55:09.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.160+0000 7fcb5359e700 1 -- 172.21.15.46:0/1162997977 wait complete. 2023-05-21T16:55:09.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.164+0000 7fcb5359e700 1 Processor -- start 2023-05-21T16:55:09.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.164+0000 7fcb5359e700 1 -- start start 2023-05-21T16:55:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.164+0000 7fcb5359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 0x7fcb4c0d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c053910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb4c0e1670 0x7fcb4c053e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0d7250 con 0x7fcb4c036770 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0342f0 con 0x7fcb4c0e12a0 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0345d0 con 0x7fcb4c0e1670 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 0x7fcb4c0d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 0x7fcb4c0d6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53330/0 (socket says 172.21.15.46:53330) 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 -- 172.21.15.46:0/269784283 learned_addr learned my addr 172.21.15.46:0/269784283 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb51d9b700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c053910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb52d9d700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb4c0e1670 0x7fcb4c053e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 -- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb4c0e1670 msgr2=0x7fcb4c053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb4c0e1670 0x7fcb4c053e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 -- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4c0e12a0 msgr2=0x7fcb4c053910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c053910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 -- 172.21.15.46:0/269784283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0094b0 con 0x7fcb4c036770 2023-05-21T16:55:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5259c700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 0x7fcb4c0d6d10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c000c00 tx=0x7fcb3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c004590 con 0x7fcb4c036770 2023-05-21T16:55:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0036c0 con 0x7fcb4c036770 2023-05-21T16:55:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0e4210 con 0x7fcb4c036770 2023-05-21T16:55:09.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c003a70 con 0x7fcb4c036770 2023-05-21T16:55:09.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c051430 con 0x7fcb4c036770 2023-05-21T16:55:09.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.168+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c0e5120 con 0x7fcb4c036770 2023-05-21T16:55:09.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.172+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb3c003bd0 con 0x7fcb4c036770 2023-05-21T16:55:09.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.172+0000 7fcb4affd700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcb340662f0 0x7fcb340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.172+0000 7fcb51d9b700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcb340662f0 0x7fcb340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.172+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcb3c085220 con 0x7fcb4c036770 2023-05-21T16:55:09.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.172+0000 7fcb51d9b700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcb340662f0 0x7fcb340687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c037030 tx=0x7fcb440012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.180+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcb3c0526f0 con 0x7fcb4c036770 2023-05-21T16:55:09.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.372+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb4c005570 con 0x7fcb4c036770 2023-05-21T16:55:09.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.376+0000 7fcb4affd700 1 -- 172.21.15.46:0/269784283 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fcb3c055d10 con 0x7fcb4c036770 2023-05-21T16:55:09.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:09.377 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3712792663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3712792663},{"type":"v1","addr":"172.21.15.142:6833","nonce":3712792663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2887349401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2887349401},{"type":"v1","addr":"172.21.15.142:6835","nonce":2887349401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/496235482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":496235482},{"type":"v1","addr":"172.21.15.46:6835","nonce":496235482}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:54:18.140172+0000","modified":"2023-05-21T16:54:20.777200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/364820067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":364820067},{"type":"v1","addr":"172.21.15.46:6837","nonce":364820067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-21T16:55:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcb340662f0 msgr2=0x7fcb340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcb340662f0 0x7fcb340687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c037030 tx=0x7fcb440012b0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 msgr2=0x7fcb4c0d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 0x7fcb4c0d6d10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c000c00 tx=0x7fcb3c004770 comp rx=0 tx=0).stop 2023-05-21T16:55:09.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 shutdown_connections 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcb340662f0 0x7fcb340687a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb4c0e1670 0x7fcb4c053e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4c0e12a0 0x7fcb4c053910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 --2- 172.21.15.46:0/269784283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb4c036770 0x7fcb4c0d6d10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 >> 172.21.15.46:0/269784283 conn(0x7fcb4c051770 msgr2=0x7fcb4c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 shutdown_connections 2023-05-21T16:55:09.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.380+0000 7fcb5359e700 1 -- 172.21.15.46:0/269784283 wait complete. 2023-05-21T16:55:09.383 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-05-21T16:55:09.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:09.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 Processor -- start 2023-05-21T16:55:09.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- start start 2023-05-21T16:55:09.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7c4160be0 0x7fc7c41651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7c406a420 0x7fc7c40c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40ade30 con 0x7fc7c4069f80 2023-05-21T16:55:09.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40cd210 con 0x7fc7c406a420 2023-05-21T16:55:09.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40cc970 con 0x7fc7c4160be0 2023-05-21T16:55:09.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c3fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7c406a420 0x7fc7c40c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c2ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc7c4069f80 0x7fc7c4070c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60504/0 (socket says 172.21.15.46:60504) 2023-05-21T16:55:09.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c2ffd700 1 -- 172.21.15.46:0/2785552391 learned_addr learned my addr 172.21.15.46:0/2785552391 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c37fe700 1 --2- 172.21.15.46:0/2785552391 >> v2:172.21.15.142:3300/0 conn(0x7fc7c4160be0 0x7fc7c41651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c3fff700 1 -- 172.21.15.46:0/2785552391 >> v2:172.21.15.142:3300/0 conn(0x7fc7c4160be0 msgr2=0x7fc7c41651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c3fff700 1 --2- 172.21.15.46:0/2785552391 >> v2:172.21.15.142:3300/0 conn(0x7fc7c4160be0 0x7fc7c41651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c3fff700 1 -- 172.21.15.46:0/2785552391 >> v1:172.21.15.46:6789/0 conn(0x7fc7c4069f80 legacy=0x7fc7c4070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c27fc700 1 -- 172.21.15.46:0/2785552391 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287429306 0 0) 0x7fc7c40ade30 con 0x7fc7c4069f80 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c3fff700 1 -- 172.21.15.46:0/2785552391 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40ccc50 con 0x7fc7c406a420 2023-05-21T16:55:09.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c3fff700 1 --2- 172.21.15.46:0/2785552391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406a420 0x7fc7c40c18a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7c406c460 tx=0x7fc7bc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548df661961e7a03 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c27fc700 1 -- 172.21.15.46:0/2785552391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc011830 con 0x7fc7c406a420 2023-05-21T16:55:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c27fc700 1 -- 172.21.15.46:0/2785552391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc011990 con 0x7fc7c406a420 2023-05-21T16:55:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c27fc700 1 -- 172.21.15.46:0/2785552391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc011d40 con 0x7fc7c406a420 2023-05-21T16:55:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/2785552391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406a420 msgr2=0x7fc7c40c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/2785552391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406a420 0x7fc7c40c18a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7c406c460 tx=0x7fc7bc009b30 comp rx=0 tx=0).stop 2023-05-21T16:55:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/2785552391 shutdown_connections 2023-05-21T16:55:09.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/2785552391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406a420 0x7fc7c40c18a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/2785552391 >> v2:172.21.15.142:3300/0 conn(0x7fc7c4160be0 0x7fc7c41651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/2785552391 >> 172.21.15.46:0/2785552391 conn(0x7fc7c40cf720 msgr2=0x7fc7c40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/2785552391 shutdown_connections 2023-05-21T16:55:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.512+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/2785552391 wait complete. 2023-05-21T16:55:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 Processor -- start 2023-05-21T16:55:09.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 -- start start 2023-05-21T16:55:09.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 0x7fc7c415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c406a420 0x7fc7c4163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c4160be0 0x7fc7c41636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c415eb20 con 0x7fc7c4069f80 2023-05-21T16:55:09.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c2590 con 0x7fc7c406a420 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c2870 con 0x7fc7c4160be0 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 0x7fc7c415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 0x7fc7c415e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53342/0 (socket says 172.21.15.46:53342) 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 -- 172.21.15.46:0/3347111703 learned_addr learned my addr 172.21.15.46:0/3347111703 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c3fff700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c4160be0 0x7fc7c41636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c2ffd700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c406a420 0x7fc7c4163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 -- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c4160be0 msgr2=0x7fc7c41636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c4160be0 0x7fc7c41636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 -- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c406a420 msgr2=0x7fc7c4163180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c406a420 0x7fc7c4163180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 -- 172.21.15.46:0/3347111703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc0094b0 con 0x7fc7c4069f80 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c3fff700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c4160be0 0x7fc7c41636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c37fe700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 0x7fc7c415e5e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800d800 tx=0x7fc7b800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80125f0 con 0x7fc7c4069f80 2023-05-21T16:55:09.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8012750 con 0x7fc7c4069f80 2023-05-21T16:55:09.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c4070730 con 0x7fc7c4069f80 2023-05-21T16:55:09.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8012ac0 con 0x7fc7c4069f80 2023-05-21T16:55:09.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.516+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c40ccf30 con 0x7fc7c4069f80 2023-05-21T16:55:09.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.520+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c4165700 con 0x7fc7c4069f80 2023-05-21T16:55:09.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.520+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7b8012c20 con 0x7fc7c4069f80 2023-05-21T16:55:09.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.520+0000 7fc7abfff700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7b00662f0 0x7fc7b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.520+0000 7fc7c2ffd700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7b00662f0 0x7fc7b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.520+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc7b8084200 con 0x7fc7c4069f80 2023-05-21T16:55:09.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.520+0000 7fc7c2ffd700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7b00662f0 0x7fc7b00687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40012e0 tx=0x7fc7b4001970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.528+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7b8055030 con 0x7fc7c4069f80 2023-05-21T16:55:09.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.692+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7c40733b0 con 0x7fc7c4069f80 2023-05-21T16:55:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7abfff700 1 -- 172.21.15.46:0/3347111703 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18374 (secure 0 0 0) 0x7fc7b8012ed0 con 0x7fc7c4069f80 2023-05-21T16:55:09.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:09.698 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:00.755376+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:54:16.591016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-21T16:54:17.138805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7b00662f0 msgr2=0x7fc7b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7b00662f0 0x7fc7b00687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40012e0 tx=0x7fc7b4001970 comp rx=0 tx=0).stop 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 msgr2=0x7fc7c415e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 0x7fc7c415e5e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800d800 tx=0x7fc7b800dbc0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 shutdown_connections 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc7b00662f0 0x7fc7b00687a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c4160be0 0x7fc7c41636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c406a420 0x7fc7c4163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 --2- 172.21.15.46:0/3347111703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c4069f80 0x7fc7c415e5e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 >> 172.21.15.46:0/3347111703 conn(0x7fc7c40cf720 msgr2=0x7fc7c40ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:09.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 shutdown_connections 2023-05-21T16:55:09.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.696+0000 7fc7c8fd9700 1 -- 172.21.15.46:0/3347111703 wait complete. 2023-05-21T16:55:09.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-21T16:55:09.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa27d16f700 1 Processor -- start 2023-05-21T16:55:09.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa27d16f700 1 -- start start 2023-05-21T16:55:09.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa27d16f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa27d16f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780b3980 con 0x7fa278159470 2023-05-21T16:55:09.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa27d16f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780b3c60 con 0x7fa2780cff30 2023-05-21T16:55:09.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa27d16f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780b3f40 con 0x7fa2780cd5d0 2023-05-21T16:55:09.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa277fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa278159470 0x7fa2780ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60518/0 (socket says 172.21.15.46:60518) 2023-05-21T16:55:09.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa277fff700 1 -- 172.21.15.46:0/3106492498 learned_addr learned my addr 172.21.15.46:0/3106492498 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:09.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa2777fe700 1 --2- 172.21.15.46:0/3106492498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa276ffd700 1 -- 172.21.15.46:0/3106492498 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802404237 0 0) 0x7fa2780b3980 con 0x7fa278159470 2023-05-21T16:55:09.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa276ffd700 1 -- 172.21.15.46:0/3106492498 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2600035d0 con 0x7fa278159470 2023-05-21T16:55:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa2777fe700 1 -- 172.21.15.46:0/3106492498 >> v1:172.21.15.142:6789/0 conn(0x7fa2780cff30 legacy=0x7fa27806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa276ffd700 1 -- 172.21.15.46:0/3106492498 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809511006 0 0) 0x7fa2600035d0 con 0x7fa278159470 2023-05-21T16:55:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa2777fe700 1 -- 172.21.15.46:0/3106492498 >> v1:172.21.15.46:6789/0 conn(0x7fa278159470 legacy=0x7fa2780ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.828+0000 7fa2777fe700 1 -- 172.21.15.46:0/3106492498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27806d120 con 0x7fa2780cd5d0 2023-05-21T16:55:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa2777fe700 1 --2- 172.21.15.46:0/3106492498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806d640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009880 tx=0x7fa26c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4959ce6ba897ff69 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa276ffd700 1 -- 172.21.15.46:0/3106492498 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268001670 con 0x7fa2780cd5d0 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa276ffd700 1 -- 172.21.15.46:0/3106492498 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c010590 con 0x7fa2780cd5d0 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa276ffd700 1 -- 172.21.15.46:0/3106492498 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c010940 con 0x7fa2780cd5d0 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 -- 172.21.15.46:0/3106492498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 msgr2=0x7fa27806d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 --2- 172.21.15.46:0/3106492498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806d640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009880 tx=0x7fa26c009b90 comp rx=0 tx=0).stop 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 -- 172.21.15.46:0/3106492498 shutdown_connections 2023-05-21T16:55:09.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 --2- 172.21.15.46:0/3106492498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806d640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 -- 172.21.15.46:0/3106492498 >> 172.21.15.46:0/3106492498 conn(0x7fa2780cca00 msgr2=0x7fa2780cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:09.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 -- 172.21.15.46:0/3106492498 shutdown_connections 2023-05-21T16:55:09.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 -- 172.21.15.46:0/3106492498 wait complete. 2023-05-21T16:55:09.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 Processor -- start 2023-05-21T16:55:09.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.832+0000 7fa27d16f700 1 -- start start 2023-05-21T16:55:09.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2780cff30 0x7fa2781efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 0x7fa27806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806c230 con 0x7fa278159470 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806b6b0 con 0x7fa2780cff30 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806b990 con 0x7fa2780cd5d0 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 0x7fa27806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa277fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 0x7fa27806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53356/0 (socket says 172.21.15.46:53356) 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 -- 172.21.15.46:0/1594178677 learned_addr learned my addr 172.21.15.46:0/1594178677 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:09.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa2777fe700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2780cff30 0x7fa2781efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 -- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 msgr2=0x7fa27806ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 -- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2780cff30 msgr2=0x7fa2781efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2780cff30 0x7fa2781efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 -- 172.21.15.46:0/1594178677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c0094b0 con 0x7fa278159470 2023-05-21T16:55:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27c96e700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 0x7fa27806d9b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa270001fd0 tx=0x7fa27000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270003e50 con 0x7fa278159470 2023-05-21T16:55:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000a8c0 con 0x7fa278159470 2023-05-21T16:55:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780b35d0 con 0x7fa278159470 2023-05-21T16:55:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000ac70 con 0x7fa278159470 2023-05-21T16:55:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa278159840 con 0x7fa278159470 2023-05-21T16:55:09.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780b26f0 con 0x7fa278159470 2023-05-21T16:55:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.836+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa270005070 con 0x7fa278159470 2023-05-21T16:55:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.840+0000 7fa274ff9700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa2640662f0 0x7fa2640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.840+0000 7fa277fff700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa2640662f0 0x7fa2640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.840+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa270083e40 con 0x7fa278159470 2023-05-21T16:55:09.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.840+0000 7fa277fff700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa2640662f0 0x7fa2640687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2680017a0 tx=0x7fa268001730 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:09.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:09.848+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa270051270 con 0x7fa278159470 2023-05-21T16:55:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.048+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa278067ac0 con 0x7fa278159470 2023-05-21T16:55:10.823 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-21T16:55:10.820+0000 7f08d3fe6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-21T16:55:10.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.840+0000 7fa274ff9700 1 -- 172.21.15.46:0/1594178677 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa270054890 con 0x7fa278159470 2023-05-21T16:55:10.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa2640662f0 msgr2=0x7fa2640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:10.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa2640662f0 0x7fa2640687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2680017a0 tx=0x7fa268001730 comp rx=0 tx=0).stop 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 msgr2=0x7fa27806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 0x7fa27806d9b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa270001fd0 tx=0x7fa27000a340 comp rx=0 tx=0).stop 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 shutdown_connections 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa2640662f0 0x7fa2640687a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa278159470 0x7fa27806d9b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2780cff30 0x7fa2781efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 --2- 172.21.15.46:0/1594178677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2780cd5d0 0x7fa27806ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 >> 172.21.15.46:0/1594178677 conn(0x7fa2780cca00 msgr2=0x7fa2780af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 shutdown_connections 2023-05-21T16:55:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.844+0000 7fa27d16f700 1 -- 172.21.15.46:0/1594178677 wait complete. 2023-05-21T16:55:10.847 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-21T16:55:10.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-21T16:55:10.880 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-05-21T16:55:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 Processor -- start 2023-05-21T16:55:10.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 -- start start 2023-05-21T16:55:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcc3c0ccda0 0x7fcc3c160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc3c160a60 0x7fcc3c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c0af130 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c1610c0 con 0x7fcc3c160a60 2023-05-21T16:55:10.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c0ce340 con 0x7fcc3c0ccda0 2023-05-21T16:55:10.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc3c160a60 0x7fcc3c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:10.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc3c160a60 0x7fcc3c0ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53370/0 (socket says 172.21.15.46:53370) 2023-05-21T16:55:10.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 -- 172.21.15.46:0/3591741962 learned_addr learned my addr 172.21.15.46:0/3591741962 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:10.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3a7fc700 1 --2- 172.21.15.46:0/3591741962 >> v2:172.21.15.142:3300/0 conn(0x7fcc3c0ccda0 0x7fcc3c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 -- 172.21.15.46:0/3591741962 >> v2:172.21.15.142:3300/0 conn(0x7fcc3c0ccda0 msgr2=0x7fcc3c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 --2- 172.21.15.46:0/3591741962 >> v2:172.21.15.142:3300/0 conn(0x7fcc3c0ccda0 0x7fcc3c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 -- 172.21.15.46:0/3591741962 >> v1:172.21.15.142:6789/0 conn(0x7fcc3c0cc9d0 legacy=0x7fcc3c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 -- 172.21.15.46:0/3591741962 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0ce620 con 0x7fcc3c160a60 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3a7fc700 1 --2- 172.21.15.46:0/3591741962 >> v2:172.21.15.142:3300/0 conn(0x7fcc3c0ccda0 0x7fcc3c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.976+0000 7fcc3b7fe700 1 --2- 172.21.15.46:0/3591741962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0ca8e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c160480 tx=0x7fcc3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef5de3043c67386 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:10.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc39ffb700 1 -- 172.21.15.46:0/3591741962 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400e070 con 0x7fcc3c160a60 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc39ffb700 1 -- 172.21.15.46:0/3591741962 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3400b9c0 con 0x7fcc3c160a60 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc39ffb700 1 -- 172.21.15.46:0/3591741962 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400bd70 con 0x7fcc3c160a60 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 -- 172.21.15.46:0/3591741962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c160a60 msgr2=0x7fcc3c0ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/3591741962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0ca8e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c160480 tx=0x7fcc3400b330 comp rx=0 tx=0).stop 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 -- 172.21.15.46:0/3591741962 shutdown_connections 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/3591741962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0ca8e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/3591741962 >> v2:172.21.15.142:3300/0 conn(0x7fcc3c0ccda0 0x7fcc3c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 -- 172.21.15.46:0/3591741962 >> 172.21.15.46:0/3591741962 conn(0x7fcc3c06d930 msgr2=0x7fcc3c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 -- 172.21.15.46:0/3591741962 shutdown_connections 2023-05-21T16:55:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 -- 172.21.15.46:0/3591741962 wait complete. 2023-05-21T16:55:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.980+0000 7fcc3bfff700 1 Processor -- start 2023-05-21T16:55:10.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 -- start start 2023-05-21T16:55:10.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 0x7fcc3c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc3c0ccda0 0x7fcc3c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c15a090 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b3140 con 0x7fcc3c160a60 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b3420 con 0x7fcc3c0ccda0 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 0x7fcc3c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:10.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 0x7fcc3c159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53378/0 (socket says 172.21.15.46:53378) 2023-05-21T16:55:10.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 -- 172.21.15.46:0/2419724986 learned_addr learned my addr 172.21.15.46:0/2419724986 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:10.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3b7fe700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:10.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3a7fc700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc3c0ccda0 0x7fcc3c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:10.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 -- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc3c0ccda0 msgr2=0x7fcc3c0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:10.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc3c0ccda0 0x7fcc3c0b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 -- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc3c160a60 msgr2=0x7fcc3c0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:10.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 -- 172.21.15.46:0/2419724986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34009b30 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3affd700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 0x7fcc3c159b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c500 tx=0x7fcc2c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0052d0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c005430 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c0cf530 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0055a0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.984+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c0ce900 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.988+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c1613a0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.988+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc2c0038e0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.988+0000 7fcc23fff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc280662f0 0x7fcc280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:10.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.988+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fcc2c0830b0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:10.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.988+0000 7fcc3a7fc700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc280662f0 0x7fcc280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:10.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.992+0000 7fcc3a7fc700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc280662f0 0x7fcc280687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0aec90 tx=0x7fcc30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:10.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:10.996+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcc2c050490 con 0x7fcc3c0cc9d0 2023-05-21T16:55:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.200+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcc3c073cb0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.840+0000 7fcc23fff700 1 -- 172.21.15.46:0/2419724986 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc2c053ab0 con 0x7fcc3c0cc9d0 2023-05-21T16:55:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc280662f0 msgr2=0x7fcc280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc280662f0 0x7fcc280687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0aec90 tx=0x7fcc30008040 comp rx=0 tx=0).stop 2023-05-21T16:55:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 msgr2=0x7fcc3c159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 0x7fcc3c159b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c500 tx=0x7fcc2c00c810 comp rx=0 tx=0).stop 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 shutdown_connections 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcc280662f0 0x7fcc280687a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc3c160a60 0x7fcc3c0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc3c0ccda0 0x7fcc3c0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 --2- 172.21.15.46:0/2419724986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc3c0cc9d0 0x7fcc3c159b50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 >> 172.21.15.46:0/2419724986 conn(0x7fcc3c06d930 msgr2=0x7fcc3c15c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 shutdown_connections 2023-05-21T16:55:11.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:11.844+0000 7fcc3bfff700 1 -- 172.21.15.46:0/2419724986 wait complete. 2023-05-21T16:55:11.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-21T16:55:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.036+0000 7f0a18d49700 1 Processor -- start 2023-05-21T16:55:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.036+0000 7f0a18d49700 1 -- start start 2023-05-21T16:55:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a1406d340 0x7f0a14167830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1415cde0 con 0x7f0a140b34a0 2023-05-21T16:55:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a14160cf0 con 0x7f0a1415ca10 2023-05-21T16:55:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a14160fd0 con 0x7f0a1406d340 2023-05-21T16:55:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a11d9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0a140b34a0 0x7f0a140cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60530/0 (socket says 172.21.15.46:60530) 2023-05-21T16:55:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a11d9b700 1 -- 172.21.15.46:0/2812320054 learned_addr learned my addr 172.21.15.46:0/2812320054 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a12d9d700 1 --2- 172.21.15.46:0/2812320054 >> v2:172.21.15.142:3300/0 conn(0x7f0a1406d340 0x7f0a14167830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a1159a700 1 -- 172.21.15.46:0/2812320054 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805903450 0 0) 0x7f0a04001110 con 0x7f0a140b34a0 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a1159a700 1 -- 172.21.15.46:0/2812320054 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09fc0035d0 con 0x7f0a140b34a0 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a12d9d700 1 -- 172.21.15.46:0/2812320054 >> v1:172.21.15.142:6789/0 conn(0x7f0a1415ca10 legacy=0x7f0a141604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a1159a700 1 -- 172.21.15.46:0/2812320054 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969352181 0 0) 0x7f0a14160cf0 con 0x7f0a1415ca10 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a12d9d700 1 -- 172.21.15.46:0/2812320054 >> v1:172.21.15.46:6789/0 conn(0x7f0a140b34a0 legacy=0x7f0a140cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a12d9d700 1 -- 172.21.15.46:0/2812320054 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a141612b0 con 0x7f0a1406d340 2023-05-21T16:55:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a12d9d700 1 --2- 172.21.15.46:0/2812320054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a14167830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009d90 tx=0x7f0a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242577509ee35725 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a1159a700 1 -- 172.21.15.46:0/2812320054 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00e070 con 0x7f0a1406d340 2023-05-21T16:55:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a1159a700 1 -- 172.21.15.46:0/2812320054 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00bb20 con 0x7f0a1406d340 2023-05-21T16:55:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a1159a700 1 -- 172.21.15.46:0/2812320054 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00bed0 con 0x7f0a1406d340 2023-05-21T16:55:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- 172.21.15.46:0/2812320054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 msgr2=0x7f0a14167830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 --2- 172.21.15.46:0/2812320054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a14167830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009d90 tx=0x7f0a0c00b330 comp rx=0 tx=0).stop 2023-05-21T16:55:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- 172.21.15.46:0/2812320054 shutdown_connections 2023-05-21T16:55:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 --2- 172.21.15.46:0/2812320054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a14167830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- 172.21.15.46:0/2812320054 >> 172.21.15.46:0/2812320054 conn(0x7f0a140b29c0 msgr2=0x7f0a140b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- 172.21.15.46:0/2812320054 shutdown_connections 2023-05-21T16:55:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.040+0000 7f0a18d49700 1 -- 172.21.15.46:0/2812320054 wait complete. 2023-05-21T16:55:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 Processor -- start 2023-05-21T16:55:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 -- start start 2023-05-21T16:55:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a1414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 0x7f0a140c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a1415ca10 0x7f0a140c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1415f9b0 con 0x7f0a140b34a0 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140cb4a0 con 0x7f0a1406d340 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a18d49700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1415baf0 con 0x7f0a1415ca10 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a11d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 0x7f0a140c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a11d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 0x7f0a140c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53388/0 (socket says 172.21.15.46:53388) 2023-05-21T16:55:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a11d9b700 1 -- 172.21.15.46:0/3164060902 learned_addr learned my addr 172.21.15.46:0/3164060902 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a1259c700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a1414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.044+0000 7f0a12d9d700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a1415ca10 0x7f0a140c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a11d9b700 1 -- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a1415ca10 msgr2=0x7f0a140c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a11d9b700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a1415ca10 0x7f0a140c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a11d9b700 1 -- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 msgr2=0x7f0a1414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a11d9b700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a1414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a11d9b700 1 -- 172.21.15.46:0/3164060902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009a70 con 0x7f0a140b34a0 2023-05-21T16:55:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a11d9b700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 0x7f0a140c7410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c520 tx=0x7f0a0400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04005d90 con 0x7f0a140b34a0 2023-05-21T16:55:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a040070d0 con 0x7f0a140b34a0 2023-05-21T16:55:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1406be10 con 0x7f0a140b34a0 2023-05-21T16:55:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04007480 con 0x7f0a140b34a0 2023-05-21T16:55:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1406bb30 con 0x7f0a140b34a0 2023-05-21T16:55:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a040075e0 con 0x7f0a140b34a0 2023-05-21T16:55:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a140cf150 con 0x7f0a140b34a0 2023-05-21T16:55:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.048+0000 7f0a02ffd700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09f40662f0 0x7f09f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.052+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f0a04083010 con 0x7f0a140b34a0 2023-05-21T16:55:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.052+0000 7f0a1259c700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09f40662f0 0x7f09f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.052+0000 7f0a1259c700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09f40662f0 0x7f09f40687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000f60 tx=0x7f0a08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.056+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0a04050400 con 0x7f0a140b34a0 2023-05-21T16:55:12.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.224+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a1415cde0 con 0x7f0a140b34a0 2023-05-21T16:55:12.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.848+0000 7f0a02ffd700 1 -- 172.21.15.46:0/3164060902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a1415cde0 con 0x7f0a140b34a0 2023-05-21T16:55:12.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09f40662f0 msgr2=0x7f09f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09f40662f0 0x7f09f40687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000f60 tx=0x7f0a08009040 comp rx=0 tx=0).stop 2023-05-21T16:55:12.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 msgr2=0x7f0a140c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:12.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 0x7f0a140c7410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c520 tx=0x7f0a0400c830 comp rx=0 tx=0).stop 2023-05-21T16:55:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 shutdown_connections 2023-05-21T16:55:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f09f40662f0 0x7f09f40687a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a1415ca10 0x7f0a140c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a140b34a0 0x7f0a140c7410 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 --2- 172.21.15.46:0/3164060902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a1406d340 0x7f0a1414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:12.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.852+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 >> 172.21.15.46:0/3164060902 conn(0x7f0a140b29c0 msgr2=0x7f0a140b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:12.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.856+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 shutdown_connections 2023-05-21T16:55:12.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.856+0000 7f0a18d49700 1 -- 172.21.15.46:0/3164060902 wait complete. 2023-05-21T16:55:12.863 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-05-21T16:55:12.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-21T16:55:12.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.996+0000 7f593759e700 1 Processor -- start 2023-05-21T16:55:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:12.996+0000 7f593759e700 1 -- start start 2023-05-21T16:55:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59380b8ad0 0x7f59380cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59380b5ce0 0x7f593806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b4910 0x7f59380b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59380b52f0 con 0x7f59380b8ad0 2023-05-21T16:55:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59380b8ea0 con 0x7f59380b5ce0 2023-05-21T16:55:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59380d09d0 con 0x7f59380b4910 2023-05-21T16:55:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59380b8ad0 0x7f59380cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f59380b8ad0 0x7f59380cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53400/0 (socket says 172.21.15.46:53400) 2023-05-21T16:55:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 -- 172.21.15.46:0/2450196395 learned_addr learned my addr 172.21.15.46:0/2450196395 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f5936d9d700 1 --2- 172.21.15.46:0/2450196395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b4910 0x7f59380b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f5935d9b700 1 --2- 172.21.15.46:0/2450196395 >> v2:172.21.15.142:3300/0 conn(0x7f59380b5ce0 0x7f593806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 -- 172.21.15.46:0/2450196395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b4910 msgr2=0x7f59380b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 --2- 172.21.15.46:0/2450196395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b4910 0x7f59380b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 -- 172.21.15.46:0/2450196395 >> v2:172.21.15.142:3300/0 conn(0x7f59380b5ce0 msgr2=0x7f593806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 --2- 172.21.15.46:0/2450196395 >> v2:172.21.15.142:3300/0 conn(0x7f59380b5ce0 0x7f593806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 -- 172.21.15.46:0/2450196395 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380d0cb0 con 0x7f59380b8ad0 2023-05-21T16:55:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593659c700 1 --2- 172.21.15.46:0/2450196395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b8ad0 0x7f59380cf310 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5938160120 tx=0x7f5920009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5950f8b640dfa56 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593559a700 1 -- 172.21.15.46:0/2450196395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011830 con 0x7f59380b8ad0 2023-05-21T16:55:13.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593559a700 1 -- 172.21.15.46:0/2450196395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920011990 con 0x7f59380b8ad0 2023-05-21T16:55:13.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593559a700 1 -- 172.21.15.46:0/2450196395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011d20 con 0x7f59380b8ad0 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- 172.21.15.46:0/2450196395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b8ad0 msgr2=0x7f59380cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- 172.21.15.46:0/2450196395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b8ad0 0x7f59380cf310 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5938160120 tx=0x7f5920009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- 172.21.15.46:0/2450196395 shutdown_connections 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- 172.21.15.46:0/2450196395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b4910 0x7f59380b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- 172.21.15.46:0/2450196395 >> v2:172.21.15.142:3300/0 conn(0x7f59380b5ce0 0x7f593806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 --2- 172.21.15.46:0/2450196395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b8ad0 0x7f59380cf310 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- 172.21.15.46:0/2450196395 >> 172.21.15.46:0/2450196395 conn(0x7f59380d3ae0 msgr2=0x7f59380cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- 172.21.15.46:0/2450196395 shutdown_connections 2023-05-21T16:55:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.000+0000 7f593759e700 1 -- 172.21.15.46:0/2450196395 wait complete. 2023-05-21T16:55:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 Processor -- start 2023-05-21T16:55:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 -- start start 2023-05-21T16:55:13.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59380b4910 0x7f5938150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 0x7f59380a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b8ad0 0x7f59381f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938150840 con 0x7f59380b5ce0 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593815d680 con 0x7f59380b4910 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593815d960 con 0x7f59380b8ad0 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 0x7f59380a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 0x7f59380a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53412/0 (socket says 172.21.15.46:53412) 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 -- 172.21.15.46:0/4190711194 learned_addr learned my addr 172.21.15.46:0/4190711194 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5936d9d700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b8ad0 0x7f59381f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593659c700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59380b4910 0x7f5938150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 -- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b8ad0 msgr2=0x7f59381f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b8ad0 0x7f59381f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 -- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59380b4910 msgr2=0x7f5938150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59380b4910 0x7f5938150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 -- 172.21.15.46:0/4190711194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009570 con 0x7f59380b5ce0 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f593659c700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59380b4910 0x7f5938150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5936d9d700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b8ad0 0x7f59381f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f5935d9b700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 0x7f59380a9f60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f592800e9d0 tx=0x7f592800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.004+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928009720 con 0x7f59380b5ce0 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592800c850 con 0x7f59380b5ce0 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59380cd790 con 0x7f59380b5ce0 2023-05-21T16:55:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592800cbc0 con 0x7f59380b5ce0 2023-05-21T16:55:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59380cd4f0 con 0x7f59380b5ce0 2023-05-21T16:55:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59380cda70 con 0x7f59380b5ce0 2023-05-21T16:55:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f592800cd20 con 0x7f59380b5ce0 2023-05-21T16:55:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f592effd700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59180662f0 0x7f59180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f593659c700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59180662f0 0x7f59180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.008+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f5928084090 con 0x7f59380b5ce0 2023-05-21T16:55:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.012+0000 7f593659c700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59180662f0 0x7f59180687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5920009860 tx=0x7f5920008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:13.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.016+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f59280550c0 con 0x7f59380b5ce0 2023-05-21T16:55:13.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.180+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59380733b0 con 0x7f59380b5ce0 2023-05-21T16:55:13.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.864+0000 7f592effd700 1 -- 172.21.15.46:0/4190711194 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5928054c50 con 0x7f59380b5ce0 2023-05-21T16:55:13.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59180662f0 msgr2=0x7f59180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:13.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59180662f0 0x7f59180687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5920009860 tx=0x7f5920008030 comp rx=0 tx=0).stop 2023-05-21T16:55:13.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 msgr2=0x7f59380a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:13.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 0x7f59380a9f60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f592800e9d0 tx=0x7f592800ed90 comp rx=0 tx=0).stop 2023-05-21T16:55:13.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 shutdown_connections 2023-05-21T16:55:13.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f59180662f0 0x7f59180687a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59380b8ad0 0x7f59381f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59380b5ce0 0x7f59380a9f60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 --2- 172.21.15.46:0/4190711194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59380b4910 0x7f5938150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:13.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 >> 172.21.15.46:0/4190711194 conn(0x7f59380d3ae0 msgr2=0x7f593806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:13.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 shutdown_connections 2023-05-21T16:55:13.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:13.868+0000 7f593759e700 1 -- 172.21.15.46:0/4190711194 wait complete. 2023-05-21T16:55:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-05-21T16:55:13.887 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-21T16:55:13.887 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-21T16:55:13.888 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-21T16:55:13.888 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:55:13.888 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-21T16:55:13.888 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-21T16:55:13.889 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-21T16:55:13.889 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:55:13.889 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-21T16:55:13.889 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-21T16:55:13.889 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-21T16:55:13.890 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:55:13.890 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-21T16:55:13.890 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-21T16:55:13.890 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-21T16:55:13.891 INFO:teuthology.orchestra.run:waiting for 300 2023-05-21T16:55:13.899 INFO:tasks.ceph.mds.a:Stopped 2023-05-21T16:55:13.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-21T16:55:13.900 INFO:tasks.ceph.mds.c:Stopped 2023-05-21T16:55:13.901 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-21T16:55:13.903 INFO:tasks.ceph.mds.d:Stopped 2023-05-21T16:55:13.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-21T16:55:13.904 INFO:tasks.ceph.mds.b:Stopped 2023-05-21T16:55:13.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-21T16:55:13.945 INFO:tasks.ceph.mds.a:Started 2023-05-21T16:55:13.946 DEBUG:teuthology.parallel:result is None 2023-05-21T16:55:13.947 INFO:tasks.ceph.mds.c:Started 2023-05-21T16:55:13.947 DEBUG:teuthology.parallel:result is None 2023-05-21T16:55:13.948 INFO:tasks.ceph.mds.d:Started 2023-05-21T16:55:13.949 DEBUG:teuthology.parallel:result is None 2023-05-21T16:55:13.950 INFO:tasks.ceph.mds.b:Started 2023-05-21T16:55:13.950 DEBUG:teuthology.parallel:result is None 2023-05-21T16:55:13.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-21T16:55:14.023 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2023-05-21T16:55:14.029 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-05-21T16:55:14.033 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-05-21T16:55:14.036 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-05-21T16:55:14.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.068+0000 7fbf8f59e700 1 Processor -- start 2023-05-21T16:55:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.068+0000 7fbf8f59e700 1 -- start start 2023-05-21T16:55:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf900ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8f59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbf900ae670 0x7fbf90070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8f59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf900714d0 0x7fbf9015e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8f59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf900d0040 con 0x7fbf900ae670 2023-05-21T16:55:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8f59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf900ca600 con 0x7fbf900714d0 2023-05-21T16:55:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900718d0 con 0x7fbf9015a510 2023-05-21T16:55:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf900ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf900ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:59696/0 (socket says 172.21.15.46:59696) 2023-05-21T16:55:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8e59c700 1 -- 172.21.15.46:0/2253012436 learned_addr learned my addr 172.21.15.46:0/2253012436 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 --2- 172.21.15.46:0/2253012436 >> v2:172.21.15.142:3300/0 conn(0x7fbf900714d0 0x7fbf9015e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 -- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 msgr2=0x7fbf900ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 --2- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf900ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 -- 172.21.15.46:0/2253012436 >> v2:172.21.15.46:3300/0 conn(0x7fbf900ae670 msgr2=0x7fbf90070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 --2- 172.21.15.46:0/2253012436 >> v2:172.21.15.46:3300/0 conn(0x7fbf900ae670 0x7fbf90070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 -- 172.21.15.46:0/2253012436 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900b3010 con 0x7fbf900714d0 2023-05-21T16:55:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8ed9d700 1 --2- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf9015e070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf9015f110 tx=0x7fbf78009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a17812dd1e6a02f server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:14.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.072+0000 7fbf8e59c700 1 --2- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf900ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:14.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8d59a700 1 -- 172.21.15.46:0/2253012436 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011830 con 0x7fbf900714d0 2023-05-21T16:55:14.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8d59a700 1 -- 172.21.15.46:0/2253012436 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78011990 con 0x7fbf900714d0 2023-05-21T16:55:14.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8d59a700 1 -- 172.21.15.46:0/2253012436 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011d20 con 0x7fbf900714d0 2023-05-21T16:55:14.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 -- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 msgr2=0x7fbf9015e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:14.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf9015e070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf9015f110 tx=0x7fbf78009b30 comp rx=0 tx=0).stop 2023-05-21T16:55:14.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 -- 172.21.15.46:0/2253012436 shutdown_connections 2023-05-21T16:55:14.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf9015e070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/2253012436 >> v2:172.21.15.46:3300/0 conn(0x7fbf900ae670 0x7fbf90070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/2253012436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf900ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 -- 172.21.15.46:0/2253012436 >> 172.21.15.46:0/2253012436 conn(0x7fbf900cca00 msgr2=0x7fbf900cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:14.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 -- 172.21.15.46:0/2253012436 shutdown_connections 2023-05-21T16:55:14.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.076+0000 7fbf8f59e700 1 -- 172.21.15.46:0/2253012436 wait complete. 2023-05-21T16:55:14.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 Processor -- start 2023-05-21T16:55:14.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 -- start start 2023-05-21T16:55:14.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf901ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 0x7fbf90157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf901580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90156bb0 con 0x7fbf900ae670 2023-05-21T16:55:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900af6b0 con 0x7fbf900714d0 2023-05-21T16:55:14.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900aed80 con 0x7fbf9015a510 2023-05-21T16:55:14.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 0x7fbf90157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf901ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf901ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:52704/0 (socket says 172.21.15.46:52704) 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8e59c700 1 -- 172.21.15.46:0/170863999 learned_addr learned my addr 172.21.15.46:0/170863999 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 0x7fbf90157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53448/0 (socket says 172.21.15.46:53448) 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8ed9d700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf901580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 -- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 msgr2=0x7fbf901580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:14.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf901580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 -- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 msgr2=0x7fbf901ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf901ed510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 -- 172.21.15.46:0/170863999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780094b0 con 0x7fbf900ae670 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8e59c700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf901ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8ed9d700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf901580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8dd9b700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 0x7fbf90157b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000b420 tx=0x7fbf8000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80011830 con 0x7fbf900ae670 2023-05-21T16:55:14.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80011990 con 0x7fbf900ae670 2023-05-21T16:55:14.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900b35d0 con 0x7fbf900ae670 2023-05-21T16:55:14.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80011d40 con 0x7fbf900ae670 2023-05-21T16:55:14.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.080+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf900b32f0 con 0x7fbf900ae670 2023-05-21T16:55:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.084+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf900b38b0 con 0x7fbf900ae670 2023-05-21T16:55:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.084+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf8001a400 con 0x7fbf900ae670 2023-05-21T16:55:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.084+0000 7fbf86ffd700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf700662f0 0x7fbf700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.084+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbf80083880 con 0x7fbf900ae670 2023-05-21T16:55:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.084+0000 7fbf8e59c700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf700662f0 0x7fbf700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:14.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.084+0000 7fbf8e59c700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf700662f0 0x7fbf700687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf88007600 tx=0x7fbf88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.088+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbf80051090 con 0x7fbf900ae670 2023-05-21T16:55:14.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:14.264+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbf90067ac0 con 0x7fbf900ae670 2023-05-21T16:55:15.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.084+0000 7fbf86ffd700 1 -- 172.21.15.46:0/170863999 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbf80015080 con 0x7fbf900ae670 2023-05-21T16:55:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf700662f0 msgr2=0x7fbf700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf700662f0 0x7fbf700687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf88007600 tx=0x7fbf88009040 comp rx=0 tx=0).stop 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 msgr2=0x7fbf90157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 0x7fbf90157b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000b420 tx=0x7fbf8000b730 comp rx=0 tx=0).stop 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 shutdown_connections 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fbf700662f0 0x7fbf700687a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf9015a510 0x7fbf901580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf900ae670 0x7fbf90157b80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 --2- 172.21.15.46:0/170863999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf900714d0 0x7fbf901ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 >> 172.21.15.46:0/170863999 conn(0x7fbf900cca00 msgr2=0x7fbf900b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 shutdown_connections 2023-05-21T16:55:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.088+0000 7fbf8f59e700 1 -- 172.21.15.46:0/170863999 wait complete. 2023-05-21T16:55:15.093 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2023-05-21T16:55:15.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-21T16:55:15.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.224+0000 7f21b087f700 1 Processor -- start 2023-05-21T16:55:15.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.224+0000 7f21b087f700 1 -- start start 2023-05-21T16:55:15.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f21ac069f80 0x7f21ac06a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac0ade30 con 0x7f21ac160be0 2023-05-21T16:55:15.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac0cd210 con 0x7f21ac070c50 2023-05-21T16:55:15.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0cc970 con 0x7f21ac069f80 2023-05-21T16:55:15.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aad9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f21ac160be0 0x7f21ac1651c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56776/0 (socket says 172.21.15.46:56776) 2023-05-21T16:55:15.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aad9d700 1 -- 172.21.15.46:0/3534617301 learned_addr learned my addr 172.21.15.46:0/3534617301 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aa59c700 1 --2- 172.21.15.46:0/3534617301 >> v2:172.21.15.142:3300/0 conn(0x7f21ac069f80 0x7f21ac06a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21a9d9b700 1 -- 172.21.15.46:0/3534617301 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936401254 0 0) 0x7f21ac0ade30 con 0x7f21ac160be0 2023-05-21T16:55:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21a9d9b700 1 -- 172.21.15.46:0/3534617301 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21940035d0 con 0x7f21ac160be0 2023-05-21T16:55:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aa59c700 1 -- 172.21.15.46:0/3534617301 >> v1:172.21.15.142:6789/0 conn(0x7f21ac070c50 legacy=0x7f21ac0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aa59c700 1 -- 172.21.15.46:0/3534617301 >> v1:172.21.15.46:6789/0 conn(0x7f21ac160be0 legacy=0x7f21ac1651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aa59c700 1 -- 172.21.15.46:0/3534617301 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0ccc50 con 0x7f21ac069f80 2023-05-21T16:55:15.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21aa59c700 1 --2- 172.21.15.46:0/3534617301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac06a420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f219c009850 tx=0x7f219c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4affcf76954dea3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:15.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21a9d9b700 1 -- 172.21.15.46:0/3534617301 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c011830 con 0x7f21ac069f80 2023-05-21T16:55:15.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21a9d9b700 1 -- 172.21.15.46:0/3534617301 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c011990 con 0x7f21ac069f80 2023-05-21T16:55:15.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21a9d9b700 1 -- 172.21.15.46:0/3534617301 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c011d40 con 0x7f21ac069f80 2023-05-21T16:55:15.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- 172.21.15.46:0/3534617301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 msgr2=0x7f21ac06a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 --2- 172.21.15.46:0/3534617301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac06a420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f219c009850 tx=0x7f219c009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:15.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- 172.21.15.46:0/3534617301 shutdown_connections 2023-05-21T16:55:15.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 --2- 172.21.15.46:0/3534617301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac06a420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- 172.21.15.46:0/3534617301 >> 172.21.15.46:0/3534617301 conn(0x7f21ac0cf720 msgr2=0x7f21ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:15.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- 172.21.15.46:0/3534617301 shutdown_connections 2023-05-21T16:55:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.228+0000 7f21b087f700 1 -- 172.21.15.46:0/3534617301 wait complete. 2023-05-21T16:55:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 Processor -- start 2023-05-21T16:55:15.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 -- start start 2023-05-21T16:55:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 0x7f21ac0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21ac160be0 0x7f21ac15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0bd650 con 0x7f21ac070c50 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac15cd60 con 0x7f21ac069f80 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21b087f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac15b780 con 0x7f21ac160be0 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 0x7f21ac0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 0x7f21ac0b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60142/0 (socket says 172.21.15.46:60142) 2023-05-21T16:55:15.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 -- 172.21.15.46:0/529537687 learned_addr learned my addr 172.21.15.46:0/529537687 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aad9d700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21ab59e700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21ac160be0 0x7f21ac15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 -- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21ac160be0 msgr2=0x7f21ac15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21ac160be0 0x7f21ac15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 -- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 msgr2=0x7f21ac15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac15c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.232+0000 7f21aa59c700 1 -- 172.21.15.46:0/529537687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0094b0 con 0x7f21ac070c50 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21aa59c700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 0x7f21ac0b0990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f219c000c00 tx=0x7f219c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c01a990 con 0x7f21ac070c50 2023-05-21T16:55:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c01f070 con 0x7f21ac070c50 2023-05-21T16:55:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c01ad30 con 0x7f21ac070c50 2023-05-21T16:55:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac070730 con 0x7f21ac070c50 2023-05-21T16:55:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac0ccf30 con 0x7f21ac070c50 2023-05-21T16:55:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac0ae1a0 con 0x7f21ac070c50 2023-05-21T16:55:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f219c01b430 con 0x7f21ac070c50 2023-05-21T16:55:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21937fe700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f21980662f0 0x7f21980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f219c084990 con 0x7f21ac070c50 2023-05-21T16:55:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.236+0000 7f21aad9d700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f21980662f0 0x7f21980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.240+0000 7f21aad9d700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f21980662f0 0x7f21980687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:15.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.244+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f219c0521f0 con 0x7f21ac070c50 2023-05-21T16:55:15.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.464+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f21ac0710b0 con 0x7f21ac070c50 2023-05-21T16:55:15.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.464+0000 7f21937fe700 1 -- 172.21.15.46:0/529537687 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f219c015020 con 0x7f21ac070c50 2023-05-21T16:55:15.466 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:15.467 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-21T16:55:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2023-05-21T16:55:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2023-05-21T16:55:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpki1gHLhAAPiOS6bcjJBHz2MRcwfWYFg==", 2023-05-21T16:55:15.467 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.468 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpkr78jNhAAYL//f04X/Fhl8DXkyaJ4GQ==", 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.469 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpkpOzlMRAA4aZpiecfZq4C3lCtQbBeYg==", 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-05-21T16:55:15.470 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpkuB/lORAAPQdRD7pj/yWPodV3N0emfQ==", 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.471 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2023-05-21T16:55:15.472 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB+TGpkBRzOMhAAVPCX/fmqk/VqvYu+RhTYFQ==", 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.473 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCBTGpkjYOONxAAv0HbaCcFUkGbs4qufAzJQQ==", 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCFTGpkA09jAxAAizXs5rJiUOqA9VP0z2jwOg==", 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCITGpke1DrBxAADVKP7j+UvBNae5bjhvY7eA==", 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCNTGpkNNyTKRAAIGMScNf7AVnIV3UOJENE5g==", 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.477 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCRTGpkN96UAxAAXRW+hfXBhwpjSPYty26O5g==", 2023-05-21T16:55:15.478 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.479 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCUTGpk3F/GBxAASeLnJ5GmRDSWZtN51PyGpA==", 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.480 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCXTGpkwC3nDxAA74at/BnPJZlsBtCbUroLJw==", 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.481 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB+TGpkXg2qARAAVnjHF0MQFJcvFrEmZI1T4w==", 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-05-21T16:55:15.482 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB+TGpkcgfhChAAhfrvn6MXSxIL6im6BX5y5g==", 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.483 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-05-21T16:55:15.484 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-05-21T16:55:15.484 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-05-21T16:55:15.484 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.484 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB+TGpkO291BxAADKtdPe8+71XZ9Ei/YOUcpA==", 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-05-21T16:55:15.485 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB+TGpkNnv0DRAALaixpNnTJIT3x79j2s79sg==", 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2023-05-21T16:55:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpki66cFhAATmRKuQwdSltOVjWabveoKw==", 2023-05-21T16:55:15.487 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.488 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mds", 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChTGpkPrNsJxAAeAFqD4EPMOLBAtPo5afjNw==", 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mds" 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mgr", 2023-05-21T16:55:15.489 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChTGpkB89sJxAAviDsdzJU9WzzvTh/WczmbA==", 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-osd", 2023-05-21T16:55:15.490 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChTGpkzORsJxAAjuG78M/rD+YCGBXW1J4zJw==", 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-osd" 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd", 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChTGpkr/psJxAAMYqCC0R/966KyhKIOlmlNA==", 2023-05-21T16:55:15.491 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChTGpkOxNtJxAA4LQ+EI5BOSDc8Tg9LBeKUg==", 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.492 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rgw", 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQChTGpkeSptJxAA0EP8FBPOUBA2+7hCibQBxw==", 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-21T16:55:15.493 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpkAOELKhAAEHcT2uVno8t8eH5xPsLVJQ==", 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-05-21T16:55:15.494 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB9TGpkMt3tIxAA3MOnp4wfW9XPCfERBAPnTw==", 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2023-05-21T16:55:15.495 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2023-05-21T16:55:15.496 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2023-05-21T16:55:15.496 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2023-05-21T16:55:15.496 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.496 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:15.496 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-05-21T16:55:15.496 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-21T16:55:15.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f21980662f0 msgr2=0x7f21980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f21980662f0 0x7f21980687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0007de0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 msgr2=0x7f21ac0b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 0x7f21ac0b0990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f219c000c00 tx=0x7f219c004770 comp rx=0 tx=0).stop 2023-05-21T16:55:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 shutdown_connections 2023-05-21T16:55:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f21980662f0 0x7f21980687a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21ac160be0 0x7f21ac15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ac070c50 0x7f21ac0b0990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 --2- 172.21.15.46:0/529537687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ac069f80 0x7f21ac15c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 >> 172.21.15.46:0/529537687 conn(0x7f21ac0cf720 msgr2=0x7f21ac0c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 shutdown_connections 2023-05-21T16:55:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.468+0000 7f21b087f700 1 -- 172.21.15.46:0/529537687 wait complete. 2023-05-21T16:55:15.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-21T16:55:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4359e700 1 Processor -- start 2023-05-21T16:55:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4359e700 1 -- start start 2023-05-21T16:55:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4415a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4359e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4406b9d0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4406b450 con 0x7f9f4415dbb0 2023-05-21T16:55:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44159a90 con 0x7f9f4406c760 2023-05-21T16:55:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f42d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9f440c9cd0 0x7f9f440ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56792/0 (socket says 172.21.15.46:56792) 2023-05-21T16:55:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f42d9d700 1 -- 172.21.15.46:0/4040876113 learned_addr learned my addr 172.21.15.46:0/4040876113 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4259c700 1 --2- 172.21.15.46:0/4040876113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243888687 0 0) 0x7f9f4406b9d0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f2c0035d0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034424566 0 0) 0x7f9f4406b450 con 0x7f9f4415dbb0 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4406b9d0 con 0x7f9f4415dbb0 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4259c700 1 -- 172.21.15.46:0/4040876113 >> v1:172.21.15.142:6789/0 conn(0x7f9f4415dbb0 legacy=0x7f9f4406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4259c700 1 -- 172.21.15.46:0/4040876113 >> v1:172.21.15.46:6789/0 conn(0x7f9f440c9cd0 legacy=0x7f9f440ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184484356 0 0) 0x7f9f2c0035d0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.620+0000 7f9f4259c700 1 -- 172.21.15.46:0/4040876113 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4406b6f0 con 0x7f9f4406c760 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4259c700 1 --2- 172.21.15.46:0/4040876113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4415a830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009880 tx=0x7f9f38009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c8b799fbf8e7798 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011830 con 0x7f9f4406c760 2023-05-21T16:55:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38011990 con 0x7f9f4406c760 2023-05-21T16:55:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4159a700 1 -- 172.21.15.46:0/4040876113 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38011d00 con 0x7f9f4406c760 2023-05-21T16:55:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 -- 172.21.15.46:0/4040876113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 msgr2=0x7f9f4415a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 --2- 172.21.15.46:0/4040876113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4415a830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009880 tx=0x7f9f38009b90 comp rx=0 tx=0).stop 2023-05-21T16:55:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 -- 172.21.15.46:0/4040876113 shutdown_connections 2023-05-21T16:55:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 --2- 172.21.15.46:0/4040876113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4415a830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 -- 172.21.15.46:0/4040876113 >> 172.21.15.46:0/4040876113 conn(0x7f9f440cf720 msgr2=0x7f9f440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 -- 172.21.15.46:0/4040876113 shutdown_connections 2023-05-21T16:55:15.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.624+0000 7f9f4359e700 1 -- 172.21.15.46:0/4040876113 wait complete. 2023-05-21T16:55:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 Processor -- start 2023-05-21T16:55:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 -- start start 2023-05-21T16:55:15.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 0x7f9f440aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4415dbb0 0x7f9f44070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4414e770 con 0x7f9f440c9cd0 2023-05-21T16:55:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b3d60 con 0x7f9f4415dbb0 2023-05-21T16:55:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b4040 con 0x7f9f4406c760 2023-05-21T16:55:15.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 0x7f9f440aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 0x7f9f440aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60154/0 (socket says 172.21.15.46:60154) 2023-05-21T16:55:15.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 -- 172.21.15.46:0/2199756075 learned_addr learned my addr 172.21.15.46:0/2199756075 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f42d9d700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4415dbb0 0x7f9f44070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4259c700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 -- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 msgr2=0x7f9f4414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4414e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 -- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4415dbb0 msgr2=0x7f9f44070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4415dbb0 0x7f9f44070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 -- 172.21.15.46:0/2199756075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380094b0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f42d9d700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4415dbb0 0x7f9f44070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f41d9b700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 0x7f9f440aca90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400cc50 tx=0x7f9f3400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400ade0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3400ce50 con 0x7f9f440c9cd0 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4415a030 con 0x7f9f440c9cd0 2023-05-21T16:55:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34003c60 con 0x7f9f440c9cd0 2023-05-21T16:55:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.628+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f44159d50 con 0x7f9f440c9cd0 2023-05-21T16:55:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.632+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4415a310 con 0x7f9f440c9cd0 2023-05-21T16:55:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.632+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f340050d0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.632+0000 7f9f32ffd700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9f24066320 0x7f9f240687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.632+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9f34083b00 con 0x7f9f440c9cd0 2023-05-21T16:55:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.632+0000 7f9f4259c700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9f24066320 0x7f9f240687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:15.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.636+0000 7f9f4259c700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9f24066320 0x7f9f240687d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f380097d0 tx=0x7f9f38010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:15.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.640+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9f34085e60 con 0x7f9f440c9cd0 2023-05-21T16:55:15.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.856+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9f440733b0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.864+0000 7f9f32ffd700 1 -- 172.21.15.46:0/2199756075 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9f340512c0 con 0x7f9f440c9cd0 2023-05-21T16:55:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9f24066320 msgr2=0x7f9f240687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9f24066320 0x7f9f240687d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9f380097d0 tx=0x7f9f38010000 comp rx=0 tx=0).stop 2023-05-21T16:55:15.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 msgr2=0x7f9f440aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:15.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 0x7f9f440aca90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400cc50 tx=0x7f9f3400a340 comp rx=0 tx=0).stop 2023-05-21T16:55:15.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 shutdown_connections 2023-05-21T16:55:15.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9f24066320 0x7f9f240687d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f4415dbb0 0x7f9f44070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f440c9cd0 0x7f9f440aca90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 --2- 172.21.15.46:0/2199756075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f4406c760 0x7f9f4414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:15.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 >> 172.21.15.46:0/2199756075 conn(0x7f9f440cf720 msgr2=0x7f9f440ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:15.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 shutdown_connections 2023-05-21T16:55:15.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.868+0000 7f9f4359e700 1 -- 172.21.15.46:0/2199756075 wait complete. 2023-05-21T16:55:15.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-21T16:55:15.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 Processor -- start 2023-05-21T16:55:15.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- start start 2023-05-21T16:55:15.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feb9c160be0 0x7feb9c1651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c069f80 0x7feb9c06a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:15.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0ade30 con 0x7feb9c070c50 2023-05-21T16:55:15.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0cd210 con 0x7feb9c160be0 2023-05-21T16:55:15.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0cc970 con 0x7feb9c069f80 2023-05-21T16:55:15.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feb9c160be0 0x7feb9c1651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feb9c070c50 0x7feb9c0c18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56802/0 (socket says 172.21.15.46:56802) 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9b7fe700 1 -- 172.21.15.46:0/3215238956 learned_addr learned my addr 172.21.15.46:0/3215238956 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9a7fc700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c069f80 0x7feb9c06a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9affd700 1 -- 172.21.15.46:0/3215238956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c069f80 msgr2=0x7feb9c06a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9affd700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c069f80 0x7feb9c06a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9affd700 1 -- 172.21.15.46:0/3215238956 >> v1:172.21.15.46:6789/0 conn(0x7feb9c070c50 legacy=0x7feb9c0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9affd700 1 -- 172.21.15.46:0/3215238956 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0ccc50 con 0x7feb9c160be0 2023-05-21T16:55:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9a7fc700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c069f80 0x7feb9c06a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:16.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9affd700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c160be0 0x7feb9c1651c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feb90009850 tx=0x7feb90009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403ebf87ae26fc2a server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb99ffb700 1 -- 172.21.15.46:0/3215238956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90011830 con 0x7feb9c160be0 2023-05-21T16:55:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb99ffb700 1 -- 172.21.15.46:0/3215238956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90011990 con 0x7feb9c160be0 2023-05-21T16:55:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb99ffb700 1 -- 172.21.15.46:0/3215238956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90011d20 con 0x7feb9c160be0 2023-05-21T16:55:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- 172.21.15.46:0/3215238956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c160be0 msgr2=0x7feb9c1651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c160be0 0x7feb9c1651c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feb90009850 tx=0x7feb90009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- 172.21.15.46:0/3215238956 shutdown_connections 2023-05-21T16:55:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c069f80 0x7feb9c06a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 --2- 172.21.15.46:0/3215238956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c160be0 0x7feb9c1651c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:15.996+0000 7feb9bfff700 1 -- 172.21.15.46:0/3215238956 >> 172.21.15.46:0/3215238956 conn(0x7feb9c0cf720 msgr2=0x7feb9c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.000+0000 7feb9bfff700 1 -- 172.21.15.46:0/3215238956 shutdown_connections 2023-05-21T16:55:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.000+0000 7feb9bfff700 1 -- 172.21.15.46:0/3215238956 wait complete. 2023-05-21T16:55:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.000+0000 7feb9bfff700 1 Processor -- start 2023-05-21T16:55:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.000+0000 7feb9bfff700 1 -- start start 2023-05-21T16:55:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c069f80 0x7feb9c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 0x7feb9c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c160be0 0x7feb9c1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c158a30 con 0x7feb9c070c50 2023-05-21T16:55:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c44d0 con 0x7feb9c069f80 2023-05-21T16:55:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c47b0 con 0x7feb9c160be0 2023-05-21T16:55:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 0x7feb9c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 0x7feb9c159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60172/0 (socket says 172.21.15.46:60172) 2023-05-21T16:55:16.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 -- 172.21.15.46:0/1511673348 learned_addr learned my addr 172.21.15.46:0/1511673348 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9affd700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c069f80 0x7feb9c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9b7fe700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c160be0 0x7feb9c1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 -- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c160be0 msgr2=0x7feb9c1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c160be0 0x7feb9c1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 -- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c069f80 msgr2=0x7feb9c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c069f80 0x7feb9c1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 -- 172.21.15.46:0/1511673348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900094b0 con 0x7feb9c070c50 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9b7fe700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c160be0 0x7feb9c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9a7fc700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 0x7feb9c159270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb94009fc0 tx=0x7feb9400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94003a40 con 0x7feb9c070c50 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400f040 con 0x7feb9c070c50 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94003e00 con 0x7feb9c070c50 2023-05-21T16:55:16.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c070730 con 0x7feb9c070c50 2023-05-21T16:55:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0ccf30 con 0x7feb9c070c50 2023-05-21T16:55:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.004+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c165700 con 0x7feb9c070c50 2023-05-21T16:55:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.008+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb94004030 con 0x7feb9c070c50 2023-05-21T16:55:16.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.008+0000 7feb83fff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.008+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feb94083a70 con 0x7feb9c070c50 2023-05-21T16:55:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.008+0000 7feb9affd700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.008+0000 7feb9affd700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb880662f0 0x7feb880687a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feb90014040 tx=0x7feb90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.012+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feb94051380 con 0x7feb9c070c50 2023-05-21T16:55:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.232+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7feb9c0733b0 con 0x7feb9c070c50 2023-05-21T16:55:16.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb83fff700 1 -- 172.21.15.46:0/1511673348 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7feb9401a0a0 con 0x7feb9c070c50 2023-05-21T16:55:16.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb880662f0 msgr2=0x7feb880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb880662f0 0x7feb880687a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feb90014040 tx=0x7feb90008030 comp rx=0 tx=0).stop 2023-05-21T16:55:16.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 msgr2=0x7feb9c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 0x7feb9c159270 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb94009fc0 tx=0x7feb9400d460 comp rx=0 tx=0).stop 2023-05-21T16:55:16.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 shutdown_connections 2023-05-21T16:55:16.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb880662f0 0x7feb880687a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c160be0 0x7feb9c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c070c50 0x7feb9c159270 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 --2- 172.21.15.46:0/1511673348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c069f80 0x7feb9c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 >> 172.21.15.46:0/1511673348 conn(0x7feb9c0cf720 msgr2=0x7feb9c15f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 shutdown_connections 2023-05-21T16:55:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.244+0000 7feb9bfff700 1 -- 172.21.15.46:0/1511673348 wait complete. 2023-05-21T16:55:16.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-21T16:55:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.372+0000 7f7c46d1f700 1 Processor -- start 2023-05-21T16:55:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.372+0000 7f7c46d1f700 1 -- start start 2023-05-21T16:55:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c4015d460 0x7f7c40070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c400ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c40159df0 con 0x7f7c40158d90 2023-05-21T16:55:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4015a280 con 0x7f7c4015d460 2023-05-21T16:55:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400cd730 con 0x7f7c40070ad0 2023-05-21T16:55:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c45d1d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7c40158d90 0x7f7c400ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56804/0 (socket says 172.21.15.46:56804) 2023-05-21T16:55:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c45d1d700 1 -- 172.21.15.46:0/1527084362 learned_addr learned my addr 172.21.15.46:0/1527084362 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:16.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4651e700 1 --2- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c400ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4551c700 1 --2- 172.21.15.46:0/1527084362 >> v2:172.21.15.142:3300/0 conn(0x7f7c4015d460 0x7f7c40070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c44d1b700 1 -- 172.21.15.46:0/1527084362 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247795369 0 0) 0x7f7c40159df0 con 0x7f7c40158d90 2023-05-21T16:55:16.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c44d1b700 1 -- 172.21.15.46:0/1527084362 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c2c0046e0 con 0x7f7c40158d90 2023-05-21T16:55:16.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4551c700 1 -- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 msgr2=0x7f7c400ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:16.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4551c700 1 --2- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c400ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4551c700 1 -- 172.21.15.46:0/1527084362 >> v1:172.21.15.46:6789/0 conn(0x7f7c40158d90 legacy=0x7f7c400ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4551c700 1 -- 172.21.15.46:0/1527084362 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40070ee0 con 0x7f7c4015d460 2023-05-21T16:55:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c4551c700 1 --2- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4015d460 0x7f7c40070590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009850 tx=0x7f7c34009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d373c30e5c4a3714 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c44d1b700 1 -- 172.21.15.46:0/1527084362 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34011830 con 0x7f7c4015d460 2023-05-21T16:55:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c44d1b700 1 -- 172.21.15.46:0/1527084362 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34011990 con 0x7f7c4015d460 2023-05-21T16:55:16.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c44d1b700 1 -- 172.21.15.46:0/1527084362 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34011d40 con 0x7f7c4015d460 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4015d460 msgr2=0x7f7c40070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4015d460 0x7f7c40070590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009850 tx=0x7f7c34009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- 172.21.15.46:0/1527084362 shutdown_connections 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c400ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/1527084362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4015d460 0x7f7c40070590 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- 172.21.15.46:0/1527084362 >> 172.21.15.46:0/1527084362 conn(0x7f7c400cf720 msgr2=0x7f7c400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:16.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- 172.21.15.46:0/1527084362 shutdown_connections 2023-05-21T16:55:16.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.376+0000 7f7c46d1f700 1 -- 172.21.15.46:0/1527084362 wait complete. 2023-05-21T16:55:16.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 Processor -- start 2023-05-21T16:55:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 -- start start 2023-05-21T16:55:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c40150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c40158d90 0x7f7c4015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 0x7f7c4015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400b04c0 con 0x7f7c4015d460 2023-05-21T16:55:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400b1320 con 0x7f7c40158d90 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c46d1f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400b0710 con 0x7f7c40070ad0 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 0x7f7c4015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 0x7f7c4015b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60188/0 (socket says 172.21.15.46:60188) 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 -- 172.21.15.46:0/72857517 learned_addr learned my addr 172.21.15.46:0/72857517 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4551c700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c40158d90 0x7f7c4015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c45d1d700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c40150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 -- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 msgr2=0x7f7c40150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c40150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 -- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c40158d90 msgr2=0x7f7c4015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c40158d90 0x7f7c4015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 -- 172.21.15.46:0/72857517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340094b0 con 0x7f7c4015d460 2023-05-21T16:55:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4551c700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c40158d90 0x7f7c4015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c4651e700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 0x7f7c4015b9c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009dd0 tx=0x7f7c3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800cd40 con 0x7f7c4015d460 2023-05-21T16:55:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.380+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800f040 con 0x7f7c4015d460 2023-05-21T16:55:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c401597a0 con 0x7f7c4015d460 2023-05-21T16:55:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380146c0 con 0x7f7c4015d460 2023-05-21T16:55:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c401594c0 con 0x7f7c4015d460 2023-05-21T16:55:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c40159a80 con 0x7f7c4015d460 2023-05-21T16:55:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c38014820 con 0x7f7c4015d460 2023-05-21T16:55:16.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c327fc700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7c240662f0 0x7f7c240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c380842d0 con 0x7f7c4015d460 2023-05-21T16:55:16.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.384+0000 7f7c45d1d700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7c240662f0 0x7f7c240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.388+0000 7f7c45d1d700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7c240662f0 0x7f7c240687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0011e0 tx=0x7f7c3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.392+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7c38051aa0 con 0x7f7c4015d460 2023-05-21T16:55:16.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:55:16.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:55:16.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.612+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7c400733b0 con 0x7f7c4015d460 2023-05-21T16:55:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c327fc700 1 -- 172.21.15.46:0/72857517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c3800cea0 con 0x7f7c4015d460 2023-05-21T16:55:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7c240662f0 msgr2=0x7f7c240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7c240662f0 0x7f7c240687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0011e0 tx=0x7f7c3c009040 comp rx=0 tx=0).stop 2023-05-21T16:55:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 msgr2=0x7f7c4015b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 0x7f7c4015b9c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009dd0 tx=0x7f7c3800c3a0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 shutdown_connections 2023-05-21T16:55:16.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7c240662f0 0x7f7c240687a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4015d460 0x7f7c4015b9c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c40158d90 0x7f7c4015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 --2- 172.21.15.46:0/72857517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c40070ad0 0x7f7c40150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 >> 172.21.15.46:0/72857517 conn(0x7f7c400cf720 msgr2=0x7f7c40157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:16.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 shutdown_connections 2023-05-21T16:55:16.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.620+0000 7f7c46d1f700 1 -- 172.21.15.46:0/72857517 wait complete. 2023-05-21T16:55:16.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-21T16:55:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf282f700 1 Processor -- start 2023-05-21T16:55:16.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf282f700 1 -- start start 2023-05-21T16:55:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf282f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf282f700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec06a990 con 0x7fccec15e8c0 2023-05-21T16:55:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf282f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec06ac70 con 0x7fccec0cac60 2023-05-21T16:55:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf282f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec06b120 con 0x7fccec15a2b0 2023-05-21T16:55:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf102c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fccec15e8c0 0x7fccec0ca550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56818/0 (socket says 172.21.15.46:56818) 2023-05-21T16:55:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf102c700 1 -- 172.21.15.46:0/1922371143 learned_addr learned my addr 172.21.15.46:0/1922371143 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf182d700 1 --2- 172.21.15.46:0/1922371143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766330485 0 0) 0x7fccec06a990 con 0x7fccec15e8c0 2023-05-21T16:55:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd80035d0 con 0x7fccec15e8c0 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217764108 0 0) 0x7fccec06ac70 con 0x7fccec0cac60 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccec06a990 con 0x7fccec0cac60 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf182d700 1 -- 172.21.15.46:0/1922371143 >> v1:172.21.15.142:6789/0 conn(0x7fccec0cac60 legacy=0x7fccec0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf182d700 1 -- 172.21.15.46:0/1922371143 >> v1:172.21.15.46:6789/0 conn(0x7fccec15e8c0 legacy=0x7fccec0ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.816+0000 7fccf182d700 1 -- 172.21.15.46:0/1922371143 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec06b400 con 0x7fccec15a2b0 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf182d700 1 --2- 172.21.15.46:0/1922371143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec06ccd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009880 tx=0x7fcce8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acccd88c4608fae8 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8011830 con 0x7fccec15a2b0 2023-05-21T16:55:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8011990 con 0x7fccec15a2b0 2023-05-21T16:55:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf082b700 1 -- 172.21.15.46:0/1922371143 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8011d20 con 0x7fccec15a2b0 2023-05-21T16:55:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 -- 172.21.15.46:0/1922371143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 msgr2=0x7fccec06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 --2- 172.21.15.46:0/1922371143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec06ccd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009880 tx=0x7fcce8009b90 comp rx=0 tx=0).stop 2023-05-21T16:55:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 -- 172.21.15.46:0/1922371143 shutdown_connections 2023-05-21T16:55:16.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 --2- 172.21.15.46:0/1922371143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec06ccd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 -- 172.21.15.46:0/1922371143 >> 172.21.15.46:0/1922371143 conn(0x7fccec06d8f0 msgr2=0x7fccec06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:16.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 -- 172.21.15.46:0/1922371143 shutdown_connections 2023-05-21T16:55:16.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 -- 172.21.15.46:0/1922371143 wait complete. 2023-05-21T16:55:16.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.820+0000 7fccf282f700 1 Processor -- start 2023-05-21T16:55:16.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 -- start start 2023-05-21T16:55:16.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 0x7fccec14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec15e8c0 0x7fccec0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c5e10 con 0x7fccec0cac60 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c7d40 con 0x7fccec15e8c0 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c8020 con 0x7fccec15a2b0 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 0x7fccec14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 0x7fccec14e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60202/0 (socket says 172.21.15.46:60202) 2023-05-21T16:55:16.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 -- 172.21.15.46:0/1279281871 learned_addr learned my addr 172.21.15.46:0/1279281871 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:16.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf102c700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf202e700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec15e8c0 0x7fccec0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 -- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 msgr2=0x7fccec0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 -- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec15e8c0 msgr2=0x7fccec0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec15e8c0 0x7fccec0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 -- 172.21.15.46:0/1279281871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80094b0 con 0x7fccec0cac60 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf182d700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 0x7fccec14e410 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcce8013040 tx=0x7fcce8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce801a8c0 con 0x7fccec0cac60 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce801e070 con 0x7fccec0cac60 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0b29c0 con 0x7fccec0cac60 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce801ac60 con 0x7fccec0cac60 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.824+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec0cb2c0 con 0x7fccec0cac60 2023-05-21T16:55:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.828+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec15a680 con 0x7fccec0cac60 2023-05-21T16:55:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.828+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcce802d450 con 0x7fccec0cac60 2023-05-21T16:55:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.828+0000 7fcce27fc700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fccd00662f0 0x7fccd00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.828+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcce8084780 con 0x7fccec0cac60 2023-05-21T16:55:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.828+0000 7fccf102c700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fccd00662f0 0x7fccd00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.828+0000 7fccf102c700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fccd00662f0 0x7fccd00687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fccec0742b0 tx=0x7fccdc007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:16.836+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcce8051fe0 con 0x7fccec0cac60 2023-05-21T16:55:17.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.056+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fccec067ac0 con 0x7fccec0cac60 2023-05-21T16:55:17.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.064+0000 7fcce27fc700 1 -- 172.21.15.46:0/1279281871 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcce80200a0 con 0x7fccec0cac60 2023-05-21T16:55:17.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fccd00662f0 msgr2=0x7fccd00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fccd00662f0 0x7fccd00687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fccec0742b0 tx=0x7fccdc007e20 comp rx=0 tx=0).stop 2023-05-21T16:55:17.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 msgr2=0x7fccec14e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 0x7fccec14e410 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcce8013040 tx=0x7fcce8004770 comp rx=0 tx=0).stop 2023-05-21T16:55:17.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 shutdown_connections 2023-05-21T16:55:17.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fccd00662f0 0x7fccd00687a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec15e8c0 0x7fccec0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccec15a2b0 0x7fccec0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 --2- 172.21.15.46:0/1279281871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fccec0cac60 0x7fccec14e410 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 >> 172.21.15.46:0/1279281871 conn(0x7fccec06d8f0 msgr2=0x7fccec0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:17.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 shutdown_connections 2023-05-21T16:55:17.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.068+0000 7fccf282f700 1 -- 172.21.15.46:0/1279281871 wait complete. 2023-05-21T16:55:17.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-21T16:55:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 Processor -- start 2023-05-21T16:55:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 -- start start 2023-05-21T16:55:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2a8071bb0 0x7fd2a80cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2a80b3660 0x7fd2a80b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a806cfa0 0x7fd2a806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a806ef10 con 0x7fd2a8071bb0 2023-05-21T16:55:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a8159160 con 0x7fd2a80b3660 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ad111700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80cf0a0 con 0x7fd2a806cfa0 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2a8071bb0 0x7fd2a80cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2a8071bb0 0x7fd2a80cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60212/0 (socket says 172.21.15.46:60212) 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 -- 172.21.15.46:0/2603224080 learned_addr learned my addr 172.21.15.46:0/2603224080 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a77fe700 1 --2- 172.21.15.46:0/2603224080 >> v2:172.21.15.142:3300/0 conn(0x7fd2a80b3660 0x7fd2a80b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ac910700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a806cfa0 0x7fd2a806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 -- 172.21.15.46:0/2603224080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a806cfa0 msgr2=0x7fd2a806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a806cfa0 0x7fd2a806d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 -- 172.21.15.46:0/2603224080 >> v2:172.21.15.142:3300/0 conn(0x7fd2a80b3660 msgr2=0x7fd2a80b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 --2- 172.21.15.46:0/2603224080 >> v2:172.21.15.142:3300/0 conn(0x7fd2a80b3660 0x7fd2a80b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 -- 172.21.15.46:0/2603224080 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80ae9b0 con 0x7fd2a8071bb0 2023-05-21T16:55:17.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2ac910700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a806cfa0 0x7fd2a806d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.196+0000 7fd2a7fff700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a8071bb0 0x7fd2a80cfc60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80b1e50 tx=0x7fd29800ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6846a3ec4a4ed96c server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2a6ffd700 1 -- 172.21.15.46:0/2603224080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800cb70 con 0x7fd2a8071bb0 2023-05-21T16:55:17.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2a6ffd700 1 -- 172.21.15.46:0/2603224080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29800ccd0 con 0x7fd2a8071bb0 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2a6ffd700 1 -- 172.21.15.46:0/2603224080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298018620 con 0x7fd2a8071bb0 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 -- 172.21.15.46:0/2603224080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a8071bb0 msgr2=0x7fd2a80cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a8071bb0 0x7fd2a80cfc60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80b1e50 tx=0x7fd29800ad90 comp rx=0 tx=0).stop 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 -- 172.21.15.46:0/2603224080 shutdown_connections 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a806cfa0 0x7fd2a806d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 --2- 172.21.15.46:0/2603224080 >> v2:172.21.15.142:3300/0 conn(0x7fd2a80b3660 0x7fd2a80b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 --2- 172.21.15.46:0/2603224080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a8071bb0 0x7fd2a80cfc60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 -- 172.21.15.46:0/2603224080 >> 172.21.15.46:0/2603224080 conn(0x7fd2a80cca00 msgr2=0x7fd2a80cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:17.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 -- 172.21.15.46:0/2603224080 shutdown_connections 2023-05-21T16:55:17.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 -- 172.21.15.46:0/2603224080 wait complete. 2023-05-21T16:55:17.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 Processor -- start 2023-05-21T16:55:17.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.200+0000 7fd2ad111700 1 -- start start 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2a806cfa0 0x7fd2a814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 0x7fd2a80c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a80c7fa0 0x7fd2a8159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a814cb70 con 0x7fd2a80b3660 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80c8830 con 0x7fd2a806cfa0 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80c8b10 con 0x7fd2a80c7fa0 2023-05-21T16:55:17.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 0x7fd2a80c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 0x7fd2a80c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60222/0 (socket says 172.21.15.46:60222) 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 -- 172.21.15.46:0/864599277 learned_addr learned my addr 172.21.15.46:0/864599277 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a7fff700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2a806cfa0 0x7fd2a814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ac910700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a80c7fa0 0x7fd2a8159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 -- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a80c7fa0 msgr2=0x7fd2a8159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a80c7fa0 0x7fd2a8159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 -- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2a806cfa0 msgr2=0x7fd2a814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2a806cfa0 0x7fd2a814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 -- 172.21.15.46:0/864599277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29800a710 con 0x7fd2a80b3660 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a77fe700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 0x7fd2a80c7a60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00d800 tx=0x7fd29c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0125f0 con 0x7fd2a80b3660 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c012750 con 0x7fd2a80b3660 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c012ac0 con 0x7fd2a80b3660 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a806e430 con 0x7fd2a80b3660 2023-05-21T16:55:17.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a80cedc0 con 0x7fd2a80b3660 2023-05-21T16:55:17.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.204+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a806e710 con 0x7fd2a80b3660 2023-05-21T16:55:17.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.208+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd29c012c20 con 0x7fd2a80b3660 2023-05-21T16:55:17.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.208+0000 7fd2a4ff9700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd2940662f0 0x7fd2940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.208+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd29c083aa0 con 0x7fd2a80b3660 2023-05-21T16:55:17.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.208+0000 7fd2a7fff700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd2940662f0 0x7fd2940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.208+0000 7fd2a7fff700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd2940662f0 0x7fd2940687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd29800aa00 tx=0x7fd29801b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.212+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd29c0511d0 con 0x7fd2a80b3660 2023-05-21T16:55:17.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.440+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd2a8067ac0 con 0x7fd2a80b3660 2023-05-21T16:55:17.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.448+0000 7fd2a4ff9700 1 -- 172.21.15.46:0/864599277 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd29c0547f0 con 0x7fd2a80b3660 2023-05-21T16:55:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd2940662f0 msgr2=0x7fd2940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd2940662f0 0x7fd2940687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd29800aa00 tx=0x7fd29801b040 comp rx=0 tx=0).stop 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 msgr2=0x7fd2a80c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 0x7fd2a80c7a60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00d800 tx=0x7fd29c00db10 comp rx=0 tx=0).stop 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 shutdown_connections 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd2940662f0 0x7fd2940687a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2a80c7fa0 0x7fd2a8159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2a80b3660 0x7fd2a80c7a60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 --2- 172.21.15.46:0/864599277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2a806cfa0 0x7fd2a814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 >> 172.21.15.46:0/864599277 conn(0x7fd2a80cca00 msgr2=0x7fd2a80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 shutdown_connections 2023-05-21T16:55:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.452+0000 7fd2ad111700 1 -- 172.21.15.46:0/864599277 wait complete. 2023-05-21T16:55:17.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-21T16:55:17.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013bfff700 1 Processor -- start 2023-05-21T16:55:17.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013bfff700 1 -- start start 2023-05-21T16:55:17.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f013c0cafc0 0x7f013c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013bfff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c1644f0 con 0x7f013c0ccc00 2023-05-21T16:55:17.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013bfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c164740 con 0x7f013c160aa0 2023-05-21T16:55:17.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c160e70 con 0x7f013c0cafc0 2023-05-21T16:55:17.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013a7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f013c0cafc0 0x7f013c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013b7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f013c0ccc00 0x7f013c0cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56830/0 (socket says 172.21.15.46:56830) 2023-05-21T16:55:17.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013b7fe700 1 -- 172.21.15.46:0/2820259487 learned_addr learned my addr 172.21.15.46:0/2820259487 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:17.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f0139ffb700 1 -- 172.21.15.46:0/2820259487 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135250248 0 0) 0x7f013c164740 con 0x7f013c160aa0 2023-05-21T16:55:17.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013a7fc700 1 -- 172.21.15.46:0/2820259487 >> v1:172.21.15.142:6789/0 conn(0x7f013c160aa0 legacy=0x7f013c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013a7fc700 1 -- 172.21.15.46:0/2820259487 >> v1:172.21.15.46:6789/0 conn(0x7f013c0ccc00 legacy=0x7f013c0cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013a7fc700 1 -- 172.21.15.46:0/2820259487 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c164a20 con 0x7f013c0cafc0 2023-05-21T16:55:17.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f013a7fc700 1 --2- 172.21.15.46:0/2820259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0cafc0 0x7f013c0cc6c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f012c009850 tx=0x7f012c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7a2e73b518e593 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f0139ffb700 1 -- 172.21.15.46:0/2820259487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c004230 con 0x7f013c0cafc0 2023-05-21T16:55:17.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f0139ffb700 1 -- 172.21.15.46:0/2820259487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c004390 con 0x7f013c0cafc0 2023-05-21T16:55:17.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.588+0000 7f0139ffb700 1 -- 172.21.15.46:0/2820259487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c0036c0 con 0x7f013c0cafc0 2023-05-21T16:55:17.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- 172.21.15.46:0/2820259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0cafc0 msgr2=0x7f013c0cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 --2- 172.21.15.46:0/2820259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0cafc0 0x7f013c0cc6c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f012c009850 tx=0x7f012c009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:17.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- 172.21.15.46:0/2820259487 shutdown_connections 2023-05-21T16:55:17.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 --2- 172.21.15.46:0/2820259487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0cafc0 0x7f013c0cc6c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- 172.21.15.46:0/2820259487 >> 172.21.15.46:0/2820259487 conn(0x7f013c06d8f0 msgr2=0x7f013c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:17.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- 172.21.15.46:0/2820259487 shutdown_connections 2023-05-21T16:55:17.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- 172.21.15.46:0/2820259487 wait complete. 2023-05-21T16:55:17.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 Processor -- start 2023-05-21T16:55:17.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- start start 2023-05-21T16:55:17.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0cafc0 0x7f013c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 0x7f013c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c160aa0 0x7f013c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c15b790 con 0x7f013c0ccc00 2023-05-21T16:55:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0b11f0 con 0x7f013c0cafc0 2023-05-21T16:55:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0b14d0 con 0x7f013c160aa0 2023-05-21T16:55:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.592+0000 7f013a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 0x7f013c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 0x7f013c0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60242/0 (socket says 172.21.15.46:60242) 2023-05-21T16:55:17.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 -- 172.21.15.46:0/126694815 learned_addr learned my addr 172.21.15.46:0/126694815 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:17.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013b7fe700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c160aa0 0x7f013c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013affd700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0cafc0 0x7f013c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 -- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c160aa0 msgr2=0x7f013c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c160aa0 0x7f013c0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 -- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0cafc0 msgr2=0x7f013c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0cafc0 0x7f013c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 -- 172.21.15.46:0/126694815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0094b0 con 0x7f013c0ccc00 2023-05-21T16:55:17.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013b7fe700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c160aa0 0x7f013c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013affd700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0cafc0 0x7f013c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013a7fc700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 0x7f013c0b07a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f012c0090b0 tx=0x7f012c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c011830 con 0x7f013c0ccc00 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c0119b0 con 0x7f013c0ccc00 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c011d60 con 0x7f013c0ccc00 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c164fe0 con 0x7f013c0ccc00 2023-05-21T16:55:17.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c164d00 con 0x7f013c0ccc00 2023-05-21T16:55:17.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c1652c0 con 0x7f013c0ccc00 2023-05-21T16:55:17.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f012c018050 con 0x7f013c0ccc00 2023-05-21T16:55:17.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f01337fe700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0120066320 0x7f01200687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f012c084630 con 0x7f013c0ccc00 2023-05-21T16:55:17.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.596+0000 7f013affd700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0120066320 0x7f01200687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.600+0000 7f013affd700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0120066320 0x7f01200687d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f01240012e0 tx=0x7f0124009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.608+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f012c051e90 con 0x7f013c0ccc00 2023-05-21T16:55:17.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.824+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f013c067ac0 con 0x7f013c0ccc00 2023-05-21T16:55:17.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.832+0000 7f01337fe700 1 -- 172.21.15.46:0/126694815 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f012c084020 con 0x7f013c0ccc00 2023-05-21T16:55:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0120066320 msgr2=0x7f01200687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0120066320 0x7f01200687d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f01240012e0 tx=0x7f0124009040 comp rx=0 tx=0).stop 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 msgr2=0x7f013c0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 0x7f013c0b07a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f012c0090b0 tx=0x7f012c004770 comp rx=0 tx=0).stop 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 shutdown_connections 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0120066320 0x7f01200687d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f013c160aa0 0x7f013c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f013c0ccc00 0x7f013c0b07a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 --2- 172.21.15.46:0/126694815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013c0cafc0 0x7f013c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 >> 172.21.15.46:0/126694815 conn(0x7f013c06d8f0 msgr2=0x7f013c0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 shutdown_connections 2023-05-21T16:55:17.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.836+0000 7f013bfff700 1 -- 172.21.15.46:0/126694815 wait complete. 2023-05-21T16:55:17.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 Processor -- start 2023-05-21T16:55:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- start start 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60c815d460 0x7f60c8070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f60c8070ad0 0x7f60c80ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c8159df0 con 0x7f60c8158d90 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c815a280 con 0x7f60c8070ad0 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c8070f10 con 0x7f60c815d460 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f60c8070ad0 0x7f60c80ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f60c8070ad0 0x7f60c80ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60248/0 (socket says 172.21.15.46:60248) 2023-05-21T16:55:17.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2120999344 learned_addr learned my addr 172.21.15.46:0/2120999344 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:17.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60c7fff700 1 --2- 172.21.15.46:0/2120999344 >> v2:172.21.15.142:3300/0 conn(0x7f60c815d460 0x7f60c8070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2120999344 >> v2:172.21.15.142:3300/0 conn(0x7f60c815d460 msgr2=0x7f60c8070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:17.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 --2- 172.21.15.46:0/2120999344 >> v2:172.21.15.142:3300/0 conn(0x7f60c815d460 0x7f60c8070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2120999344 >> v1:172.21.15.142:6789/0 conn(0x7f60c8158d90 legacy=0x7f60c80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2120999344 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c80cd730 con 0x7f60c8070ad0 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd0e7700 1 --2- 172.21.15.46:0/2120999344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c8070ad0 0x7f60c80ca580 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f60c806ba20 tx=0x7f60c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653366d08e7a19d2 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60c77fe700 1 -- 172.21.15.46:0/2120999344 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0011830 con 0x7f60c8070ad0 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60c77fe700 1 -- 172.21.15.46:0/2120999344 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0011990 con 0x7f60c8070ad0 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60c77fe700 1 -- 172.21.15.46:0/2120999344 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0011d20 con 0x7f60c8070ad0 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2120999344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c8070ad0 msgr2=0x7f60c80ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2120999344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c8070ad0 0x7f60c80ca580 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f60c806ba20 tx=0x7f60c0009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2120999344 shutdown_connections 2023-05-21T16:55:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2120999344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c8070ad0 0x7f60c80ca580 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2120999344 >> v2:172.21.15.142:3300/0 conn(0x7f60c815d460 0x7f60c8070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2120999344 >> 172.21.15.46:0/2120999344 conn(0x7f60c80cf720 msgr2=0x7f60c80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2120999344 shutdown_connections 2023-05-21T16:55:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.964+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2120999344 wait complete. 2023-05-21T16:55:17.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.968+0000 7f60cd8e8700 1 Processor -- start 2023-05-21T16:55:17.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.968+0000 7f60cd8e8700 1 -- start start 2023-05-21T16:55:17.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c8070ad0 0x7f60c80c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c8158d90 0x7f60c80b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 0x7f60c814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8165e50 con 0x7f60c815d460 2023-05-21T16:55:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80b3ef0 con 0x7f60c8070ad0 2023-05-21T16:55:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80b41d0 con 0x7f60c8158d90 2023-05-21T16:55:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 0x7f60c814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 0x7f60c814d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60256/0 (socket says 172.21.15.46:60256) 2023-05-21T16:55:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2501694288 learned_addr learned my addr 172.21.15.46:0/2501694288 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cc8e6700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c8070ad0 0x7f60c80c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c7fff700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c8158d90 0x7f60c80b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c8158d90 msgr2=0x7f60c80b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c8158d90 0x7f60c80b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c8070ad0 msgr2=0x7f60c80c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c8070ad0 0x7f60c80c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 -- 172.21.15.46:0/2501694288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0009570 con 0x7f60c815d460 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd0e7700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 0x7f60c814d550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f60c806e870 tx=0x7f60c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0004380 con 0x7f60c815d460 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c001f070 con 0x7f60c815d460 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c81597a0 con 0x7f60c815d460 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00036c0 con 0x7f60c815d460 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c81594c0 con 0x7f60c815d460 2023-05-21T16:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c8159a80 con 0x7f60c815d460 2023-05-21T16:55:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60c0021030 con 0x7f60c815d460 2023-05-21T16:55:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c57fa700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f60b4066320 0x7f60b40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.972+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f60c0084b80 con 0x7f60c815d460 2023-05-21T16:55:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.976+0000 7f60cc8e6700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f60b4066320 0x7f60b40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.976+0000 7f60cc8e6700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f60b4066320 0x7f60b40687d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0018a0 tx=0x7f60bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:17.980+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f60c0052500 con 0x7f60c815d460 2023-05-21T16:55:18.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.144+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60c8165f90 con 0x7f60c815d460 2023-05-21T16:55:18.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.144+0000 7f60c57fa700 1 -- 172.21.15.46:0/2501694288 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f60c8165f90 con 0x7f60c815d460 2023-05-21T16:55:18.148 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:18.148 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:15.073641+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f60b4066320 msgr2=0x7f60b40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f60b4066320 0x7f60b40687d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0018a0 tx=0x7f60bc009040 comp rx=0 tx=0).stop 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 msgr2=0x7f60c814d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 0x7f60c814d550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f60c806e870 tx=0x7f60c0004770 comp rx=0 tx=0).stop 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 shutdown_connections 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f60b4066320 0x7f60b40687d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c815d460 0x7f60c814d550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60c8158d90 0x7f60c80b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 --2- 172.21.15.46:0/2501694288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60c8070ad0 0x7f60c80c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 >> 172.21.15.46:0/2501694288 conn(0x7f60c80cf720 msgr2=0x7f60c80c2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 shutdown_connections 2023-05-21T16:55:18.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.148+0000 7f60cd8e8700 1 -- 172.21.15.46:0/2501694288 wait complete. 2023-05-21T16:55:18.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-21T16:55:18.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-21T16:55:18.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 Processor -- start 2023-05-21T16:55:18.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 -- start start 2023-05-21T16:55:18.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00b49e0 0x7f4ce00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ce00d18b0 0x7f4ce00d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00b5370 con 0x7f4ce015ca20 2023-05-21T16:55:18.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce00d0e60 con 0x7f4ce00d18b0 2023-05-21T16:55:18.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce7c8a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00d1420 con 0x7f4ce00b49e0 2023-05-21T16:55:18.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ce00d18b0 0x7f4ce00d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4ce00d18b0 0x7f4ce00d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60258/0 (socket says 172.21.15.46:60258) 2023-05-21T16:55:18.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 -- 172.21.15.46:0/3652603903 learned_addr learned my addr 172.21.15.46:0/3652603903 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:18.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce5225700 1 --2- 172.21.15.46:0/3652603903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00b49e0 0x7f4ce00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 -- 172.21.15.46:0/3652603903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00b49e0 msgr2=0x7f4ce00b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:18.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 --2- 172.21.15.46:0/3652603903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00b49e0 0x7f4ce00b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 -- 172.21.15.46:0/3652603903 >> v1:172.21.15.142:6789/0 conn(0x7f4ce015ca20 legacy=0x7f4ce006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 -- 172.21.15.46:0/3652603903 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00cd920 con 0x7f4ce00d18b0 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.280+0000 7f4ce6227700 1 --2- 172.21.15.46:0/3652603903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce00d18b0 0x7f4ce00d1d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009e50 tx=0x7f4cd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b7417001779121 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce4a24700 1 -- 172.21.15.46:0/3652603903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800e070 con 0x7f4ce00d18b0 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce4a24700 1 -- 172.21.15.46:0/3652603903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd800b910 con 0x7f4ce00d18b0 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce4a24700 1 -- 172.21.15.46:0/3652603903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800bcc0 con 0x7f4ce00d18b0 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/3652603903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce00d18b0 msgr2=0x7f4ce00d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/3652603903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce00d18b0 0x7f4ce00d1d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009e50 tx=0x7f4cd800b330 comp rx=0 tx=0).stop 2023-05-21T16:55:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/3652603903 shutdown_connections 2023-05-21T16:55:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/3652603903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce00d18b0 0x7f4ce00d1d20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/3652603903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00b49e0 0x7f4ce00b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/3652603903 >> 172.21.15.46:0/3652603903 conn(0x7f4ce006cd50 msgr2=0x7f4ce00d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/3652603903 shutdown_connections 2023-05-21T16:55:18.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/3652603903 wait complete. 2023-05-21T16:55:18.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 Processor -- start 2023-05-21T16:55:18.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.284+0000 7f4ce7c8a700 1 -- start start 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ce00b49e0 0x7f4ce01f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00d18b0 0x7f4ce01f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 0x7f4ce00d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c8a30 con 0x7f4ce015ca20 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce01f65e0 con 0x7f4ce00b49e0 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00c8420 con 0x7f4ce00d18b0 2023-05-21T16:55:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 0x7f4ce00d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 0x7f4ce00d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60268/0 (socket says 172.21.15.46:60268) 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 -- 172.21.15.46:0/1953967513 learned_addr learned my addr 172.21.15.46:0/1953967513 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce5a26700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ce00b49e0 0x7f4ce01f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce5225700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00d18b0 0x7f4ce01f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 -- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00d18b0 msgr2=0x7f4ce01f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00d18b0 0x7f4ce01f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 -- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ce00b49e0 msgr2=0x7f4ce01f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ce00b49e0 0x7f4ce01f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 -- 172.21.15.46:0/1953967513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8009b30 con 0x7f4ce015ca20 2023-05-21T16:55:18.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce6227700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 0x7f4ce00d1c80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4ce006d290 tx=0x7f4cd8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80048c0 con 0x7f4ce015ca20 2023-05-21T16:55:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd80092e0 con 0x7f4ce015ca20 2023-05-21T16:55:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce00d10b0 con 0x7f4ce015ca20 2023-05-21T16:55:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd801c660 con 0x7f4ce015ca20 2023-05-21T16:55:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce00cdc00 con 0x7f4ce015ca20 2023-05-21T16:55:18.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.288+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce00cd5b0 con 0x7f4ce015ca20 2023-05-21T16:55:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.292+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4cd801c7c0 con 0x7f4ce015ca20 2023-05-21T16:55:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.292+0000 7f4cd67fc700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4cc40662f0 0x7f4cc40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.292+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4cd8085570 con 0x7f4ce015ca20 2023-05-21T16:55:18.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.292+0000 7f4ce5a26700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4cc40662f0 0x7f4cc40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.292+0000 7f4ce5a26700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4cc40662f0 0x7f4cc40687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00b7fe0 tx=0x7f4cd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.300+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4cd8052d30 con 0x7f4ce015ca20 2023-05-21T16:55:18.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.464+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ce0074200 con 0x7f4ce015ca20 2023-05-21T16:55:18.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.464+0000 7f4cd67fc700 1 -- 172.21.15.46:0/1953967513 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cd8056350 con 0x7f4ce015ca20 2023-05-21T16:55:18.466 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-21T16:55:18.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4cc40662f0 msgr2=0x7f4cc40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4cc40662f0 0x7f4cc40687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00b7fe0 tx=0x7f4cd0009040 comp rx=0 tx=0).stop 2023-05-21T16:55:18.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 msgr2=0x7f4ce00d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 0x7f4ce00d1c80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4ce006d290 tx=0x7f4cd8004af0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 shutdown_connections 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4cc40662f0 0x7f4cc40687a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ce015ca20 0x7f4ce00d1c80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ce00d18b0 0x7f4ce01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 --2- 172.21.15.46:0/1953967513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ce00b49e0 0x7f4ce01f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 >> 172.21.15.46:0/1953967513 conn(0x7f4ce006cd50 msgr2=0x7f4ce00b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 shutdown_connections 2023-05-21T16:55:18.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.468+0000 7f4ce7c8a700 1 -- 172.21.15.46:0/1953967513 wait complete. 2023-05-21T16:55:18.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-21T16:55:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791ffff700 1 Processor -- start 2023-05-21T16:55:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791ffff700 1 -- start start 2023-05-21T16:55:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7920070250 0x7f792015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791ffff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792015efc0 con 0x7f7920070620 2023-05-21T16:55:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79200cb9a0 con 0x7f79200ccdd0 2023-05-21T16:55:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792006db30 con 0x7f7920070250 2023-05-21T16:55:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7920070620 0x7f792006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56842/0 (socket says 172.21.15.46:56842) 2023-05-21T16:55:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791f7fe700 1 -- 172.21.15.46:0/1262076256 learned_addr learned my addr 172.21.15.46:0/1262076256 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791effd700 1 --2- 172.21.15.46:0/1262076256 >> v2:172.21.15.142:3300/0 conn(0x7f7920070250 0x7f792015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334188312 0 0) 0x7f7918001490 con 0x7f7920070620 2023-05-21T16:55:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79080035d0 con 0x7f7920070620 2023-05-21T16:55:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705458216 0 0) 0x7f79200cb9a0 con 0x7f79200ccdd0 2023-05-21T16:55:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.600+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7918001490 con 0x7f79200ccdd0 2023-05-21T16:55:18.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3885556662 0 0) 0x7f79080035d0 con 0x7f7920070620 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 >> v2:172.21.15.142:3300/0 conn(0x7f7920070250 msgr2=0x7f792015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 --2- 172.21.15.46:0/1262076256 >> v2:172.21.15.142:3300/0 conn(0x7f7920070250 0x7f792015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 >> v1:172.21.15.142:6789/0 conn(0x7f79200ccdd0 legacy=0x7f79200b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792015a960 con 0x7f7920070620 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f7918001b80 con 0x7f7920070620 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 >> v1:172.21.15.46:6789/0 conn(0x7f7920070620 legacy=0x7f792006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7908003bb0 0x7f7908003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f7908004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7908005220 0x7f790800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792006db30 con 0x7f7908004870 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790800c080 con 0x7f7908005220 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790800c240 con 0x7f7908003bb0 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f7908004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791effd700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7908003bb0 0x7f7908003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791f7fe700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7908005220 0x7f790800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 -- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7908003bb0 msgr2=0x7f7908003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7908003bb0 0x7f7908003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 -- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7908005220 msgr2=0x7f790800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7908005220 0x7f790800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791f7fe700 1 -- 172.21.15.46:0/1262076256 reap_dead start 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 -- 172.21.15.46:0/1262076256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080035d0 con 0x7f7908004870 2023-05-21T16:55:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791e7fc700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f7908004ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7910001960 tx=0x7f79080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae5f36af20b8f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910001450 con 0x7f7908004870 2023-05-21T16:55:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910006aa0 con 0x7f7908004870 2023-05-21T16:55:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791dffb700 1 -- 172.21.15.46:0/1262076256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910006e50 con 0x7f7908004870 2023-05-21T16:55:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 -- 172.21.15.46:0/1262076256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 msgr2=0x7f7908004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f7908004ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7910001960 tx=0x7f79080058a0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 -- 172.21.15.46:0/1262076256 shutdown_connections 2023-05-21T16:55:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 --2- 172.21.15.46:0/1262076256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f7908004ce0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 -- 172.21.15.46:0/1262076256 >> 172.21.15.46:0/1262076256 conn(0x7f79200d0b80 msgr2=0x7f79200d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 -- 172.21.15.46:0/1262076256 shutdown_connections 2023-05-21T16:55:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.604+0000 7f791ffff700 1 -- 172.21.15.46:0/1262076256 wait complete. 2023-05-21T16:55:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.608+0000 7f791ffff700 1 Processor -- start 2023-05-21T16:55:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.608+0000 7f791ffff700 1 -- start start 2023-05-21T16:55:18.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f792014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f792014e980 0x7f79200b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200cab20 0x7f79200b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b5720 con 0x7f7908004870 2023-05-21T16:55:18.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c82b0 con 0x7f79200cab20 2023-05-21T16:55:18.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c7cf0 con 0x7f792014e980 2023-05-21T16:55:18.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f792014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f792014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60290/0 (socket says 172.21.15.46:60290) 2023-05-21T16:55:18.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 -- 172.21.15.46:0/3303625705 learned_addr learned my addr 172.21.15.46:0/3303625705 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:18.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791e7fc700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f792014e980 0x7f79200b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791f7fe700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200cab20 0x7f79200b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 -- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f792014e980 msgr2=0x7f79200b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f792014e980 0x7f79200b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 -- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200cab20 msgr2=0x7f79200b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200cab20 0x7f79200b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 -- 172.21.15.46:0/3303625705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200cb3e0 con 0x7f7908004870 2023-05-21T16:55:18.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791f7fe700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200cab20 0x7f79200b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:18.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.612+0000 7f791effd700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f792014ee80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f79140119d0 tx=0x7f7914011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011ec0 con 0x7f7908004870 2023-05-21T16:55:18.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914004240 con 0x7f7908004870 2023-05-21T16:55:18.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79200cd270 con 0x7f7908004870 2023-05-21T16:55:18.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79140045d0 con 0x7f7908004870 2023-05-21T16:55:18.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200cb6c0 con 0x7f7908004870 2023-05-21T16:55:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7920073cb0 con 0x7f7908004870 2023-05-21T16:55:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.616+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f791400f730 con 0x7f7908004870 2023-05-21T16:55:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.620+0000 7f79077fe700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f790c066320 0x7f790c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.620+0000 7f791e7fc700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f790c066320 0x7f790c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.620+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7914083d20 con 0x7f7908004870 2023-05-21T16:55:18.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.620+0000 7f791e7fc700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f790c066320 0x7f790c0687d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7910015040 tx=0x7f7910005040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.624+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7914054f80 con 0x7f7908004870 2023-05-21T16:55:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.788+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79200d0230 con 0x7f7908004870 2023-05-21T16:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.788+0000 7f79077fe700 1 -- 172.21.15.46:0/3303625705 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79140230a0 con 0x7f7908004870 2023-05-21T16:55:18.792 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-21T16:55:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f790c066320 msgr2=0x7f790c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f790c066320 0x7f790c0687d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7910015040 tx=0x7f7910005040 comp rx=0 tx=0).stop 2023-05-21T16:55:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 msgr2=0x7f792014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f792014ee80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f79140119d0 tx=0x7f7914011ce0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 shutdown_connections 2023-05-21T16:55:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f790c066320 0x7f790c0687d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200cab20 0x7f79200b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f792014e980 0x7f79200b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 --2- 172.21.15.46:0/3303625705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7908004870 0x7f792014ee80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 >> 172.21.15.46:0/3303625705 conn(0x7f79200d0b80 msgr2=0x7f792006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 shutdown_connections 2023-05-21T16:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.792+0000 7f791ffff700 1 -- 172.21.15.46:0/3303625705 wait complete. 2023-05-21T16:55:18.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-21T16:55:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe934f49700 1 Processor -- start 2023-05-21T16:55:18.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe934f49700 1 -- start start 2023-05-21T16:55:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe934f49700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe9300b5020 0x7fe9300cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe934f49700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300b8ea0 con 0x7fe9300b8ad0 2023-05-21T16:55:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe934f49700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300d09d0 con 0x7fe9300b5ce0 2023-05-21T16:55:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe934f49700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300d0cb0 con 0x7fe9300b5020 2023-05-21T16:55:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92f7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe9300b8ad0 0x7fe93006a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56856/0 (socket says 172.21.15.46:56856) 2023-05-21T16:55:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92f7fe700 1 -- 172.21.15.46:0/4056506511 learned_addr learned my addr 172.21.15.46:0/4056506511 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92ffff700 1 --2- 172.21.15.46:0/4056506511 >> v2:172.21.15.46:3300/0 conn(0x7fe9300b5020 0x7fe9300cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92e7fc700 1 -- 172.21.15.46:0/4056506511 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064744828 0 0) 0x7fe9300b8ea0 con 0x7fe9300b8ad0 2023-05-21T16:55:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92e7fc700 1 -- 172.21.15.46:0/4056506511 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9100035d0 con 0x7fe9300b8ad0 2023-05-21T16:55:18.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92ffff700 1 -- 172.21.15.46:0/4056506511 >> v1:172.21.15.142:6789/0 conn(0x7fe9300b5ce0 legacy=0x7fe9300b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92ffff700 1 -- 172.21.15.46:0/4056506511 >> v1:172.21.15.46:6789/0 conn(0x7fe9300b8ad0 legacy=0x7fe93006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92ffff700 1 -- 172.21.15.46:0/4056506511 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300cd4f0 con 0x7fe9300b5020 2023-05-21T16:55:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92ffff700 1 --2- 172.21.15.46:0/4056506511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cf310 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe928009850 tx=0x7fe928009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695f9ea163d23384 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92e7fc700 1 -- 172.21.15.46:0/4056506511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928011830 con 0x7fe9300b5020 2023-05-21T16:55:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92e7fc700 1 -- 172.21.15.46:0/4056506511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928011990 con 0x7fe9300b5020 2023-05-21T16:55:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.920+0000 7fe92e7fc700 1 -- 172.21.15.46:0/4056506511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928011d40 con 0x7fe9300b5020 2023-05-21T16:55:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 -- 172.21.15.46:0/4056506511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 msgr2=0x7fe9300cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 --2- 172.21.15.46:0/4056506511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cf310 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe928009850 tx=0x7fe928009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 -- 172.21.15.46:0/4056506511 shutdown_connections 2023-05-21T16:55:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 --2- 172.21.15.46:0/4056506511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cf310 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 -- 172.21.15.46:0/4056506511 >> 172.21.15.46:0/4056506511 conn(0x7fe9300d3ae0 msgr2=0x7fe9300cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 -- 172.21.15.46:0/4056506511 shutdown_connections 2023-05-21T16:55:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.924+0000 7fe934f49700 1 -- 172.21.15.46:0/4056506511 wait complete. 2023-05-21T16:55:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 Processor -- start 2023-05-21T16:55:18.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 -- start start 2023-05-21T16:55:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9300b5ce0 0x7fe930150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9300b8ad0 0x7fe930153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300cc420 con 0x7fe9300b5020 2023-05-21T16:55:18.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930150b60 con 0x7fe9300b8ad0 2023-05-21T16:55:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300cb7a0 con 0x7fe9300b5ce0 2023-05-21T16:55:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60306/0 (socket says 172.21.15.46:60306) 2023-05-21T16:55:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 -- 172.21.15.46:0/2497826777 learned_addr learned my addr 172.21.15.46:0/2497826777 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92ffff700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9300b8ad0 0x7fe930153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92effd700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9300b5ce0 0x7fe930150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 -- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9300b5ce0 msgr2=0x7fe930150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9300b5ce0 0x7fe930150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 -- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9300b8ad0 msgr2=0x7fe930153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9300b8ad0 0x7fe930153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 -- 172.21.15.46:0/2497826777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280094b0 con 0x7fe9300b5020 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92effd700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9300b5ce0 0x7fe930150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe92f7fe700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cb0e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe92000cbc0 tx=0x7fe92000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000a820 con 0x7fe9300b5020 2023-05-21T16:55:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92000a980 con 0x7fe9300b5020 2023-05-21T16:55:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9300cda70 con 0x7fe9300b5020 2023-05-21T16:55:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000ad10 con 0x7fe9300b5020 2023-05-21T16:55:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.928+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9300cd790 con 0x7fe9300b5020 2023-05-21T16:55:18.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.932+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe930167550 con 0x7fe9300b5020 2023-05-21T16:55:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.932+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe92001b3b0 con 0x7fe9300b5020 2023-05-21T16:55:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.932+0000 7fe927fff700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe9140662f0 0x7fe9140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.932+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe9200833f0 con 0x7fe9300b5020 2023-05-21T16:55:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.932+0000 7fe92effd700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe9140662f0 0x7fe9140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.932+0000 7fe92effd700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe9140662f0 0x7fe9140687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe930155020 tx=0x7fe918009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:18.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:18.940+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe920050c50 con 0x7fe9300b5020 2023-05-21T16:55:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.108+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe93006b3e0 con 0x7fe9300b5020 2023-05-21T16:55:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.108+0000 7fe927fff700 1 -- 172.21.15.46:0/2497826777 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe920054270 con 0x7fe9300b5020 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:19.111 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-05-21T16:55:19.112 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2023-05-21T16:55:19.112 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "rbd" 2023-05-21T16:55:19.112 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:19.112 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-05-21T16:55:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe9140662f0 msgr2=0x7fe9140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe9140662f0 0x7fe9140687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe930155020 tx=0x7fe918009040 comp rx=0 tx=0).stop 2023-05-21T16:55:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 msgr2=0x7fe9300cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cb0e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe92000cbc0 tx=0x7fe92000cbf0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 shutdown_connections 2023-05-21T16:55:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe9140662f0 0x7fe9140687a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9300b8ad0 0x7fe930153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9300b5ce0 0x7fe930150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 --2- 172.21.15.46:0/2497826777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9300b5020 0x7fe9300cb0e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 >> 172.21.15.46:0/2497826777 conn(0x7fe9300d3ae0 msgr2=0x7fe93006a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 shutdown_connections 2023-05-21T16:55:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.112+0000 7fe934f49700 1 -- 172.21.15.46:0/2497826777 wait complete. 2023-05-21T16:55:19.129 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-21T16:55:19.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-21T16:55:19.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 Processor -- start 2023-05-21T16:55:19.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 -- start start 2023-05-21T16:55:19.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f436015a830 0x7f436006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:19.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600c9cd0 0x7f43600ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:19.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436006b9d0 con 0x7f436006c760 2023-05-21T16:55:19.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436006b450 con 0x7f436015a830 2023-05-21T16:55:19.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f4364c5a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4360159a90 con 0x7f43600c9cd0 2023-05-21T16:55:19.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.252+0000 7f435effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f436015a830 0x7f436006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:19.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f436006c760 0x7f436015dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:47750/0 (socket says 172.21.15.46:47750) 2023-05-21T16:55:19.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435f7fe700 1 -- 172.21.15.46:0/3297966019 learned_addr learned my addr 172.21.15.46:0/3297966019 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:19.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600c9cd0 0x7f43600ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:19.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435effd700 1 -- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600c9cd0 msgr2=0x7f43600ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:19.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435effd700 1 --2- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600c9cd0 0x7f43600ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435effd700 1 -- 172.21.15.46:0/3297966019 >> v1:172.21.15.142:6789/0 conn(0x7f436006c760 legacy=0x7f436015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435effd700 1 -- 172.21.15.46:0/3297966019 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436006d070 con 0x7f436015a830 2023-05-21T16:55:19.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435effd700 1 --2- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436015a830 0x7f436006cb30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4350009880 tx=0x7f4350009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57604d5b896d8f2c server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:19.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435e7fc700 1 -- 172.21.15.46:0/3297966019 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350011830 con 0x7f436015a830 2023-05-21T16:55:19.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435e7fc700 1 -- 172.21.15.46:0/3297966019 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4350011990 con 0x7f436015a830 2023-05-21T16:55:19.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f435e7fc700 1 -- 172.21.15.46:0/3297966019 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350011d20 con 0x7f436015a830 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 -- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436015a830 msgr2=0x7f436006cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 --2- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436015a830 0x7f436006cb30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4350009880 tx=0x7f4350009b90 comp rx=0 tx=0).stop 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 -- 172.21.15.46:0/3297966019 shutdown_connections 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 --2- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43600c9cd0 0x7f43600ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 --2- 172.21.15.46:0/3297966019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436015a830 0x7f436006cb30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 -- 172.21.15.46:0/3297966019 >> 172.21.15.46:0/3297966019 conn(0x7f43600cf720 msgr2=0x7f43600cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:19.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 -- 172.21.15.46:0/3297966019 shutdown_connections 2023-05-21T16:55:19.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.256+0000 7f4364c5a700 1 -- 172.21.15.46:0/3297966019 wait complete. 2023-05-21T16:55:19.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 Processor -- start 2023-05-21T16:55:19.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 -- start start 2023-05-21T16:55:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436006c760 0x7f43600c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 0x7f43600ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f436015a830 0x7f43600b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360144c90 con 0x7f43600c9cd0 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43600aea90 con 0x7f436006c760 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43600b4090 con 0x7f436015a830 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 0x7f43600ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 0x7f43600ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60320/0 (socket says 172.21.15.46:60320) 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 -- 172.21.15.46:0/1710023121 learned_addr learned my addr 172.21.15.46:0/1710023121 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435f7fe700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436006c760 0x7f43600c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:19.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435ffff700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f436015a830 0x7f43600b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:19.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 -- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f436015a830 msgr2=0x7f43600b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f436015a830 0x7f43600b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 -- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436006c760 msgr2=0x7f43600c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436006c760 0x7f43600c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 -- 172.21.15.46:0/1710023121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500094b0 con 0x7f43600c9cd0 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435f7fe700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436006c760 0x7f43600c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f435effd700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 0x7f43600ae550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4350009bd0 tx=0x7f4350004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:19.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350004480 con 0x7f43600c9cd0 2023-05-21T16:55:19.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435001f070 con 0x7f43600c9cd0 2023-05-21T16:55:19.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360159d50 con 0x7f43600c9cd0 2023-05-21T16:55:19.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350003900 con 0x7f43600c9cd0 2023-05-21T16:55:19.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.260+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436006b6f0 con 0x7f43600c9cd0 2023-05-21T16:55:19.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.264+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436015a030 con 0x7f43600c9cd0 2023-05-21T16:55:19.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.264+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4350021030 con 0x7f43600c9cd0 2023-05-21T16:55:19.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.264+0000 7f4347fff700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f434c0662f0 0x7f434c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:19.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.264+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4350084ce0 con 0x7f43600c9cd0 2023-05-21T16:55:19.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.264+0000 7f435f7fe700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f434c0662f0 0x7f434c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:19.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.264+0000 7f435f7fe700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f434c0662f0 0x7f434c0687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4354005930 tx=0x7f4354009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:19.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.272+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f43500525e0 con 0x7f43600c9cd0 2023-05-21T16:55:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.440+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f43600733b0 con 0x7f43600c9cd0 2023-05-21T16:55:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.892+0000 7f4347fff700 1 -- 172.21.15.46:0/1710023121 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4350055c00 con 0x7f43600c9cd0 2023-05-21T16:55:19.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.900+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f434c0662f0 msgr2=0x7f434c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.900+0000 7f4364c5a700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f434c0662f0 0x7f434c0687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4354005930 tx=0x7f4354009040 comp rx=0 tx=0).stop 2023-05-21T16:55:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.900+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 msgr2=0x7f43600ae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.900+0000 7f4364c5a700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 0x7f43600ae550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4350009bd0 tx=0x7f4350004770 comp rx=0 tx=0).stop 2023-05-21T16:55:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 shutdown_connections 2023-05-21T16:55:19.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f434c0662f0 0x7f434c0687a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f436015a830 0x7f43600b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43600c9cd0 0x7f43600ae550 secure :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4350009bd0 tx=0x7f4350004770 comp rx=0 tx=0).stop 2023-05-21T16:55:19.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 --2- 172.21.15.46:0/1710023121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f436006c760 0x7f43600c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:19.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 >> 172.21.15.46:0/1710023121 conn(0x7f43600cf720 msgr2=0x7f4360152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:19.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.904+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 shutdown_connections 2023-05-21T16:55:19.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:19.908+0000 7f4364c5a700 1 -- 172.21.15.46:0/1710023121 wait complete. 2023-05-21T16:55:19.911 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-05-21T16:55:19.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-21T16:55:20.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.048+0000 7fedb53a3700 1 Processor -- start 2023-05-21T16:55:20.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.048+0000 7fedb53a3700 1 -- start start 2023-05-21T16:55:20.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedb00b4800 0x7fedb00b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedb00d1ac0 0x7fedb00b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb00d0d00 con 0x7fedb00b6110 2023-05-21T16:55:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb0161520 con 0x7fedb00b4800 2023-05-21T16:55:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb00d0fe0 con 0x7fedb00d1ac0 2023-05-21T16:55:20.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedb00b4800 0x7fedb00b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb4ba2700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fedb00b6110 0x7fedb01607b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56858/0 (socket says 172.21.15.46:56858) 2023-05-21T16:55:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb4ba2700 1 -- 172.21.15.46:0/2129679660 learned_addr learned my addr 172.21.15.46:0/2129679660 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7feda77fe700 1 --2- 172.21.15.46:0/2129679660 >> v2:172.21.15.142:3300/0 conn(0x7fedb00d1ac0 0x7fedb00b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:20.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fedb00b4800 0x7fedb00b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60334/0 (socket says 172.21.15.46:60334) 2023-05-21T16:55:20.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 -- 172.21.15.46:0/2129679660 >> v2:172.21.15.142:3300/0 conn(0x7fedb00d1ac0 msgr2=0x7fedb00b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:20.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 --2- 172.21.15.46:0/2129679660 >> v2:172.21.15.142:3300/0 conn(0x7fedb00d1ac0 0x7fedb00b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 -- 172.21.15.46:0/2129679660 >> v1:172.21.15.46:6789/0 conn(0x7fedb00b6110 legacy=0x7fedb01607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:20.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaf7fe700 1 -- 172.21.15.46:0/2129679660 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006934945 0 0) 0x7fedb00d0d00 con 0x7fedb00b6110 2023-05-21T16:55:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 -- 172.21.15.46:0/2129679660 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb00d12c0 con 0x7fedb00b4800 2023-05-21T16:55:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7feda77fe700 1 --2- 172.21.15.46:0/2129679660 >> v2:172.21.15.142:3300/0 conn(0x7fedb00d1ac0 0x7fedb00b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaffff700 1 --2- 172.21.15.46:0/2129679660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00b4800 0x7fedb00b4bd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fedb00ce8f0 tx=0x7feda0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e66f7989a7bec3 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaf7fe700 1 -- 172.21.15.46:0/2129679660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0011830 con 0x7fedb00b4800 2023-05-21T16:55:20.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaf7fe700 1 -- 172.21.15.46:0/2129679660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0011990 con 0x7fedb00b4800 2023-05-21T16:55:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedaf7fe700 1 -- 172.21.15.46:0/2129679660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0011d20 con 0x7fedb00b4800 2023-05-21T16:55:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 -- 172.21.15.46:0/2129679660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00b4800 msgr2=0x7fedb00b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:20.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.052+0000 7fedb53a3700 1 --2- 172.21.15.46:0/2129679660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00b4800 0x7fedb00b4bd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fedb00ce8f0 tx=0x7feda0009b30 comp rx=0 tx=0).stop 2023-05-21T16:55:20.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 -- 172.21.15.46:0/2129679660 shutdown_connections 2023-05-21T16:55:20.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 --2- 172.21.15.46:0/2129679660 >> v2:172.21.15.142:3300/0 conn(0x7fedb00d1ac0 0x7fedb00b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 --2- 172.21.15.46:0/2129679660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00b4800 0x7fedb00b4bd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 -- 172.21.15.46:0/2129679660 >> 172.21.15.46:0/2129679660 conn(0x7fedb006c170 msgr2=0x7fedb006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:20.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 -- 172.21.15.46:0/2129679660 shutdown_connections 2023-05-21T16:55:20.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 -- 172.21.15.46:0/2129679660 wait complete. 2023-05-21T16:55:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 Processor -- start 2023-05-21T16:55:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.056+0000 7fedb53a3700 1 -- start start 2023-05-21T16:55:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00b4800 0x7fedb00c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00b6110 0x7fedb01f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 0x7fedb0159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:20.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00c7f30 con 0x7fedb00d1ac0 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00c6ec0 con 0x7fedb00b4800 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb015cea0 con 0x7fedb00b6110 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 0x7fedb0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 0x7fedb0159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60346/0 (socket says 172.21.15.46:60346) 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 -- 172.21.15.46:0/189052239 learned_addr learned my addr 172.21.15.46:0/189052239 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedaffff700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00b4800 0x7fedb00c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:20.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7feda77fe700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00b6110 0x7fedb01f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 -- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00b6110 msgr2=0x7fedb01f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00b6110 0x7fedb01f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 -- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00b4800 msgr2=0x7fedb00c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00b4800 0x7fedb00c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 -- 172.21.15.46:0/189052239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98009450 con 0x7fedb00d1ac0 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb4ba2700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 0x7fedb0159720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feda800cca0 tx=0x7feda800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800ab70 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800acd0 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda00094b0 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8007310 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb00b5110 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.060+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb00d15a0 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.064+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feda8007470 con 0x7fedb00d1ac0 2023-05-21T16:55:20.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.064+0000 7fedad7fa700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fed90066320 0x7fed900687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:20.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.064+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7feda8083830 con 0x7fedb00d1ac0 2023-05-21T16:55:20.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.064+0000 7fedaffff700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fed90066320 0x7fed900687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:20.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.064+0000 7fedaffff700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fed90066320 0x7fed900687d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feda0000c00 tx=0x7feda0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:20.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.072+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feda8050f20 con 0x7fedb00d1ac0 2023-05-21T16:55:20.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.236+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fedb00b6590 con 0x7fedb00d1ac0 2023-05-21T16:55:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.900+0000 7fedad7fa700 1 -- 172.21.15.46:0/189052239 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7feda80180d0 con 0x7fedb00d1ac0 2023-05-21T16:55:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fed90066320 msgr2=0x7fed900687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fed90066320 0x7fed900687d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feda0000c00 tx=0x7feda0008030 comp rx=0 tx=0).stop 2023-05-21T16:55:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 msgr2=0x7fedb0159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 0x7fedb0159720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feda800cca0 tx=0x7feda800a060 comp rx=0 tx=0).stop 2023-05-21T16:55:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 shutdown_connections 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fed90066320 0x7fed900687d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedb00d1ac0 0x7fedb0159720 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedb00b6110 0x7fedb01f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 --2- 172.21.15.46:0/189052239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedb00b4800 0x7fedb00c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 >> 172.21.15.46:0/189052239 conn(0x7fedb006c170 msgr2=0x7fedb00cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 shutdown_connections 2023-05-21T16:55:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:20.924+0000 7fedb53a3700 1 -- 172.21.15.46:0/189052239 wait complete. 2023-05-21T16:55:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-05-21T16:55:20.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-21T16:55:21.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.068+0000 7fe2dd0da700 1 Processor -- start 2023-05-21T16:55:21.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.068+0000 7fe2dd0da700 1 -- start start 2023-05-21T16:55:21.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d80b4f90 0x7fe2d80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 0x7fe2d8160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80cdab0 con 0x7fe2d815c760 2023-05-21T16:55:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d8161300 con 0x7fe2d80d28c0 2023-05-21T16:55:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80cf030 con 0x7fe2d80b4f90 2023-05-21T16:55:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dc8d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 0x7fe2d8160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d80b4f90 0x7fe2d80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d7fff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe2d815c760 0x7fe2d80b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:47758/0 (socket says 172.21.15.46:47758) 2023-05-21T16:55:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d7fff700 1 -- 172.21.15.46:0/4249924695 learned_addr learned my addr 172.21.15.46:0/4249924695 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dc8d9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 0x7fe2d8160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:38994/0 (socket says 172.21.15.46:38994) 2023-05-21T16:55:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d77fe700 1 -- 172.21.15.46:0/4249924695 >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 msgr2=0x7fe2d8160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d77fe700 1 --2- 172.21.15.46:0/4249924695 >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 0x7fe2d8160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d77fe700 1 -- 172.21.15.46:0/4249924695 >> v1:172.21.15.142:6789/0 conn(0x7fe2d815c760 legacy=0x7fe2d80b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d77fe700 1 -- 172.21.15.46:0/4249924695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80cf2d0 con 0x7fe2d80b4f90 2023-05-21T16:55:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dc8d9700 1 --2- 172.21.15.46:0/4249924695 >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 0x7fe2d8160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:21.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d77fe700 1 --2- 172.21.15.46:0/4249924695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d80b4f90 0x7fe2d80b5c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009850 tx=0x7fe2c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c124eb5db9230a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d6ffd700 1 -- 172.21.15.46:0/4249924695 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011830 con 0x7fe2d80b4f90 2023-05-21T16:55:21.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d6ffd700 1 -- 172.21.15.46:0/4249924695 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8011990 con 0x7fe2d80b4f90 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2d6ffd700 1 -- 172.21.15.46:0/4249924695 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011d40 con 0x7fe2d80b4f90 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- 172.21.15.46:0/4249924695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d80b4f90 msgr2=0x7fe2d80b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/4249924695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d80b4f90 0x7fe2d80b5c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009850 tx=0x7fe2c8009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- 172.21.15.46:0/4249924695 shutdown_connections 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/4249924695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d80b4f90 0x7fe2d80b5c30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/4249924695 >> v2:172.21.15.142:3300/0 conn(0x7fe2d80d28c0 0x7fe2d8160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- 172.21.15.46:0/4249924695 >> 172.21.15.46:0/4249924695 conn(0x7fe2d80d2e00 msgr2=0x7fe2d80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:21.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- 172.21.15.46:0/4249924695 shutdown_connections 2023-05-21T16:55:21.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.072+0000 7fe2dd0da700 1 -- 172.21.15.46:0/4249924695 wait complete. 2023-05-21T16:55:21.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 Processor -- start 2023-05-21T16:55:21.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 -- start start 2023-05-21T16:55:21.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d80b4f90 0x7fe2d81f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 0x7fe2d80c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d815c760 0x7fe2d81f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c99f0 con 0x7fe2d80d28c0 2023-05-21T16:55:21.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c9560 con 0x7fe2d80b4f90 2023-05-21T16:55:21.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c8c30 con 0x7fe2d815c760 2023-05-21T16:55:21.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 0x7fe2d80c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 0x7fe2d80c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60360/0 (socket says 172.21.15.46:60360) 2023-05-21T16:55:21.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 -- 172.21.15.46:0/3012574799 learned_addr learned my addr 172.21.15.46:0/3012574799 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d7fff700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d80b4f90 0x7fe2d81f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dc8d9700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d815c760 0x7fe2d81f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 -- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d815c760 msgr2=0x7fe2d81f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d815c760 0x7fe2d81f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 -- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d80b4f90 msgr2=0x7fe2d81f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d80b4f90 0x7fe2d81f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 -- 172.21.15.46:0/3012574799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009a70 con 0x7fe2d80d28c0 2023-05-21T16:55:21.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d77fe700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 0x7fe2d80c6b10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80090b0 tx=0x7fe2c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8004480 con 0x7fe2d80d28c0 2023-05-21T16:55:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c801f070 con 0x7fe2d80d28c0 2023-05-21T16:55:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c80094b0 con 0x7fe2d80d28c0 2023-05-21T16:55:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8003900 con 0x7fe2d80d28c0 2023-05-21T16:55:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.076+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80cd460 con 0x7fe2d80d28c0 2023-05-21T16:55:21.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.080+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d80cf5b0 con 0x7fe2d80d28c0 2023-05-21T16:55:21.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.080+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2c8021030 con 0x7fe2d80d28c0 2023-05-21T16:55:21.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.080+0000 7fe2d4ff9700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2b80662f0 0x7fe2b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.080+0000 7fe2d7fff700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2b80662f0 0x7fe2b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.080+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe2c80854c0 con 0x7fe2d80d28c0 2023-05-21T16:55:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.084+0000 7fe2d7fff700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2b80662f0 0x7fe2b80687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0005930 tx=0x7fe2c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.088+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe2c8052990 con 0x7fe2d80d28c0 2023-05-21T16:55:21.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.288+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe2d80cd710 con 0x7fe2d80d28c0 2023-05-21T16:55:21.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.308+0000 7fe2d4ff9700 1 -- 172.21.15.46:0/3012574799 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe2c8055fb0 con 0x7fe2d80d28c0 2023-05-21T16:55:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2b80662f0 msgr2=0x7fe2b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2b80662f0 0x7fe2b80687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0005930 tx=0x7fe2c0009040 comp rx=0 tx=0).stop 2023-05-21T16:55:21.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 msgr2=0x7fe2d80c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 0x7fe2d80c6b10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80090b0 tx=0x7fe2c8004770 comp rx=0 tx=0).stop 2023-05-21T16:55:21.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 shutdown_connections 2023-05-21T16:55:21.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fe2b80662f0 0x7fe2b80687a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d815c760 0x7fe2d81f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2d80d28c0 0x7fe2d80c6b10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 --2- 172.21.15.46:0/3012574799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d80b4f90 0x7fe2d81f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.320+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 >> 172.21.15.46:0/3012574799 conn(0x7fe2d80d2e00 msgr2=0x7fe2d80cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.324+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 shutdown_connections 2023-05-21T16:55:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.324+0000 7fe2dd0da700 1 -- 172.21.15.46:0/3012574799 wait complete. 2023-05-21T16:55:21.327 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 5 and data pool 6 2023-05-21T16:55:21.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:21.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.440+0000 7f8a191a0700 1 Processor -- start 2023-05-21T16:55:21.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.440+0000 7f8a191a0700 1 -- start start 2023-05-21T16:55:21.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a140b8ad0 0x7f8a140cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a140b5ce0 0x7f8a1406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a140b8ea0 con 0x7f8a140b4910 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140d09d0 con 0x7f8a140b8ad0 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140d0cb0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a140b8ad0 0x7f8a140cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8a140b8ad0 0x7f8a140cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60364/0 (socket says 172.21.15.46:60364) 2023-05-21T16:55:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a1899f700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8a140b4910 0x7f8a141601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56868/0 (socket says 172.21.15.46:56868) 2023-05-21T16:55:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 -- 172.21.15.46:0/3757988830 learned_addr learned my addr 172.21.15.46:0/3757988830 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a137fe700 1 --2- 172.21.15.46:0/3757988830 >> v2:172.21.15.142:3300/0 conn(0x7f8a140b5ce0 0x7f8a1406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 -- 172.21.15.46:0/3757988830 >> v2:172.21.15.142:3300/0 conn(0x7f8a140b5ce0 msgr2=0x7f8a1406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 --2- 172.21.15.46:0/3757988830 >> v2:172.21.15.142:3300/0 conn(0x7f8a140b5ce0 0x7f8a1406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 -- 172.21.15.46:0/3757988830 >> v1:172.21.15.46:6789/0 conn(0x7f8a140b4910 legacy=0x7f8a141601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a12ffd700 1 -- 172.21.15.46:0/3757988830 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694842720 0 0) 0x7f8a140b8ea0 con 0x7f8a140b4910 2023-05-21T16:55:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 -- 172.21.15.46:0/3757988830 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140cd4f0 con 0x7f8a140b8ad0 2023-05-21T16:55:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a137fe700 1 --2- 172.21.15.46:0/3757988830 >> v2:172.21.15.142:3300/0 conn(0x7f8a140b5ce0 0x7f8a1406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a13fff700 1 --2- 172.21.15.46:0/3757988830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b8ad0 0x7f8a140cf310 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8a14160120 tx=0x7f8a04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7488a7f19fd327 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a12ffd700 1 -- 172.21.15.46:0/3757988830 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400b8a0 con 0x7f8a140b8ad0 2023-05-21T16:55:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a12ffd700 1 -- 172.21.15.46:0/3757988830 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0400ba00 con 0x7f8a140b8ad0 2023-05-21T16:55:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a12ffd700 1 -- 172.21.15.46:0/3757988830 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400bd90 con 0x7f8a140b8ad0 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- 172.21.15.46:0/3757988830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b8ad0 msgr2=0x7f8a140cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 --2- 172.21.15.46:0/3757988830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b8ad0 0x7f8a140cf310 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8a14160120 tx=0x7f8a04009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- 172.21.15.46:0/3757988830 shutdown_connections 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 --2- 172.21.15.46:0/3757988830 >> v2:172.21.15.142:3300/0 conn(0x7f8a140b5ce0 0x7f8a1406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 --2- 172.21.15.46:0/3757988830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b8ad0 0x7f8a140cf310 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- 172.21.15.46:0/3757988830 >> 172.21.15.46:0/3757988830 conn(0x7f8a140d3ae0 msgr2=0x7f8a140cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:21.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- 172.21.15.46:0/3757988830 shutdown_connections 2023-05-21T16:55:21.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.444+0000 7f8a191a0700 1 -- 172.21.15.46:0/3757988830 wait complete. 2023-05-21T16:55:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 Processor -- start 2023-05-21T16:55:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 -- start start 2023-05-21T16:55:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a140b4910 0x7f8a14148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 0x7f8a1414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a140b8ad0 0x7f8a1414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1414a880 con 0x7f8a140b5ce0 2023-05-21T16:55:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1414c5f0 con 0x7f8a140b4910 2023-05-21T16:55:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a14149c00 con 0x7f8a140b8ad0 2023-05-21T16:55:21.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 0x7f8a1414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a140b4910 0x7f8a14148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 0x7f8a1414c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60376/0 (socket says 172.21.15.46:60376) 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a140b4910 0x7f8a14148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39012/0 (socket says 172.21.15.46:39012) 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a1899f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a140b8ad0 0x7f8a1414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a13fff700 1 -- 172.21.15.46:0/828558052 learned_addr learned my addr 172.21.15.46:0/828558052 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 -- 172.21.15.46:0/828558052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a140b8ad0 msgr2=0x7f8a1414aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a140b8ad0 0x7f8a1414aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 -- 172.21.15.46:0/828558052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a140b4910 msgr2=0x7f8a14148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a140b4910 0x7f8a14148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 -- 172.21.15.46:0/828558052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009570 con 0x7f8a140b5ce0 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a137fe700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 0x7f8a1414c0b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c7f0 tx=0x7f8a0800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08004220 con 0x7f8a140b5ce0 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140cda70 con 0x7f8a140b5ce0 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08004380 con 0x7f8a140b5ce0 2023-05-21T16:55:21.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080036c0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.448+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a140cd790 con 0x7f8a140b5ce0 2023-05-21T16:55:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.452+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a08003820 con 0x7f8a140b5ce0 2023-05-21T16:55:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.452+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1406aed0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.452+0000 7f8a10ff9700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a000662f0 0x7f8a000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.452+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a080837a0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.452+0000 7f8a13fff700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a000662f0 0x7f8a000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.456+0000 7f8a13fff700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a000662f0 0x7f8a000687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009150 tx=0x7f8a04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.460+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8a08050ba0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a1414a9c0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a10ff9700 1 -- 172.21.15.46:0/828558052 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f8a1414a9c0 con 0x7f8a140b5ce0 2023-05-21T16:55:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:21.630 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:21.292813+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:55:19.482721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-21T16:55:20.275924+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:21.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a000662f0 msgr2=0x7f8a000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a000662f0 0x7f8a000687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009150 tx=0x7f8a04008030 comp rx=0 tx=0).stop 2023-05-21T16:55:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 msgr2=0x7f8a1414c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 0x7f8a1414c0b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c7f0 tx=0x7f8a0800cb00 comp rx=0 tx=0).stop 2023-05-21T16:55:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 shutdown_connections 2023-05-21T16:55:21.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8a000662f0 0x7f8a000687a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a140b8ad0 0x7f8a1414aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a140b5ce0 0x7f8a1414c0b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.628+0000 7f8a191a0700 1 --2- 172.21.15.46:0/828558052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a140b4910 0x7f8a14148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.632+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 >> 172.21.15.46:0/828558052 conn(0x7f8a140d3ae0 msgr2=0x7f8a140b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.632+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 shutdown_connections 2023-05-21T16:55:21.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.632+0000 7f8a191a0700 1 -- 172.21.15.46:0/828558052 wait complete. 2023-05-21T16:55:21.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:21.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.756+0000 7fd89d0ca700 1 Processor -- start 2023-05-21T16:55:21.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.756+0000 7fd89d0ca700 1 -- start start 2023-05-21T16:55:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd89806c760 0x7fd8980caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd89815e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89815aea0 con 0x7fd898154de0 2023-05-21T16:55:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89815ac20 con 0x7fd89806c760 2023-05-21T16:55:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd898071790 con 0x7fd89815e210 2023-05-21T16:55:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd897fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd898154de0 0x7fd89815b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56882/0 (socket says 172.21.15.46:56882) 2023-05-21T16:55:21.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd897fff700 1 -- 172.21.15.46:0/2177135186 learned_addr learned my addr 172.21.15.46:0/2177135186 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:21.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 --2- 172.21.15.46:0/2177135186 >> v2:172.21.15.142:3300/0 conn(0x7fd89806c760 0x7fd8980caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89c8c9700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd89815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678396044 0 0) 0x7fd89815aea0 con 0x7fd898154de0 2023-05-21T16:55:21.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8800035d0 con 0x7fd898154de0 2023-05-21T16:55:21.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076041021 0 0) 0x7fd8800035d0 con 0x7fd898154de0 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 msgr2=0x7fd89815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd89815e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 >> v2:172.21.15.142:3300/0 conn(0x7fd89806c760 msgr2=0x7fd8980caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 --2- 172.21.15.46:0/2177135186 >> v2:172.21.15.142:3300/0 conn(0x7fd89806c760 0x7fd8980caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89806cdd0 con 0x7fd898154de0 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7fd88c001670 con 0x7fd898154de0 2023-05-21T16:55:21.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 --2- 172.21.15.46:0/2177135186 >> v2:172.21.15.142:3300/0 conn(0x7fd89806c760 0x7fd8980caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 >> v1:172.21.15.46:6789/0 conn(0x7fd898154de0 legacy=0x7fd89815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880003a20 0x7fd880003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880004450 0x7fd880004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd880004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898071790 con 0x7fd880004450 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd880005720 con 0x7fd880003a20 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88000bab0 con 0x7fd89815e210 2023-05-21T16:55:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880004450 0x7fd880004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd897fff700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880003a20 0x7fd880003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89c8c9700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd880004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 -- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 msgr2=0x7fd880004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd880004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 -- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880003a20 msgr2=0x7fd880003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880003a20 0x7fd880003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 -- 172.21.15.46:0/2177135186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800035d0 con 0x7fd880004450 2023-05-21T16:55:21.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89c8c9700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd89815e210 0x7fd880004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:21.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd8977fe700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880004450 0x7fd880004910 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd88800e350 tx=0x7fd8800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac46bbbffe884367 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800edf0 con 0x7fd880004450 2023-05-21T16:55:21.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800f040 con 0x7fd880004450 2023-05-21T16:55:21.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd896ffd700 1 -- 172.21.15.46:0/2177135186 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880146a0 con 0x7fd880004450 2023-05-21T16:55:21.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- 172.21.15.46:0/2177135186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880004450 msgr2=0x7fd880004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/2177135186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880004450 0x7fd880004910 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd88800e350 tx=0x7fd8800058a0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89c8c9700 1 -- 172.21.15.46:0/2177135186 reap_dead start 2023-05-21T16:55:21.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- 172.21.15.46:0/2177135186 shutdown_connections 2023-05-21T16:55:21.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- 172.21.15.46:0/2177135186 >> 172.21.15.46:0/2177135186 conn(0x7fd8980cf720 msgr2=0x7fd8980cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:21.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- 172.21.15.46:0/2177135186 shutdown_connections 2023-05-21T16:55:21.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.760+0000 7fd89d0ca700 1 -- 172.21.15.46:0/2177135186 wait complete. 2023-05-21T16:55:21.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 Processor -- start 2023-05-21T16:55:21.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 -- start start 2023-05-21T16:55:21.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880004450 0x7fd898153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 0x7fd8980c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8980b0700 0x7fd8980b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898153a70 con 0x7fd8980c7e40 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980b10b0 con 0x7fd880004450 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980c95d0 con 0x7fd8980b0700 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 0x7fd8980c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 0x7fd8980c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60392/0 (socket says 172.21.15.46:60392) 2023-05-21T16:55:21.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 -- 172.21.15.46:0/3559689476 learned_addr learned my addr 172.21.15.46:0/3559689476 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:21.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd897fff700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880004450 0x7fd898153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89c8c9700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8980b0700 0x7fd8980b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 -- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8980b0700 msgr2=0x7fd8980b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8980b0700 0x7fd8980b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 -- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880004450 msgr2=0x7fd898153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880004450 0x7fd898153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 -- 172.21.15.46:0/3559689476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89806d390 con 0x7fd8980c7e40 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89c8c9700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8980b0700 0x7fd8980b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd8977fe700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 0x7fd8980c82b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd888003f40 tx=0x7fd888009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888004550 con 0x7fd8980c7e40 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880046d0 con 0x7fd8980c7e40 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89806d0b0 con 0x7fd8980c7e40 2023-05-21T16:55:21.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888014480 con 0x7fd8980c7e40 2023-05-21T16:55:21.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.764+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89815ba40 con 0x7fd8980c7e40 2023-05-21T16:55:21.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.768+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8980733b0 con 0x7fd8980c7e40 2023-05-21T16:55:21.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.768+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8880145e0 con 0x7fd8980c7e40 2023-05-21T16:55:21.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.768+0000 7fd894ff9700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8840662f0 0x7fd8840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:21.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.768+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd888086490 con 0x7fd8980c7e40 2023-05-21T16:55:21.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.768+0000 7fd897fff700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8840662f0 0x7fd8840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:21.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.768+0000 7fd897fff700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8840662f0 0x7fd8840687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0015d0 tx=0x7fd88c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:21.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.772+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd888053880 con 0x7fd8980c7e40 2023-05-21T16:55:21.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.936+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8980c9710 con 0x7fd8980c7e40 2023-05-21T16:55:21.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.940+0000 7fd894ff9700 1 -- 172.21.15.46:0/3559689476 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18364 (secure 0 0 0) 0x7fd888009de0 con 0x7fd8980c7e40 2023-05-21T16:55:21.944 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:21.945 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:21.292813+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:55:19.482721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-21T16:55:20.275924+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8840662f0 msgr2=0x7fd8840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8840662f0 0x7fd8840687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0015d0 tx=0x7fd88c009040 comp rx=0 tx=0).stop 2023-05-21T16:55:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 msgr2=0x7fd8980c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 0x7fd8980c82b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd888003f40 tx=0x7fd888009750 comp rx=0 tx=0).stop 2023-05-21T16:55:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 shutdown_connections 2023-05-21T16:55:21.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd8840662f0 0x7fd8840687a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8980b0700 0x7fd8980b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8980c7e40 0x7fd8980c82b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 --2- 172.21.15.46:0/3559689476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd880004450 0x7fd898153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 >> 172.21.15.46:0/3559689476 conn(0x7fd8980cf720 msgr2=0x7fd898158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 shutdown_connections 2023-05-21T16:55:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:21.944+0000 7fd89d0ca700 1 -- 172.21.15.46:0/3559689476 wait complete. 2023-05-21T16:55:21.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-21T16:55:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 Processor -- start 2023-05-21T16:55:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 -- start start 2023-05-21T16:55:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4dc006eac0 0x7f4dc00c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00cac10 con 0x7f4dc00cd800 2023-05-21T16:55:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc00cdff0 con 0x7f4dc006eac0 2023-05-21T16:55:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc5292700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00ce200 con 0x7f4dc0142c60 2023-05-21T16:55:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4dc006eac0 0x7f4dc00c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4dc006eac0 0x7f4dc00c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60406/0 (socket says 172.21.15.46:60406) 2023-05-21T16:55:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 -- 172.21.15.46:0/67960899 learned_addr learned my addr 172.21.15.46:0/67960899 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dbffff700 1 --2- 172.21.15.46:0/67960899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 -- 172.21.15.46:0/67960899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 msgr2=0x7f4dc00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 --2- 172.21.15.46:0/67960899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc00ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 -- 172.21.15.46:0/67960899 >> v1:172.21.15.142:6789/0 conn(0x7f4dc00cd800 legacy=0x7f4dc006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 -- 172.21.15.46:0/67960899 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00ce4e0 con 0x7f4dc006eac0 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.080+0000 7f4dc4a91700 1 --2- 172.21.15.46:0/67960899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc006eac0 0x7f4dc00c4680 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009e50 tx=0x7f4db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcbda9b19cb8416 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dbeffd700 1 -- 172.21.15.46:0/67960899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800e070 con 0x7f4dc006eac0 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dbeffd700 1 -- 172.21.15.46:0/67960899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800b910 con 0x7f4dc006eac0 2023-05-21T16:55:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dbeffd700 1 -- 172.21.15.46:0/67960899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800bcc0 con 0x7f4dc006eac0 2023-05-21T16:55:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 -- 172.21.15.46:0/67960899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc006eac0 msgr2=0x7f4dc00c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 --2- 172.21.15.46:0/67960899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc006eac0 0x7f4dc00c4680 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009e50 tx=0x7f4db800b330 comp rx=0 tx=0).stop 2023-05-21T16:55:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 -- 172.21.15.46:0/67960899 shutdown_connections 2023-05-21T16:55:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 --2- 172.21.15.46:0/67960899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc006eac0 0x7f4dc00c4680 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 --2- 172.21.15.46:0/67960899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc00ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 -- 172.21.15.46:0/67960899 >> 172.21.15.46:0/67960899 conn(0x7f4dc00cfeb0 msgr2=0x7f4dc00cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 -- 172.21.15.46:0/67960899 shutdown_connections 2023-05-21T16:55:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 -- 172.21.15.46:0/67960899 wait complete. 2023-05-21T16:55:22.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 Processor -- start 2023-05-21T16:55:22.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.084+0000 7f4dc5292700 1 -- start start 2023-05-21T16:55:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 0x7f4dc0136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc00cd800 0x7f4dc015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc0133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc015b250 con 0x7f4dc00cd800 2023-05-21T16:55:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0134fc0 con 0x7f4dc006eac0 2023-05-21T16:55:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc01595e0 con 0x7f4dc0142c60 2023-05-21T16:55:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbf7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc00cd800 0x7f4dc015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 0x7f4dc0136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 0x7f4dc0136800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39048/0 (socket says 172.21.15.46:39048) 2023-05-21T16:55:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 -- 172.21.15.46:0/3166139226 learned_addr learned my addr 172.21.15.46:0/3166139226 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc4a91700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc0133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 -- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 msgr2=0x7f4dc0133bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc0133bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 -- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc00cd800 msgr2=0x7f4dc015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc00cd800 0x7f4dc015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 -- 172.21.15.46:0/3166139226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009b30 con 0x7f4dc006eac0 2023-05-21T16:55:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbffff700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 0x7f4dc0136800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4db000e870 tx=0x7f4db000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db00095a0 con 0x7f4dc006eac0 2023-05-21T16:55:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0013680 con 0x7f4dc006eac0 2023-05-21T16:55:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc00c4160 con 0x7f4dc006eac0 2023-05-21T16:55:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db00139f0 con 0x7f4dc006eac0 2023-05-21T16:55:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.088+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc00ce7c0 con 0x7f4dc006eac0 2023-05-21T16:55:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.092+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00ceaa0 con 0x7f4dc006eac0 2023-05-21T16:55:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.092+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4db0013b50 con 0x7f4dc006eac0 2023-05-21T16:55:22.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.092+0000 7f4dbcff9700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4dac0662f0 0x7f4dac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.092+0000 7f4dbf7fe700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4dac0662f0 0x7f4dac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:22.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.092+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4db0083d50 con 0x7f4dc006eac0 2023-05-21T16:55:22.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.092+0000 7f4dbf7fe700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4dac0662f0 0x7f4dac0687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0141500 tx=0x7f4db4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:22.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.104+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4db0054ab0 con 0x7f4dc006eac0 2023-05-21T16:55:22.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:22.308+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4dc0073cb0 con 0x7f4dc006eac0 2023-05-21T16:55:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.312+0000 7f4dbcff9700 1 -- 172.21.15.46:0/3166139226 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4db00170b0 con 0x7f4dc006eac0 2023-05-21T16:55:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4dac0662f0 msgr2=0x7f4dac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4dac0662f0 0x7f4dac0687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0141500 tx=0x7f4db4009040 comp rx=0 tx=0).stop 2023-05-21T16:55:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 msgr2=0x7f4dc0136800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 0x7f4dc0136800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4db000e870 tx=0x7f4db000eb80 comp rx=0 tx=0).stop 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 shutdown_connections 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4dac0662f0 0x7f4dac0687a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dc0142c60 0x7f4dc0133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dc00cd800 0x7f4dc015ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 --2- 172.21.15.46:0/3166139226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dc006eac0 0x7f4dc0136800 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 >> 172.21.15.46:0/3166139226 conn(0x7f4dc00cfeb0 msgr2=0x7f4dc00ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 shutdown_connections 2023-05-21T16:55:23.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.320+0000 7f4dc5292700 1 -- 172.21.15.46:0/3166139226 wait complete. 2023-05-21T16:55:23.338 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-21T16:55:23.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-21T16:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.456+0000 7fc5ef4ab700 1 Processor -- start 2023-05-21T16:55:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.456+0000 7fc5ef4ab700 1 -- start start 2023-05-21T16:55:23.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:23.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5e8070620 0x7fc5e806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:23.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e815efc0 con 0x7fc5e8070250 2023-05-21T16:55:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e806db30 con 0x7fc5e8070620 2023-05-21T16:55:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80cb1d0 con 0x7fc5e80ccdd0 2023-05-21T16:55:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5e8070620 0x7fc5e806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:23.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc5e8070620 0x7fc5e806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60420/0 (socket says 172.21.15.46:60420) 2023-05-21T16:55:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 -- 172.21.15.46:0/309696766 learned_addr learned my addr 172.21.15.46:0/309696766 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5edca8700 1 --2- 172.21.15.46:0/309696766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 -- 172.21.15.46:0/309696766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 msgr2=0x7fc5e815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 --2- 172.21.15.46:0/309696766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 -- 172.21.15.46:0/309696766 >> v1:172.21.15.142:6789/0 conn(0x7fc5e8070250 legacy=0x7fc5e80b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 -- 172.21.15.46:0/309696766 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80cb9a0 con 0x7fc5e8070620 2023-05-21T16:55:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5eecaa700 1 --2- 172.21.15.46:0/309696766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e806df50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009e50 tx=0x7fc5e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554f4c6dbd09bfe7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:23.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ed4a7700 1 -- 172.21.15.46:0/309696766 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000e070 con 0x7fc5e8070620 2023-05-21T16:55:23.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ed4a7700 1 -- 172.21.15.46:0/309696766 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000b910 con 0x7fc5e8070620 2023-05-21T16:55:23.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ed4a7700 1 -- 172.21.15.46:0/309696766 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000bcc0 con 0x7fc5e8070620 2023-05-21T16:55:23.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/309696766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 msgr2=0x7fc5e806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:23.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/309696766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e806df50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009e50 tx=0x7fc5e000b330 comp rx=0 tx=0).stop 2023-05-21T16:55:23.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/309696766 shutdown_connections 2023-05-21T16:55:23.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/309696766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e806df50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.460+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/309696766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/309696766 >> 172.21.15.46:0/309696766 conn(0x7fc5e80d0b80 msgr2=0x7fc5e80d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:23.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/309696766 shutdown_connections 2023-05-21T16:55:23.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/309696766 wait complete. 2023-05-21T16:55:23.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 Processor -- start 2023-05-21T16:55:23.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 -- start start 2023-05-21T16:55:23.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e8070250 0x7fc5e815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:23.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.464+0000 7fc5ef4ab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e80c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ef4ab700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e80c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ef4ab700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e815dab0 con 0x7fc5e8070620 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ef4ab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80c91b0 con 0x7fc5e8070250 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ef4ab700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e815d4f0 con 0x7fc5e80ccdd0 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e80c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e80c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60424/0 (socket says 172.21.15.46:60424) 2023-05-21T16:55:23.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 -- 172.21.15.46:0/1422488630 learned_addr learned my addr 172.21.15.46:0/1422488630 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5eecaa700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e80c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ee4a9700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e8070250 0x7fc5e815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 -- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 msgr2=0x7fc5e80c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e80c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 -- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e8070250 msgr2=0x7fc5e815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e8070250 0x7fc5e815cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 -- 172.21.15.46:0/1422488630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0009b30 con 0x7fc5e8070620 2023-05-21T16:55:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5edca8700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e80c6ba0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800e9a0 tx=0x7fc5d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:23.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8009720 con 0x7fc5e8070620 2023-05-21T16:55:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800c690 con 0x7fc5e8070620 2023-05-21T16:55:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e80cd270 con 0x7fc5e8070620 2023-05-21T16:55:23.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800ca40 con 0x7fc5e8070620 2023-05-21T16:55:23.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.468+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e815a960 con 0x7fc5e8070620 2023-05-21T16:55:23.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.472+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e80cb3e0 con 0x7fc5e8070620 2023-05-21T16:55:23.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.472+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5d800cba0 con 0x7fc5e8070620 2023-05-21T16:55:23.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.472+0000 7fc5deffd700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc5cc0662f0 0x7fc5cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:23.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.472+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5d8083cc0 con 0x7fc5e8070620 2023-05-21T16:55:23.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.472+0000 7fc5ee4a9700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc5cc0662f0 0x7fc5cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:23.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.472+0000 7fc5ee4a9700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc5cc0662f0 0x7fc5cc0687a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000f60 tx=0x7fc5e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:23.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.480+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc5d8054bd0 con 0x7fc5e8070620 2023-05-21T16:55:23.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:23.684+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc5e80c9320 con 0x7fc5e8070620 2023-05-21T16:55:24.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.619+0000 7fc5deffd700 1 -- 172.21.15.46:0/1422488630 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc5d80170c0 con 0x7fc5e8070620 2023-05-21T16:55:24.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc5cc0662f0 msgr2=0x7fc5cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc5cc0662f0 0x7fc5cc0687a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000f60 tx=0x7fc5e4009040 comp rx=0 tx=0).stop 2023-05-21T16:55:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 msgr2=0x7fc5e80c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e80c6ba0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800e9a0 tx=0x7fc5d800ecb0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 shutdown_connections 2023-05-21T16:55:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fc5cc0662f0 0x7fc5cc0687a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e80ccdd0 0x7fc5e80c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5e8070620 0x7fc5e80c6ba0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 --2- 172.21.15.46:0/1422488630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e8070250 0x7fc5e815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 >> 172.21.15.46:0/1422488630 conn(0x7fc5e80d0b80 msgr2=0x7fc5e806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 shutdown_connections 2023-05-21T16:55:24.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.623+0000 7fc5ef4ab700 1 -- 172.21.15.46:0/1422488630 wait complete. 2023-05-21T16:55:24.646 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-21T16:55:24.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:55:24.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 Processor -- start 2023-05-21T16:55:24.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 -- start start 2023-05-21T16:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c070350 0x7f459c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f459c0cf140 0x7f459c0cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0cecb0 con 0x7f459c15c5d0 2023-05-21T16:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0cd470 con 0x7f459c0cf140 2023-05-21T16:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c070cc0 con 0x7f459c070350 2023-05-21T16:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f459c0cf140 0x7f459c0cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f459c0cf140 0x7f459c0cf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45316/0 (socket says 172.21.15.46:45316) 2023-05-21T16:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.759+0000 7f459ad9d700 1 -- 172.21.15.46:0/3509312860 learned_addr learned my addr 172.21.15.46:0/3509312860 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f4599d9b700 1 --2- 172.21.15.46:0/3509312860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c070350 0x7f459c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459ad9d700 1 -- 172.21.15.46:0/3509312860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c070350 msgr2=0x7f459c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459ad9d700 1 --2- 172.21.15.46:0/3509312860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c070350 0x7f459c070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459ad9d700 1 -- 172.21.15.46:0/3509312860 >> v1:172.21.15.142:6789/0 conn(0x7f459c15c5d0 legacy=0x7f459c0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459ad9d700 1 -- 172.21.15.46:0/3509312860 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0cb2b0 con 0x7f459c0cf140 2023-05-21T16:55:24.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459ad9d700 1 --2- 172.21.15.46:0/3509312860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c0cf140 0x7f459c0cf5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4594009910 tx=0x7f4594009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e238beda6e147332 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:24.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459959a700 1 -- 172.21.15.46:0/3509312860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400ba60 con 0x7f459c0cf140 2023-05-21T16:55:24.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459959a700 1 -- 172.21.15.46:0/3509312860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459400bbc0 con 0x7f459c0cf140 2023-05-21T16:55:24.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459959a700 1 -- 172.21.15.46:0/3509312860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594009e60 con 0x7f459c0cf140 2023-05-21T16:55:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 -- 172.21.15.46:0/3509312860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c0cf140 msgr2=0x7f459c0cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 --2- 172.21.15.46:0/3509312860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c0cf140 0x7f459c0cf5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4594009910 tx=0x7f4594009c20 comp rx=0 tx=0).stop 2023-05-21T16:55:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 -- 172.21.15.46:0/3509312860 shutdown_connections 2023-05-21T16:55:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 --2- 172.21.15.46:0/3509312860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c0cf140 0x7f459c0cf5c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 --2- 172.21.15.46:0/3509312860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c070350 0x7f459c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 -- 172.21.15.46:0/3509312860 >> 172.21.15.46:0/3509312860 conn(0x7f459c0d0c60 msgr2=0x7f459c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 -- 172.21.15.46:0/3509312860 shutdown_connections 2023-05-21T16:55:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.763+0000 7f459b59e700 1 -- 172.21.15.46:0/3509312860 wait complete. 2023-05-21T16:55:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 Processor -- start 2023-05-21T16:55:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 -- start start 2023-05-21T16:55:24.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c070350 0x7f459c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:24.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0cf140 0x7f459c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:24.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 0x7f459c14b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:24.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c157520 con 0x7f459c15c5d0 2023-05-21T16:55:24.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0c4830 con 0x7f459c070350 2023-05-21T16:55:24.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0c4b10 con 0x7f459c0cf140 2023-05-21T16:55:24.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 0x7f459c14b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:24.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 0x7f459c14b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45324/0 (socket says 172.21.15.46:45324) 2023-05-21T16:55:24.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 -- 172.21.15.46:0/2140305839 learned_addr learned my addr 172.21.15.46:0/2140305839 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:24.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f4599d9b700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0cf140 0x7f459c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:24.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459a59c700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c070350 0x7f459c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:24.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 -- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0cf140 msgr2=0x7f459c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0cf140 0x7f459c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 -- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c070350 msgr2=0x7f459c1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c070350 0x7f459c1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 -- 172.21.15.46:0/2140305839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594009570 con 0x7f459c15c5d0 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459ad9d700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 0x7f459c14b080 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4594009c60 tx=0x7f4594004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594004250 con 0x7f459c15c5d0 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459401f070 con 0x7f459c15c5d0 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c0cb870 con 0x7f459c15c5d0 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940045d0 con 0x7f459c15c5d0 2023-05-21T16:55:24.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.767+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c0cb590 con 0x7f459c15c5d0 2023-05-21T16:55:24.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.771+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c0ce940 con 0x7f459c15c5d0 2023-05-21T16:55:24.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.771+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4594021030 con 0x7f459c15c5d0 2023-05-21T16:55:24.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.771+0000 7f4592ffd700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f457c0662f0 0x7f457c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:24.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.771+0000 7f459a59c700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f457c0662f0 0x7f457c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:24.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.771+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4594084e20 con 0x7f459c15c5d0 2023-05-21T16:55:24.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.771+0000 7f459a59c700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f457c0662f0 0x7f457c0687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4584000f60 tx=0x7f4584009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:24.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.783+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4594052330 con 0x7f459c15c5d0 2023-05-21T16:55:24.887 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T16:55:24.883+0000 7f9d8229b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-21T16:55:24.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.979+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f459c067ac0 con 0x7f459c15c5d0 2023-05-21T16:55:24.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.979+0000 7f4592ffd700 1 -- 172.21.15.46:0/2140305839 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f4594015090 con 0x7f459c15c5d0 2023-05-21T16:55:24.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:24.984 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:55:21.293141+0000","modified":"2023-05-21T16:55:24.614864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/2842509941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":2842509941},{"type":"v1","addr":"172.21.15.46:6837","nonce":2842509941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-21T16:55:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f457c0662f0 msgr2=0x7f457c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f457c0662f0 0x7f457c0687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4584000f60 tx=0x7f4584009040 comp rx=0 tx=0).stop 2023-05-21T16:55:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 msgr2=0x7f459c14b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 0x7f459c14b080 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4594009c60 tx=0x7f4594004770 comp rx=0 tx=0).stop 2023-05-21T16:55:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 shutdown_connections 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f457c0662f0 0x7f457c0687a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f459c15c5d0 0x7f459c14b080 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f459c0cf140 0x7f459c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 --2- 172.21.15.46:0/2140305839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c070350 0x7f459c1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 >> 172.21.15.46:0/2140305839 conn(0x7f459c0d0c60 msgr2=0x7f459c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 shutdown_connections 2023-05-21T16:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:24.983+0000 7f459b59e700 1 -- 172.21.15.46:0/2140305839 wait complete. 2023-05-21T16:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-05-21T16:55:24.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-21T16:55:25.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 Processor -- start 2023-05-21T16:55:25.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 -- start start 2023-05-21T16:55:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130806c760 0x7f130815a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f130815dbb0 0x7f130806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1308069f80 0x7f130806a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130806b9d0 con 0x7f130815dbb0 2023-05-21T16:55:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130806b450 con 0x7f1308069f80 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1308159a90 con 0x7f130806c760 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f130815dbb0 0x7f130806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f130815dbb0 0x7f130806cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45334/0 (socket says 172.21.15.46:45334) 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 -- 172.21.15.46:0/3424688528 learned_addr learned my addr 172.21.15.46:0/3424688528 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130dcb6700 1 --2- 172.21.15.46:0/3424688528 >> v2:172.21.15.142:3300/0 conn(0x7f1308069f80 0x7f130806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130d4b5700 1 --2- 172.21.15.46:0/3424688528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130806c760 0x7f130815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 -- 172.21.15.46:0/3424688528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130806c760 msgr2=0x7f130815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 --2- 172.21.15.46:0/3424688528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130806c760 0x7f130815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 -- 172.21.15.46:0/3424688528 >> v2:172.21.15.142:3300/0 conn(0x7f1308069f80 msgr2=0x7f130806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 --2- 172.21.15.46:0/3424688528 >> v2:172.21.15.142:3300/0 conn(0x7f1308069f80 0x7f130806a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 -- 172.21.15.46:0/3424688528 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130806d070 con 0x7f130815dbb0 2023-05-21T16:55:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130ccb4700 1 --2- 172.21.15.46:0/3424688528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130815dbb0 0x7f130806cb30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13080cc4d0 tx=0x7f1304009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682f493d502715be server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f12fffff700 1 -- 172.21.15.46:0/3424688528 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400f8a0 con 0x7f130815dbb0 2023-05-21T16:55:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f12fffff700 1 -- 172.21.15.46:0/3424688528 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400fa00 con 0x7f130815dbb0 2023-05-21T16:55:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f12fffff700 1 -- 172.21.15.46:0/3424688528 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400fd90 con 0x7f130815dbb0 2023-05-21T16:55:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 -- 172.21.15.46:0/3424688528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130815dbb0 msgr2=0x7f130806cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.111+0000 7f130e4b7700 1 --2- 172.21.15.46:0/3424688528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130815dbb0 0x7f130806cb30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13080cc4d0 tx=0x7f1304009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- 172.21.15.46:0/3424688528 shutdown_connections 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 --2- 172.21.15.46:0/3424688528 >> v2:172.21.15.142:3300/0 conn(0x7f1308069f80 0x7f130806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 --2- 172.21.15.46:0/3424688528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130815dbb0 0x7f130806cb30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 --2- 172.21.15.46:0/3424688528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130806c760 0x7f130815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- 172.21.15.46:0/3424688528 >> 172.21.15.46:0/3424688528 conn(0x7f13080cf720 msgr2=0x7f13080cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- 172.21.15.46:0/3424688528 shutdown_connections 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- 172.21.15.46:0/3424688528 wait complete. 2023-05-21T16:55:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 Processor -- start 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- start start 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1308069f80 0x7f13080b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 0x7f130815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130815dbb0 0x7f1308156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c6750 con 0x7f130806c760 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13081596e0 con 0x7f130815dbb0 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b1e20 con 0x7f1308069f80 2023-05-21T16:55:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 0x7f130815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 0x7f130815c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45336/0 (socket says 172.21.15.46:45336) 2023-05-21T16:55:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 -- 172.21.15.46:0/1228857787 learned_addr learned my addr 172.21.15.46:0/1228857787 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130dcb6700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130815dbb0 0x7f1308156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130d4b5700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1308069f80 0x7f13080b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 -- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1308069f80 msgr2=0x7f13080b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1308069f80 0x7f13080b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 -- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130815dbb0 msgr2=0x7f1308156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130815dbb0 0x7f1308156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 -- 172.21.15.46:0/1228857787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009570 con 0x7f130806c760 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130ccb4700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 0x7f130815c300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1304009f40 tx=0x7f1304004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040038c0 con 0x7f130806c760 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304003a40 con 0x7f130806c760 2023-05-21T16:55:25.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1308159d50 con 0x7f130806c760 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304003df0 con 0x7f130806c760 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.115+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130806b6f0 con 0x7f130806c760 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.119+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130815a030 con 0x7f130806c760 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.119+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1304019400 con 0x7f130806c760 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.119+0000 7f12fdffb700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f12ec0662f0 0x7f12ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.119+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1304084ce0 con 0x7f130806c760 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.119+0000 7f130d4b5700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f12ec0662f0 0x7f12ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.119+0000 7f130d4b5700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f12ec0662f0 0x7f12ec0687a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009a00 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.123+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f13040522b0 con 0x7f130806c760 2023-05-21T16:55:25.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.287+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13080c6890 con 0x7f130806c760 2023-05-21T16:55:25.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f12fdffb700 1 -- 172.21.15.46:0/1228857787 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f13080c6890 con 0x7f130806c760 2023-05-21T16:55:25.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:25.294 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":38,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:55:22.296964+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:55:19.482721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-21T16:55:20.275924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-21T16:55:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f12ec0662f0 msgr2=0x7f12ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f12ec0662f0 0x7f12ec0687a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009a00 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2023-05-21T16:55:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 msgr2=0x7f130815c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 0x7f130815c300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1304009f40 tx=0x7f1304004770 comp rx=0 tx=0).stop 2023-05-21T16:55:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 shutdown_connections 2023-05-21T16:55:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f12ec0662f0 0x7f12ec0687a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f130815dbb0 0x7f1308156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f130806c760 0x7f130815c300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 --2- 172.21.15.46:0/1228857787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1308069f80 0x7f13080b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 >> 172.21.15.46:0/1228857787 conn(0x7f13080cf720 msgr2=0x7f13080c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 shutdown_connections 2023-05-21T16:55:25.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.291+0000 7f130e4b7700 1 -- 172.21.15.46:0/1228857787 wait complete. 2023-05-21T16:55:25.314 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-21T16:55:25.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:55:25.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00494d5700 1 Processor -- start 2023-05-21T16:55:25.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00494d5700 1 -- start start 2023-05-21T16:55:25.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00494d5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 0x7f0044164900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00494d5700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004406b9d0 con 0x7f004415a830 2023-05-21T16:55:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00494d5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004406b450 con 0x7f004406c760 2023-05-21T16:55:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00494d5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0044159a90 con 0x7f0044162520 2023-05-21T16:55:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00437fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f004415a830 0x7f004406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54120/0 (socket says 172.21.15.46:54120) 2023-05-21T16:55:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f00437fe700 1 -- 172.21.15.46:0/3066861893 learned_addr learned my addr 172.21.15.46:0/3066861893 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f0048cd4700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 0x7f0044164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839033767 0 0) 0x7f004406b9d0 con 0x7f004415a830 2023-05-21T16:55:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00300035d0 con 0x7f004415a830 2023-05-21T16:55:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993411919 0 0) 0x7f004406b450 con 0x7f004406c760 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.427+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f004406b9d0 con 0x7f004406c760 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705271825 0 0) 0x7f00300035d0 con 0x7f004415a830 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 msgr2=0x7f0044164900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 0x7f0044164900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 >> v1:172.21.15.142:6789/0 conn(0x7f004406c760 legacy=0x7f004415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004406b6f0 con 0x7f004415a830 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f0034001670 con 0x7f004415a830 2023-05-21T16:55:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 >> v1:172.21.15.46:6789/0 conn(0x7f004415a830 legacy=0x7f004406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003be0 0x7f0030003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f0030004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 0x7f0030005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044159a90 con 0x7f0030004870 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003000bb10 con 0x7f0030003be0 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003000bcd0 con 0x7f0044162520 2023-05-21T16:55:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0048cd4700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 0x7f0030005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0043fff700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003be0 0x7f0030003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f0030004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 -- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 msgr2=0x7f0030005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044162520 0x7f0030005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 -- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003be0 msgr2=0x7f0030003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0030003be0 0x7f0030003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 -- 172.21.15.46:0/3066861893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004406b6f0 con 0x7f0030004870 2023-05-21T16:55:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00437fe700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f0030004ce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f003400c340 tx=0x7f00300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191f42af422970a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400ce00 con 0x7f0030004870 2023-05-21T16:55:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0034005980 con 0x7f0030004870 2023-05-21T16:55:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0042ffd700 1 -- 172.21.15.46:0/3066861893 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034005cf0 con 0x7f0030004870 2023-05-21T16:55:25.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00494d5700 1 -- 172.21.15.46:0/3066861893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 msgr2=0x7f0030004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00494d5700 1 --2- 172.21.15.46:0/3066861893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f0030004ce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f003400c340 tx=0x7f00300058a0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f0048cd4700 1 -- 172.21.15.46:0/3066861893 reap_dead start 2023-05-21T16:55:25.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00494d5700 1 -- 172.21.15.46:0/3066861893 shutdown_connections 2023-05-21T16:55:25.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00494d5700 1 -- 172.21.15.46:0/3066861893 >> 172.21.15.46:0/3066861893 conn(0x7f00440cf720 msgr2=0x7f00440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00494d5700 1 -- 172.21.15.46:0/3066861893 shutdown_connections 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.431+0000 7f00494d5700 1 -- 172.21.15.46:0/3066861893 wait complete. 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 Processor -- start 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 -- start start 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f004415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004415b670 0x7f00441502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044146a90 0x7f00440b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004415d0e0 con 0x7f0030004870 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004415bb00 con 0x7f004415b670 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004415bde0 con 0x7f0044146a90 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f004415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00437fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004415b670 0x7f00441502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f004415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45344/0 (socket says 172.21.15.46:45344) 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 -- 172.21.15.46:0/1070944231 learned_addr learned my addr 172.21.15.46:0/1070944231 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0048cd4700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044146a90 0x7f00440b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 -- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044146a90 msgr2=0x7f00440b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044146a90 0x7f00440b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 -- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004415b670 msgr2=0x7f00441502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004415b670 0x7f00441502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 -- 172.21.15.46:0/1070944231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004415a030 con 0x7f0030004870 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0043fff700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f004415cba0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f002c00f750 tx=0x7f002c00fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c005320 con 0x7f0030004870 2023-05-21T16:55:25.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c0054a0 con 0x7f0030004870 2023-05-21T16:55:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0044159d50 con 0x7f0030004870 2023-05-21T16:55:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c006ac0 con 0x7f0030004870 2023-05-21T16:55:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.435+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004415a310 con 0x7f0030004870 2023-05-21T16:55:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.439+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00440733b0 con 0x7f0030004870 2023-05-21T16:55:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.439+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f002c006c20 con 0x7f0030004870 2023-05-21T16:55:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.439+0000 7f0040ff9700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00240662f0 0x7f00240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.439+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f002c083370 con 0x7f0030004870 2023-05-21T16:55:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.439+0000 7f00437fe700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00240662f0 0x7f00240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.439+0000 7f00437fe700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00240662f0 0x7f00240687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0034015040 tx=0x7f003400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.447+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f002c050880 con 0x7f0030004870 2023-05-21T16:55:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.603+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f004406b2a0 con 0x7f00240662f0 2023-05-21T16:55:25.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.619+0000 7f0040ff9700 1 -- 172.21.15.46:0/1070944231 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297748 (secure 0 0 0) 0x7f004406b2a0 con 0x7f00240662f0 2023-05-21T16:55:25.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:25.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00240662f0 msgr2=0x7f00240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00240662f0 0x7f00240687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0034015040 tx=0x7f003400a000 comp rx=0 tx=0).stop 2023-05-21T16:55:25.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 msgr2=0x7f004415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f004415cba0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f002c00f750 tx=0x7f002c00fa60 comp rx=0 tx=0).stop 2023-05-21T16:55:25.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 shutdown_connections 2023-05-21T16:55:25.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00240662f0 0x7f00240687a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0044146a90 0x7f00440b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004415b670 0x7f00441502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 --2- 172.21.15.46:0/1070944231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0030004870 0x7f004415cba0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 >> 172.21.15.46:0/1070944231 conn(0x7f00440cf720 msgr2=0x7f00440cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:25.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 shutdown_connections 2023-05-21T16:55:25.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.623+0000 7f00494d5700 1 -- 172.21.15.46:0/1070944231 wait complete. 2023-05-21T16:55:25.630 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:55:25.642 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-05-21T16:55:24.804857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":85084,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":754889636,"statfs":{"total":773094113280,"available":773006987264,"internally_reserved":0,"allocated":4354048,"data_stored":2451766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912893"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902321+0000","last_change":"2023-05-21T16:55:19.902321+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902321+0000","last_undegraded":"2023-05-21T16:55:19.902321+0000","last_fullsized":"2023-05-21T16:55:19.902321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906946+0000","last_change":"2023-05-21T16:55:19.906946+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906946+0000","last_undegraded":"2023-05-21T16:55:19.906946+0000","last_fullsized":"2023-05-21T16:55:19.906946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902861+0000","last_change":"2023-05-21T16:55:19.902861+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902861+0000","last_undegraded":"2023-05-21T16:55:19.902861+0000","last_fullsized":"2023-05-21T16:55:19.902861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900150+0000","last_change":"2023-05-21T16:55:19.900150+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900150+0000","last_undegraded":"2023-05-21T16:55:19.900150+0000","last_fullsized":"2023-05-21T16:55:19.900150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.899728+0000","last_change":"2023-05-21T16:55:19.899728+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.899728+0000","last_undegraded":"2023-05-21T16:55:19.899728+0000","last_fullsized":"2023-05-21T16:55:19.899728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896766+0000","last_change":"2023-05-21T16:55:19.896766+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896766+0000","last_undegraded":"2023-05-21T16:55:19.896766+0000","last_fullsized":"2023-05-21T16:55:19.896766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.901629+0000","last_change":"2023-05-21T16:55:19.901629+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.901629+0000","last_undegraded":"2023-05-21T16:55:19.901629+0000","last_fullsized":"2023-05-21T16:55:19.901629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900549+0000","last_change":"2023-05-21T16:55:19.900549+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900549+0000","last_undegraded":"2023-05-21T16:55:19.900549+0000","last_fullsized":"2023-05-21T16:55:19.900549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904565+0000","last_change":"2023-05-21T16:55:19.904565+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904565+0000","last_undegraded":"2023-05-21T16:55:19.904565+0000","last_fullsized":"2023-05-21T16:55:19.904565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900319+0000","last_change":"2023-05-21T16:55:19.900319+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900319+0000","last_undegraded":"2023-05-21T16:55:19.900319+0000","last_fullsized":"2023-05-21T16:55:19.900319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.897761+0000","last_change":"2023-05-21T16:55:19.897761+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.897761+0000","last_undegraded":"2023-05-21T16:55:19.897761+0000","last_fullsized":"2023-05-21T16:55:19.897761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904403+0000","last_change":"2023-05-21T16:55:19.904403+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904403+0000","last_undegraded":"2023-05-21T16:55:19.904403+0000","last_fullsized":"2023-05-21T16:55:19.904403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904180+0000","last_change":"2023-05-21T16:55:19.904180+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904180+0000","last_undegraded":"2023-05-21T16:55:19.904180+0000","last_fullsized":"2023-05-21T16:55:19.904180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902319+0000","last_change":"2023-05-21T16:55:19.902319+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902319+0000","last_undegraded":"2023-05-21T16:55:19.902319+0000","last_fullsized":"2023-05-21T16:55:19.902319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902354+0000","last_change":"2023-05-21T16:55:19.902354+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902354+0000","last_undegraded":"2023-05-21T16:55:19.902354+0000","last_fullsized":"2023-05-21T16:55:19.902354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896316+0000","last_change":"2023-05-21T16:55:19.896316+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896316+0000","last_undegraded":"2023-05-21T16:55:19.896316+0000","last_fullsized":"2023-05-21T16:55:19.896316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.899017+0000","last_change":"2023-05-21T16:55:19.899017+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.899017+0000","last_undegraded":"2023-05-21T16:55:19.899017+0000","last_fullsized":"2023-05-21T16:55:19.899017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.898375+0000","last_change":"2023-05-21T16:55:19.898375+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.898375+0000","last_undegraded":"2023-05-21T16:55:19.898375+0000","last_fullsized":"2023-05-21T16:55:19.898375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.909219+0000","last_change":"2023-05-21T16:55:19.909219+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.909219+0000","last_undegraded":"2023-05-21T16:55:19.909219+0000","last_fullsized":"2023-05-21T16:55:19.909219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902096+0000","last_change":"2023-05-21T16:55:19.902096+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902096+0000","last_undegraded":"2023-05-21T16:55:19.902096+0000","last_fullsized":"2023-05-21T16:55:19.902096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.909192+0000","last_change":"2023-05-21T16:55:19.909192+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.909192+0000","last_undegraded":"2023-05-21T16:55:19.909192+0000","last_fullsized":"2023-05-21T16:55:19.909192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906612+0000","last_change":"2023-05-21T16:55:19.906612+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906612+0000","last_undegraded":"2023-05-21T16:55:19.906612+0000","last_fullsized":"2023-05-21T16:55:19.906612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896830+0000","last_change":"2023-05-21T16:55:19.896830+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896830+0000","last_undegraded":"2023-05-21T16:55:19.896830+0000","last_fullsized":"2023-05-21T16:55:19.896830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906550+0000","last_change":"2023-05-21T16:55:19.906550+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906550+0000","last_undegraded":"2023-05-21T16:55:19.906550+0000","last_fullsized":"2023-05-21T16:55:19.906550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896328+0000","last_change":"2023-05-21T16:55:19.896328+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896328+0000","last_undegraded":"2023-05-21T16:55:19.896328+0000","last_fullsized":"2023-05-21T16:55:19.896328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897815+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:55:19.897815+0000","last_peered":"2023-05-21T16:55:19.897815+0000","last_clean":"2023-05-21T16:55:19.897815+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:55:19.897815+0000","last_undegraded":"2023-05-21T16:55:19.897815+0000","last_fullsized":"2023-05-21T16:55:19.897815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:36.989098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.900123+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:55:19.900123+0000","last_peered":"2023-05-21T16:55:19.900123+0000","last_clean":"2023-05-21T16:55:19.900123+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:55:19.900123+0000","last_undegraded":"2023-05-21T16:55:19.900123+0000","last_fullsized":"2023-05-21T16:55:19.900123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:15:49.250261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.898488+0000","last_change":"2023-05-21T16:55:19.898488+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.898488+0000","last_undegraded":"2023-05-21T16:55:19.898488+0000","last_fullsized":"2023-05-21T16:55:19.898488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897647+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:55:19.897647+0000","last_peered":"2023-05-21T16:55:19.897647+0000","last_clean":"2023-05-21T16:55:19.897647+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:55:19.897647+0000","last_undegraded":"2023-05-21T16:55:19.897647+0000","last_fullsized":"2023-05-21T16:55:19.897647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:29.681321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.908843+0000","last_change":"2023-05-21T16:55:19.908843+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.908843+0000","last_undegraded":"2023-05-21T16:55:19.908843+0000","last_fullsized":"2023-05-21T16:55:19.908843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909706+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:55:19.909706+0000","last_peered":"2023-05-21T16:55:19.909706+0000","last_clean":"2023-05-21T16:55:19.909706+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:55:19.909706+0000","last_undegraded":"2023-05-21T16:55:19.909706+0000","last_fullsized":"2023-05-21T16:55:19.909706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:19:06.481702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.905676+0000","last_change":"2023-05-21T16:55:19.905676+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.905676+0000","last_undegraded":"2023-05-21T16:55:19.905676+0000","last_fullsized":"2023-05-21T16:55:19.905676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897375+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:55:19.897375+0000","last_peered":"2023-05-21T16:55:19.897375+0000","last_clean":"2023-05-21T16:55:19.897375+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:55:19.897375+0000","last_undegraded":"2023-05-21T16:55:19.897375+0000","last_fullsized":"2023-05-21T16:55:19.897375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:49.636380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.905934+0000","last_change":"2023-05-21T16:55:19.905934+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.905934+0000","last_undegraded":"2023-05-21T16:55:19.905934+0000","last_fullsized":"2023-05-21T16:55:19.905934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909003+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:55:19.909003+0000","last_peered":"2023-05-21T16:55:19.909003+0000","last_clean":"2023-05-21T16:55:19.909003+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:55:19.909003+0000","last_undegraded":"2023-05-21T16:55:19.909003+0000","last_fullsized":"2023-05-21T16:55:19.909003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:11:45.556188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902579+0000","last_change":"2023-05-21T16:55:19.902579+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902579+0000","last_undegraded":"2023-05-21T16:55:19.902579+0000","last_fullsized":"2023-05-21T16:55:19.902579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.898243+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:55:19.898243+0000","last_peered":"2023-05-21T16:55:19.898243+0000","last_clean":"2023-05-21T16:55:19.898243+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:55:19.898243+0000","last_undegraded":"2023-05-21T16:55:19.898243+0000","last_fullsized":"2023-05-21T16:55:19.898243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:58:20.208504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.901182+0000","last_change":"2023-05-21T16:55:19.901182+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.901182+0000","last_undegraded":"2023-05-21T16:55:19.901182+0000","last_fullsized":"2023-05-21T16:55:19.901182+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909001+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:55:19.909001+0000","last_peered":"2023-05-21T16:55:19.909001+0000","last_clean":"2023-05-21T16:55:19.909001+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:55:19.909001+0000","last_undegraded":"2023-05-21T16:55:19.909001+0000","last_fullsized":"2023-05-21T16:55:19.909001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:15.144296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904380+0000","last_change":"2023-05-21T16:55:19.904380+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904380+0000","last_undegraded":"2023-05-21T16:55:19.904380+0000","last_fullsized":"2023-05-21T16:55:19.904380+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.903405+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:55:19.903405+0000","last_peered":"2023-05-21T16:55:19.903405+0000","last_clean":"2023-05-21T16:55:19.903405+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:55:19.903405+0000","last_undegraded":"2023-05-21T16:55:19.903405+0000","last_fullsized":"2023-05-21T16:55:19.903405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:26.337916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.034}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.89600000000000002}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.628},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.872}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.93999999999999995}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8204,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363636,"statfs":{"total":96636764160,"available":96628363264,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0189999999999999}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.91000000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73199999999999998}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.095},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.141}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.76700000000000002}]},{"osd":1,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.02},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.96099999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0409999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363444,"statfs":{"total":96636764160,"available":96628166656,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.012},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.91300000000000003}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.874}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.081},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12428,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359412,"statfs":{"total":96636764160,"available":96624037888,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12364,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359476,"statfs":{"total":96636764160,"available":96624103424,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81000000000000005}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.286},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.141}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.121}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.556},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.034}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.427},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.2450000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12416,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359424,"statfs":{"total":96636764160,"available":96624050176,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.71099999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.173}]},{"osd":7,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.218},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.018}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13520,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358320,"statfs":{"total":96636764160,"available":96622919680,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.74399999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1519999999999999}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.014},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.254}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.054}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:55:25.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:55:25.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.759+0000 7fcf26514700 1 Processor -- start 2023-05-21T16:55:25.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.759+0000 7fcf26514700 1 -- start start 2023-05-21T16:55:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf20154de0 0x7fcf2006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcf2015e210 0x7fcf2015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2015aea0 con 0x7fcf200caea0 2023-05-21T16:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2015ac20 con 0x7fcf20154de0 2023-05-21T16:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2015eb50 con 0x7fcf2015e210 2023-05-21T16:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf20154de0 0x7fcf2006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf20154de0 0x7fcf2006c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45356/0 (socket says 172.21.15.46:45356) 2023-05-21T16:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 -- 172.21.15.46:0/3631384056 learned_addr learned my addr 172.21.15.46:0/3631384056 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:25.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25d13700 1 --2- 172.21.15.46:0/3631384056 >> v2:172.21.15.142:3300/0 conn(0x7fcf2015e210 0x7fcf2015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 -- 172.21.15.46:0/3631384056 >> v2:172.21.15.142:3300/0 conn(0x7fcf2015e210 msgr2=0x7fcf2015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 --2- 172.21.15.46:0/3631384056 >> v2:172.21.15.142:3300/0 conn(0x7fcf2015e210 0x7fcf2015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 -- 172.21.15.46:0/3631384056 >> v1:172.21.15.142:6789/0 conn(0x7fcf200caea0 legacy=0x7fcf2015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 -- 172.21.15.46:0/3631384056 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20071790 con 0x7fcf20154de0 2023-05-21T16:55:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25d13700 1 --2- 172.21.15.46:0/3631384056 >> v2:172.21.15.142:3300/0 conn(0x7fcf2015e210 0x7fcf2015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:25.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf25512700 1 --2- 172.21.15.46:0/3631384056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf2006c760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcf201587f0 tx=0x7fcf10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be743eb609b454ce server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf17fff700 1 -- 172.21.15.46:0/3631384056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000b8a0 con 0x7fcf20154de0 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf17fff700 1 -- 172.21.15.46:0/3631384056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000ba00 con 0x7fcf20154de0 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf17fff700 1 -- 172.21.15.46:0/3631384056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000bd90 con 0x7fcf20154de0 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- 172.21.15.46:0/3631384056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 msgr2=0x7fcf2006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 --2- 172.21.15.46:0/3631384056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf2006c760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcf201587f0 tx=0x7fcf10009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- 172.21.15.46:0/3631384056 shutdown_connections 2023-05-21T16:55:25.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 --2- 172.21.15.46:0/3631384056 >> v2:172.21.15.142:3300/0 conn(0x7fcf2015e210 0x7fcf2015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 --2- 172.21.15.46:0/3631384056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf2006c760 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- 172.21.15.46:0/3631384056 >> 172.21.15.46:0/3631384056 conn(0x7fcf200cf720 msgr2=0x7fcf200cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:25.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- 172.21.15.46:0/3631384056 shutdown_connections 2023-05-21T16:55:25.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.763+0000 7fcf26514700 1 -- 172.21.15.46:0/3631384056 wait complete. 2023-05-21T16:55:25.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 Processor -- start 2023-05-21T16:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 -- start start 2023-05-21T16:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf200caea0 0x7fcf201f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf201471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015e210 0x7fcf20157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf20147700 con 0x7fcf20154de0 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200af5e0 con 0x7fcf200caea0 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200af8c0 con 0x7fcf2015e210 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf201471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf201471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45372/0 (socket says 172.21.15.46:45372) 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 -- 172.21.15.46:0/293294605 learned_addr learned my addr 172.21.15.46:0/293294605 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf25512700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf200caea0 0x7fcf201f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf25d13700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015e210 0x7fcf20157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 -- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015e210 msgr2=0x7fcf20157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015e210 0x7fcf20157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 -- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf200caea0 msgr2=0x7fcf201f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf200caea0 0x7fcf201f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 -- 172.21.15.46:0/293294605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009570 con 0x7fcf20154de0 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf25d13700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015e210 0x7fcf20157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf24d11700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf201471c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c500 tx=0x7fcf1c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0052d0 con 0x7fcf20154de0 2023-05-21T16:55:25.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c005430 con 0x7fcf20154de0 2023-05-21T16:55:25.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2006cdd0 con 0x7fcf20154de0 2023-05-21T16:55:25.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0055a0 con 0x7fcf20154de0 2023-05-21T16:55:25.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.767+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf200cb340 con 0x7fcf20154de0 2023-05-21T16:55:25.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.771+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2006d0b0 con 0x7fcf20154de0 2023-05-21T16:55:25.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.771+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf1c0036a0 con 0x7fcf20154de0 2023-05-21T16:55:25.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.771+0000 7fcf15ffb700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcf040662f0 0x7fcf040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:25.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.771+0000 7fcf25512700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcf040662f0 0x7fcf040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:25.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.771+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf1c082f60 con 0x7fcf20154de0 2023-05-21T16:55:25.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.771+0000 7fcf25512700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcf040662f0 0x7fcf040687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf10000c00 tx=0x7fcf10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:25.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.779+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcf1c0503e0 con 0x7fcf20154de0 2023-05-21T16:55:25.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.943+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf200733b0 con 0x7fcf040662f0 2023-05-21T16:55:25.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.959+0000 7fcf15ffb700 1 -- 172.21.15.46:0/293294605 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297748 (secure 0 0 0) 0x7fcf200733b0 con 0x7fcf040662f0 2023-05-21T16:55:25.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:25.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcf040662f0 msgr2=0x7fcf040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcf040662f0 0x7fcf040687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf10000c00 tx=0x7fcf10008030 comp rx=0 tx=0).stop 2023-05-21T16:55:25.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 msgr2=0x7fcf201471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf201471c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c500 tx=0x7fcf1c00c810 comp rx=0 tx=0).stop 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 shutdown_connections 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fcf040662f0 0x7fcf040687a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcf2015e210 0x7fcf20157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf20154de0 0x7fcf201471c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 --2- 172.21.15.46:0/293294605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf200caea0 0x7fcf201f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 >> 172.21.15.46:0/293294605 conn(0x7fcf200cf720 msgr2=0x7fcf2015b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:25.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 shutdown_connections 2023-05-21T16:55:25.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:25.963+0000 7fcf26514700 1 -- 172.21.15.46:0/293294605 wait complete. 2023-05-21T16:55:25.970 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:55:25.985 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-05-21T16:55:24.804857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":85084,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":754889636,"statfs":{"total":773094113280,"available":773006987264,"internally_reserved":0,"allocated":4354048,"data_stored":2451766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912893"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902321+0000","last_change":"2023-05-21T16:55:19.902321+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902321+0000","last_undegraded":"2023-05-21T16:55:19.902321+0000","last_fullsized":"2023-05-21T16:55:19.902321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906946+0000","last_change":"2023-05-21T16:55:19.906946+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906946+0000","last_undegraded":"2023-05-21T16:55:19.906946+0000","last_fullsized":"2023-05-21T16:55:19.906946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902861+0000","last_change":"2023-05-21T16:55:19.902861+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902861+0000","last_undegraded":"2023-05-21T16:55:19.902861+0000","last_fullsized":"2023-05-21T16:55:19.902861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900150+0000","last_change":"2023-05-21T16:55:19.900150+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900150+0000","last_undegraded":"2023-05-21T16:55:19.900150+0000","last_fullsized":"2023-05-21T16:55:19.900150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.899728+0000","last_change":"2023-05-21T16:55:19.899728+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.899728+0000","last_undegraded":"2023-05-21T16:55:19.899728+0000","last_fullsized":"2023-05-21T16:55:19.899728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896766+0000","last_change":"2023-05-21T16:55:19.896766+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896766+0000","last_undegraded":"2023-05-21T16:55:19.896766+0000","last_fullsized":"2023-05-21T16:55:19.896766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.901629+0000","last_change":"2023-05-21T16:55:19.901629+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.901629+0000","last_undegraded":"2023-05-21T16:55:19.901629+0000","last_fullsized":"2023-05-21T16:55:19.901629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900549+0000","last_change":"2023-05-21T16:55:19.900549+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900549+0000","last_undegraded":"2023-05-21T16:55:19.900549+0000","last_fullsized":"2023-05-21T16:55:19.900549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904565+0000","last_change":"2023-05-21T16:55:19.904565+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904565+0000","last_undegraded":"2023-05-21T16:55:19.904565+0000","last_fullsized":"2023-05-21T16:55:19.904565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900319+0000","last_change":"2023-05-21T16:55:19.900319+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900319+0000","last_undegraded":"2023-05-21T16:55:19.900319+0000","last_fullsized":"2023-05-21T16:55:19.900319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.897761+0000","last_change":"2023-05-21T16:55:19.897761+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.897761+0000","last_undegraded":"2023-05-21T16:55:19.897761+0000","last_fullsized":"2023-05-21T16:55:19.897761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904403+0000","last_change":"2023-05-21T16:55:19.904403+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904403+0000","last_undegraded":"2023-05-21T16:55:19.904403+0000","last_fullsized":"2023-05-21T16:55:19.904403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904180+0000","last_change":"2023-05-21T16:55:19.904180+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904180+0000","last_undegraded":"2023-05-21T16:55:19.904180+0000","last_fullsized":"2023-05-21T16:55:19.904180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902319+0000","last_change":"2023-05-21T16:55:19.902319+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902319+0000","last_undegraded":"2023-05-21T16:55:19.902319+0000","last_fullsized":"2023-05-21T16:55:19.902319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902354+0000","last_change":"2023-05-21T16:55:19.902354+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902354+0000","last_undegraded":"2023-05-21T16:55:19.902354+0000","last_fullsized":"2023-05-21T16:55:19.902354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896316+0000","last_change":"2023-05-21T16:55:19.896316+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896316+0000","last_undegraded":"2023-05-21T16:55:19.896316+0000","last_fullsized":"2023-05-21T16:55:19.896316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.899017+0000","last_change":"2023-05-21T16:55:19.899017+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.899017+0000","last_undegraded":"2023-05-21T16:55:19.899017+0000","last_fullsized":"2023-05-21T16:55:19.899017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.898375+0000","last_change":"2023-05-21T16:55:19.898375+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.898375+0000","last_undegraded":"2023-05-21T16:55:19.898375+0000","last_fullsized":"2023-05-21T16:55:19.898375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.909219+0000","last_change":"2023-05-21T16:55:19.909219+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.909219+0000","last_undegraded":"2023-05-21T16:55:19.909219+0000","last_fullsized":"2023-05-21T16:55:19.909219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902096+0000","last_change":"2023-05-21T16:55:19.902096+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902096+0000","last_undegraded":"2023-05-21T16:55:19.902096+0000","last_fullsized":"2023-05-21T16:55:19.902096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.909192+0000","last_change":"2023-05-21T16:55:19.909192+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.909192+0000","last_undegraded":"2023-05-21T16:55:19.909192+0000","last_fullsized":"2023-05-21T16:55:19.909192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906612+0000","last_change":"2023-05-21T16:55:19.906612+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906612+0000","last_undegraded":"2023-05-21T16:55:19.906612+0000","last_fullsized":"2023-05-21T16:55:19.906612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896830+0000","last_change":"2023-05-21T16:55:19.896830+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896830+0000","last_undegraded":"2023-05-21T16:55:19.896830+0000","last_fullsized":"2023-05-21T16:55:19.896830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906550+0000","last_change":"2023-05-21T16:55:19.906550+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906550+0000","last_undegraded":"2023-05-21T16:55:19.906550+0000","last_fullsized":"2023-05-21T16:55:19.906550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896328+0000","last_change":"2023-05-21T16:55:19.896328+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896328+0000","last_undegraded":"2023-05-21T16:55:19.896328+0000","last_fullsized":"2023-05-21T16:55:19.896328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897815+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:55:19.897815+0000","last_peered":"2023-05-21T16:55:19.897815+0000","last_clean":"2023-05-21T16:55:19.897815+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:55:19.897815+0000","last_undegraded":"2023-05-21T16:55:19.897815+0000","last_fullsized":"2023-05-21T16:55:19.897815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:36.989098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.900123+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:55:19.900123+0000","last_peered":"2023-05-21T16:55:19.900123+0000","last_clean":"2023-05-21T16:55:19.900123+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:55:19.900123+0000","last_undegraded":"2023-05-21T16:55:19.900123+0000","last_fullsized":"2023-05-21T16:55:19.900123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:15:49.250261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.898488+0000","last_change":"2023-05-21T16:55:19.898488+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.898488+0000","last_undegraded":"2023-05-21T16:55:19.898488+0000","last_fullsized":"2023-05-21T16:55:19.898488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897647+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:55:19.897647+0000","last_peered":"2023-05-21T16:55:19.897647+0000","last_clean":"2023-05-21T16:55:19.897647+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:55:19.897647+0000","last_undegraded":"2023-05-21T16:55:19.897647+0000","last_fullsized":"2023-05-21T16:55:19.897647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:29.681321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.908843+0000","last_change":"2023-05-21T16:55:19.908843+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.908843+0000","last_undegraded":"2023-05-21T16:55:19.908843+0000","last_fullsized":"2023-05-21T16:55:19.908843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909706+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:55:19.909706+0000","last_peered":"2023-05-21T16:55:19.909706+0000","last_clean":"2023-05-21T16:55:19.909706+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:55:19.909706+0000","last_undegraded":"2023-05-21T16:55:19.909706+0000","last_fullsized":"2023-05-21T16:55:19.909706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:19:06.481702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.905676+0000","last_change":"2023-05-21T16:55:19.905676+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.905676+0000","last_undegraded":"2023-05-21T16:55:19.905676+0000","last_fullsized":"2023-05-21T16:55:19.905676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897375+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:55:19.897375+0000","last_peered":"2023-05-21T16:55:19.897375+0000","last_clean":"2023-05-21T16:55:19.897375+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:55:19.897375+0000","last_undegraded":"2023-05-21T16:55:19.897375+0000","last_fullsized":"2023-05-21T16:55:19.897375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:49.636380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.905934+0000","last_change":"2023-05-21T16:55:19.905934+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.905934+0000","last_undegraded":"2023-05-21T16:55:19.905934+0000","last_fullsized":"2023-05-21T16:55:19.905934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909003+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:55:19.909003+0000","last_peered":"2023-05-21T16:55:19.909003+0000","last_clean":"2023-05-21T16:55:19.909003+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:55:19.909003+0000","last_undegraded":"2023-05-21T16:55:19.909003+0000","last_fullsized":"2023-05-21T16:55:19.909003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:11:45.556188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902579+0000","last_change":"2023-05-21T16:55:19.902579+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902579+0000","last_undegraded":"2023-05-21T16:55:19.902579+0000","last_fullsized":"2023-05-21T16:55:19.902579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.898243+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:55:19.898243+0000","last_peered":"2023-05-21T16:55:19.898243+0000","last_clean":"2023-05-21T16:55:19.898243+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:55:19.898243+0000","last_undegraded":"2023-05-21T16:55:19.898243+0000","last_fullsized":"2023-05-21T16:55:19.898243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:58:20.208504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.901182+0000","last_change":"2023-05-21T16:55:19.901182+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.901182+0000","last_undegraded":"2023-05-21T16:55:19.901182+0000","last_fullsized":"2023-05-21T16:55:19.901182+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909001+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:55:19.909001+0000","last_peered":"2023-05-21T16:55:19.909001+0000","last_clean":"2023-05-21T16:55:19.909001+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:55:19.909001+0000","last_undegraded":"2023-05-21T16:55:19.909001+0000","last_fullsized":"2023-05-21T16:55:19.909001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:15.144296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904380+0000","last_change":"2023-05-21T16:55:19.904380+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904380+0000","last_undegraded":"2023-05-21T16:55:19.904380+0000","last_fullsized":"2023-05-21T16:55:19.904380+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.903405+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:55:19.903405+0000","last_peered":"2023-05-21T16:55:19.903405+0000","last_clean":"2023-05-21T16:55:19.903405+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:55:19.903405+0000","last_undegraded":"2023-05-21T16:55:19.903405+0000","last_fullsized":"2023-05-21T16:55:19.903405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:26.337916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.034}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.89600000000000002}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.628},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.872}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.93999999999999995}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8204,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363636,"statfs":{"total":96636764160,"available":96628363264,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0189999999999999}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.91000000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73199999999999998}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.095},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.141}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.76700000000000002}]},{"osd":1,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.02},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.96099999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0409999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363444,"statfs":{"total":96636764160,"available":96628166656,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.012},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.91300000000000003}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.874}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.081},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12428,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359412,"statfs":{"total":96636764160,"available":96624037888,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12364,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359476,"statfs":{"total":96636764160,"available":96624103424,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81000000000000005}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.286},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.141}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.121}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.556},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.034}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.427},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.2450000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12416,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359424,"statfs":{"total":96636764160,"available":96624050176,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.71099999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.173}]},{"osd":7,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.218},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.018}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13520,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358320,"statfs":{"total":96636764160,"available":96622919680,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.74399999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1519999999999999}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.014},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.254}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.054}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:55:25.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:55:26.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 Processor -- start 2023-05-21T16:55:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 -- start start 2023-05-21T16:55:26.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 0x7f1d9c0e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d9c0e4f50 0x7f1d9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0e0af0 con 0x7f1d9c0e12a0 2023-05-21T16:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c0e45f0 con 0x7f1d9c0e4f50 2023-05-21T16:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.103+0000 7f1da359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c050f00 con 0x7f1d9c037b40 2023-05-21T16:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 0x7f1d9c0e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da2d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d9c0e4f50 0x7f1d9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 0x7f1d9c0e4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:49444/0 (socket says 172.21.15.46:49444) 2023-05-21T16:55:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 -- 172.21.15.46:0/346129885 learned_addr learned my addr 172.21.15.46:0/346129885 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:26.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 -- 172.21.15.46:0/346129885 >> v2:172.21.15.142:3300/0 conn(0x7f1d9c0e4f50 msgr2=0x7f1d9c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:26.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 --2- 172.21.15.46:0/346129885 >> v2:172.21.15.142:3300/0 conn(0x7f1d9c0e4f50 0x7f1d9c036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 -- 172.21.15.46:0/346129885 >> v1:172.21.15.142:6789/0 conn(0x7f1d9c0e12a0 legacy=0x7f1d9c0e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 -- 172.21.15.46:0/346129885 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c051150 con 0x7f1d9c037b40 2023-05-21T16:55:26.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da1d9b700 1 --2- 172.21.15.46:0/346129885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 0x7f1d9c0e4a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009910 tx=0x7f1d8c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffe0a283ea31245 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da159a700 1 -- 172.21.15.46:0/346129885 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c011830 con 0x7f1d9c037b40 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da159a700 1 -- 172.21.15.46:0/346129885 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c011990 con 0x7f1d9c037b40 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da159a700 1 -- 172.21.15.46:0/346129885 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c011d40 con 0x7f1d9c037b40 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 -- 172.21.15.46:0/346129885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 msgr2=0x7f1d9c0e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 --2- 172.21.15.46:0/346129885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 0x7f1d9c0e4a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009910 tx=0x7f1d8c009c20 comp rx=0 tx=0).stop 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 -- 172.21.15.46:0/346129885 shutdown_connections 2023-05-21T16:55:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 --2- 172.21.15.46:0/346129885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c037b40 0x7f1d9c0e4a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 --2- 172.21.15.46:0/346129885 >> v2:172.21.15.142:3300/0 conn(0x7f1d9c0e4f50 0x7f1d9c036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 -- 172.21.15.46:0/346129885 >> 172.21.15.46:0/346129885 conn(0x7f1d9c051770 msgr2=0x7f1d9c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:26.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 -- 172.21.15.46:0/346129885 shutdown_connections 2023-05-21T16:55:26.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 -- 172.21.15.46:0/346129885 wait complete. 2023-05-21T16:55:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 Processor -- start 2023-05-21T16:55:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.107+0000 7f1da359e700 1 -- start start 2023-05-21T16:55:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 0x7f1d9c048820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d9c0e12a0 0x7f1d9c0dce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c0e4f50 0x7f1d9c04ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c049b60 con 0x7f1d9c037b40 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c048ee0 con 0x7f1d9c0e12a0 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0491c0 con 0x7f1d9c0e4f50 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 0x7f1d9c048820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 0x7f1d9c048820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45384/0 (socket says 172.21.15.46:45384) 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 -- 172.21.15.46:0/3647029157 learned_addr learned my addr 172.21.15.46:0/3647029157 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da1d9b700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d9c0e12a0 0x7f1d9c0dce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da2d9d700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c0e4f50 0x7f1d9c04ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 -- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c0e4f50 msgr2=0x7f1d9c04ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c0e4f50 0x7f1d9c04ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 -- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d9c0e12a0 msgr2=0x7f1d9c0dce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d9c0e12a0 0x7f1d9c0dce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 -- 172.21.15.46:0/3647029157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009570 con 0x7f1d9c037b40 2023-05-21T16:55:26.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da259c700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 0x7f1d9c048820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400c500 tx=0x7f1d9400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940052d0 con 0x7f1d9c037b40 2023-05-21T16:55:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d94005430 con 0x7f1d9c037b40 2023-05-21T16:55:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0e4210 con 0x7f1d9c037b40 2023-05-21T16:55:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940055a0 con 0x7f1d9c037b40 2023-05-21T16:55:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.111+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c051430 con 0x7f1d9c037b40 2023-05-21T16:55:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.115+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c037f90 con 0x7f1d9c037b40 2023-05-21T16:55:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.115+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d940038e0 con 0x7f1d9c037b40 2023-05-21T16:55:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.115+0000 7f1d9affd700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1d840662f0 0x7f1d840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.115+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d94082fc0 con 0x7f1d9c037b40 2023-05-21T16:55:26.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.115+0000 7f1da1d9b700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1d840662f0 0x7f1d840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.115+0000 7f1da1d9b700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1d840662f0 0x7f1d840687a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c000c00 tx=0x7f1d8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.123+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1d940b36f0 con 0x7f1d9c037b40 2023-05-21T16:55:26.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.279+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d9c0e0af0 con 0x7f1d840662f0 2023-05-21T16:55:26.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.299+0000 7f1d9affd700 1 -- 172.21.15.46:0/3647029157 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297748 (secure 0 0 0) 0x7f1d9c0e0af0 con 0x7f1d840662f0 2023-05-21T16:55:26.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:26.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1d840662f0 msgr2=0x7f1d840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1d840662f0 0x7f1d840687a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c000c00 tx=0x7f1d8c008030 comp rx=0 tx=0).stop 2023-05-21T16:55:26.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 msgr2=0x7f1d9c048820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 0x7f1d9c048820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400c500 tx=0x7f1d9400c810 comp rx=0 tx=0).stop 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 shutdown_connections 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1d840662f0 0x7f1d840687a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d9c0e4f50 0x7f1d9c04ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d9c0e12a0 0x7f1d9c0dce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 --2- 172.21.15.46:0/3647029157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d9c037b40 0x7f1d9c048820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 >> 172.21.15.46:0/3647029157 conn(0x7f1d9c051770 msgr2=0x7f1d9c0e3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:26.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 shutdown_connections 2023-05-21T16:55:26.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.307+0000 7f1da359e700 1 -- 172.21.15.46:0/3647029157 wait complete. 2023-05-21T16:55:26.311 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:55:26.328 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-05-21T16:55:24.804857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":85084,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":80768,"kb_avail":754889636,"statfs":{"total":773094113280,"available":773006987264,"internally_reserved":0,"allocated":4354048,"data_stored":2451766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82706432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912893"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902321+0000","last_change":"2023-05-21T16:55:19.902321+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902321+0000","last_undegraded":"2023-05-21T16:55:19.902321+0000","last_fullsized":"2023-05-21T16:55:19.902321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906946+0000","last_change":"2023-05-21T16:55:19.906946+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906946+0000","last_undegraded":"2023-05-21T16:55:19.906946+0000","last_fullsized":"2023-05-21T16:55:19.906946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902861+0000","last_change":"2023-05-21T16:55:19.902861+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902861+0000","last_undegraded":"2023-05-21T16:55:19.902861+0000","last_fullsized":"2023-05-21T16:55:19.902861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900150+0000","last_change":"2023-05-21T16:55:19.900150+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900150+0000","last_undegraded":"2023-05-21T16:55:19.900150+0000","last_fullsized":"2023-05-21T16:55:19.900150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.899728+0000","last_change":"2023-05-21T16:55:19.899728+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.899728+0000","last_undegraded":"2023-05-21T16:55:19.899728+0000","last_fullsized":"2023-05-21T16:55:19.899728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896766+0000","last_change":"2023-05-21T16:55:19.896766+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896766+0000","last_undegraded":"2023-05-21T16:55:19.896766+0000","last_fullsized":"2023-05-21T16:55:19.896766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.901629+0000","last_change":"2023-05-21T16:55:19.901629+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.901629+0000","last_undegraded":"2023-05-21T16:55:19.901629+0000","last_fullsized":"2023-05-21T16:55:19.901629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900549+0000","last_change":"2023-05-21T16:55:19.900549+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900549+0000","last_undegraded":"2023-05-21T16:55:19.900549+0000","last_fullsized":"2023-05-21T16:55:19.900549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904565+0000","last_change":"2023-05-21T16:55:19.904565+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904565+0000","last_undegraded":"2023-05-21T16:55:19.904565+0000","last_fullsized":"2023-05-21T16:55:19.904565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.900319+0000","last_change":"2023-05-21T16:55:19.900319+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.900319+0000","last_undegraded":"2023-05-21T16:55:19.900319+0000","last_fullsized":"2023-05-21T16:55:19.900319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.897761+0000","last_change":"2023-05-21T16:55:19.897761+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.897761+0000","last_undegraded":"2023-05-21T16:55:19.897761+0000","last_fullsized":"2023-05-21T16:55:19.897761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904403+0000","last_change":"2023-05-21T16:55:19.904403+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904403+0000","last_undegraded":"2023-05-21T16:55:19.904403+0000","last_fullsized":"2023-05-21T16:55:19.904403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904180+0000","last_change":"2023-05-21T16:55:19.904180+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904180+0000","last_undegraded":"2023-05-21T16:55:19.904180+0000","last_fullsized":"2023-05-21T16:55:19.904180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902319+0000","last_change":"2023-05-21T16:55:19.902319+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902319+0000","last_undegraded":"2023-05-21T16:55:19.902319+0000","last_fullsized":"2023-05-21T16:55:19.902319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902354+0000","last_change":"2023-05-21T16:55:19.902354+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902354+0000","last_undegraded":"2023-05-21T16:55:19.902354+0000","last_fullsized":"2023-05-21T16:55:19.902354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896316+0000","last_change":"2023-05-21T16:55:19.896316+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896316+0000","last_undegraded":"2023-05-21T16:55:19.896316+0000","last_fullsized":"2023-05-21T16:55:19.896316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.899017+0000","last_change":"2023-05-21T16:55:19.899017+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.899017+0000","last_undegraded":"2023-05-21T16:55:19.899017+0000","last_fullsized":"2023-05-21T16:55:19.899017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.898375+0000","last_change":"2023-05-21T16:55:19.898375+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.898375+0000","last_undegraded":"2023-05-21T16:55:19.898375+0000","last_fullsized":"2023-05-21T16:55:19.898375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.909219+0000","last_change":"2023-05-21T16:55:19.909219+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.909219+0000","last_undegraded":"2023-05-21T16:55:19.909219+0000","last_fullsized":"2023-05-21T16:55:19.909219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902096+0000","last_change":"2023-05-21T16:55:19.902096+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902096+0000","last_undegraded":"2023-05-21T16:55:19.902096+0000","last_fullsized":"2023-05-21T16:55:19.902096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.909192+0000","last_change":"2023-05-21T16:55:19.909192+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.909192+0000","last_undegraded":"2023-05-21T16:55:19.909192+0000","last_fullsized":"2023-05-21T16:55:19.909192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906612+0000","last_change":"2023-05-21T16:55:19.906612+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906612+0000","last_undegraded":"2023-05-21T16:55:19.906612+0000","last_fullsized":"2023-05-21T16:55:19.906612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896830+0000","last_change":"2023-05-21T16:55:19.896830+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896830+0000","last_undegraded":"2023-05-21T16:55:19.896830+0000","last_fullsized":"2023-05-21T16:55:19.896830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.906550+0000","last_change":"2023-05-21T16:55:19.906550+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.906550+0000","last_undegraded":"2023-05-21T16:55:19.906550+0000","last_fullsized":"2023-05-21T16:55:19.906550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.896328+0000","last_change":"2023-05-21T16:55:19.896328+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.896328+0000","last_undegraded":"2023-05-21T16:55:19.896328+0000","last_fullsized":"2023-05-21T16:55:19.896328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897815+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:55:19.897815+0000","last_peered":"2023-05-21T16:55:19.897815+0000","last_clean":"2023-05-21T16:55:19.897815+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:55:19.897815+0000","last_undegraded":"2023-05-21T16:55:19.897815+0000","last_fullsized":"2023-05-21T16:55:19.897815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:46:36.989098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.900123+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:55:19.900123+0000","last_peered":"2023-05-21T16:55:19.900123+0000","last_clean":"2023-05-21T16:55:19.900123+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:55:19.900123+0000","last_undegraded":"2023-05-21T16:55:19.900123+0000","last_fullsized":"2023-05-21T16:55:19.900123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:15:49.250261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.898488+0000","last_change":"2023-05-21T16:55:19.898488+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.898488+0000","last_undegraded":"2023-05-21T16:55:19.898488+0000","last_fullsized":"2023-05-21T16:55:19.898488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897647+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:55:19.897647+0000","last_peered":"2023-05-21T16:55:19.897647+0000","last_clean":"2023-05-21T16:55:19.897647+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:55:19.897647+0000","last_undegraded":"2023-05-21T16:55:19.897647+0000","last_fullsized":"2023-05-21T16:55:19.897647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:55:29.681321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.908843+0000","last_change":"2023-05-21T16:55:19.908843+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.908843+0000","last_undegraded":"2023-05-21T16:55:19.908843+0000","last_fullsized":"2023-05-21T16:55:19.908843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909706+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:55:19.909706+0000","last_peered":"2023-05-21T16:55:19.909706+0000","last_clean":"2023-05-21T16:55:19.909706+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:55:19.909706+0000","last_undegraded":"2023-05-21T16:55:19.909706+0000","last_fullsized":"2023-05-21T16:55:19.909706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:19:06.481702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.905676+0000","last_change":"2023-05-21T16:55:19.905676+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.905676+0000","last_undegraded":"2023-05-21T16:55:19.905676+0000","last_fullsized":"2023-05-21T16:55:19.905676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.897375+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:55:19.897375+0000","last_peered":"2023-05-21T16:55:19.897375+0000","last_clean":"2023-05-21T16:55:19.897375+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:55:19.897375+0000","last_undegraded":"2023-05-21T16:55:19.897375+0000","last_fullsized":"2023-05-21T16:55:19.897375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:19:49.636380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.905934+0000","last_change":"2023-05-21T16:55:19.905934+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.905934+0000","last_undegraded":"2023-05-21T16:55:19.905934+0000","last_fullsized":"2023-05-21T16:55:19.905934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909003+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:55:19.909003+0000","last_peered":"2023-05-21T16:55:19.909003+0000","last_clean":"2023-05-21T16:55:19.909003+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:55:19.909003+0000","last_undegraded":"2023-05-21T16:55:19.909003+0000","last_fullsized":"2023-05-21T16:55:19.909003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:11:45.556188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.902579+0000","last_change":"2023-05-21T16:55:19.902579+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.902579+0000","last_undegraded":"2023-05-21T16:55:19.902579+0000","last_fullsized":"2023-05-21T16:55:19.902579+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.898243+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:55:19.898243+0000","last_peered":"2023-05-21T16:55:19.898243+0000","last_clean":"2023-05-21T16:55:19.898243+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:55:19.898243+0000","last_undegraded":"2023-05-21T16:55:19.898243+0000","last_fullsized":"2023-05-21T16:55:19.898243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:58:20.208504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.901182+0000","last_change":"2023-05-21T16:55:19.901182+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.901182+0000","last_undegraded":"2023-05-21T16:55:19.901182+0000","last_fullsized":"2023-05-21T16:55:19.901182+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.909001+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:55:19.909001+0000","last_peered":"2023-05-21T16:55:19.909001+0000","last_clean":"2023-05-21T16:55:19.909001+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:55:19.909001+0000","last_undegraded":"2023-05-21T16:55:19.909001+0000","last_fullsized":"2023-05-21T16:55:19.909001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:41:15.144296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-21T16:55:20.890342+0000","last_change":"2023-05-21T16:55:20.890342+0000","last_active":"2023-05-21T16:55:20.890342+0000","last_peered":"2023-05-21T16:55:20.890342+0000","last_clean":"2023-05-21T16:55:20.890342+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:20.890342+0000","last_undegraded":"2023-05-21T16:55:20.890342+0000","last_fullsized":"2023-05-21T16:55:20.890342+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-05-21T16:55:19.904380+0000","last_change":"2023-05-21T16:55:19.904380+0000","last_active":"2023-05-21T16:55:19.886476+0000","last_peered":"2023-05-21T16:55:19.886476+0000","last_clean":"2023-05-21T16:55:19.886476+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-21T16:55:19.904380+0000","last_undegraded":"2023-05-21T16:55:19.904380+0000","last_fullsized":"2023-05-21T16:55:19.904380+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-05-21T16:55:19.903405+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:55:19.903405+0000","last_peered":"2023-05-21T16:55:19.903405+0000","last_clean":"2023-05-21T16:55:19.903405+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:55:19.903405+0000","last_undegraded":"2023-05-21T16:55:19.903405+0000","last_fullsized":"2023-05-21T16:55:19.903405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:26.337916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9424,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362416,"statfs":{"total":96636764160,"available":96627113984,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.034}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.89600000000000002}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.628},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.872}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.93999999999999995}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8204,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363636,"statfs":{"total":96636764160,"available":96628363264,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0189999999999999}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.91000000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73199999999999998}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.99299999999999999}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.095},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.141}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8332,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363508,"statfs":{"total":96636764160,"available":96628232192,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.76700000000000002}]},{"osd":1,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.70799999999999996}]},{"osd":2,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.02},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.96099999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0409999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363444,"statfs":{"total":96636764160,"available":96628166656,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.012},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.91300000000000003}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.874}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.081},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12428,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359412,"statfs":{"total":96636764160,"available":96624037888,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12364,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359476,"statfs":{"total":96636764160,"available":96624103424,"internally_reserved":0,"allocated":397312,"data_stored":159650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.81000000000000005}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.286},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.141}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.121}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.556},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.034}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.427},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.2450000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12416,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359424,"statfs":{"total":96636764160,"available":96624050176,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.628},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.71099999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.173}]},{"osd":7,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.218},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.018}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13520,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358320,"statfs":{"total":96636764160,"available":96622919680,"internally_reserved":0,"allocated":991232,"data_stored":750018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.74399999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1519999999999999}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.014},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.254}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.054}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:55:26.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-05-21T16:55:26.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-05-21T16:55:26.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-05-21T16:55:26.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-05-21T16:55:26.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-05-21T16:55:26.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-05-21T16:55:26.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-05-21T16:55:26.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-05-21T16:55:26.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-05-21T16:55:26.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-05-21T16:55:26.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-05-21T16:55:26.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-05-21T16:55:26.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-05-21T16:55:26.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-05-21T16:55:26.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-05-21T16:55:26.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-05-21T16:55:26.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-05-21T16:55:26.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-05-21T16:55:26.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-05-21T16:55:26.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-05-21T16:55:26.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-05-21T16:55:26.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-05-21T16:55:26.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-05-21T16:55:26.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-05-21T16:55:26.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-05-21T16:55:26.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-05-21T16:55:26.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-05-21T16:55:26.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-05-21T16:55:26.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-05-21T16:55:26.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-05-21T16:55:26.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-05-21T16:55:26.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-05-21T16:55:26.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-05-21T16:55:26.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-05-21T16:55:26.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.902321+0000', 'last_change': '2023-05-21T16:55:19.902321+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.902321+0000', 'last_undegraded': '2023-05-21T16:55:19.902321+0000', 'last_fullsized': '2023-05-21T16:55:19.902321+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-21T16:55:26.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-05-21T16:55:26.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-05-21T16:55:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.906946+0000', 'last_change': '2023-05-21T16:55:19.906946+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.906946+0000', 'last_undegraded': '2023-05-21T16:55:19.906946+0000', 'last_fullsized': '2023-05-21T16:55:19.906946+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-21T16:55:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-05-21T16:55:26.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-05-21T16:55:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.902861+0000', 'last_change': '2023-05-21T16:55:19.902861+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.902861+0000', 'last_undegraded': '2023-05-21T16:55:19.902861+0000', 'last_fullsized': '2023-05-21T16:55:19.902861+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-21T16:55:26.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-05-21T16:55:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-05-21T16:55:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.900150+0000', 'last_change': '2023-05-21T16:55:19.900150+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.900150+0000', 'last_undegraded': '2023-05-21T16:55:19.900150+0000', 'last_fullsized': '2023-05-21T16:55:19.900150+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-21T16:55:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-05-21T16:55:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-05-21T16:55:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.899728+0000', 'last_change': '2023-05-21T16:55:19.899728+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.899728+0000', 'last_undegraded': '2023-05-21T16:55:19.899728+0000', 'last_fullsized': '2023-05-21T16:55:19.899728+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-21T16:55:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-05-21T16:55:26.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-05-21T16:55:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.896766+0000', 'last_change': '2023-05-21T16:55:19.896766+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.896766+0000', 'last_undegraded': '2023-05-21T16:55:19.896766+0000', 'last_fullsized': '2023-05-21T16:55:19.896766+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-21T16:55:26.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-05-21T16:55:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-05-21T16:55:26.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.901629+0000', 'last_change': '2023-05-21T16:55:19.901629+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.901629+0000', 'last_undegraded': '2023-05-21T16:55:19.901629+0000', 'last_fullsized': '2023-05-21T16:55:19.901629+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-21T16:55:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-05-21T16:55:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-05-21T16:55:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.900549+0000', 'last_change': '2023-05-21T16:55:19.900549+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.900549+0000', 'last_undegraded': '2023-05-21T16:55:19.900549+0000', 'last_fullsized': '2023-05-21T16:55:19.900549+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-21T16:55:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-05-21T16:55:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-05-21T16:55:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.904565+0000', 'last_change': '2023-05-21T16:55:19.904565+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.904565+0000', 'last_undegraded': '2023-05-21T16:55:19.904565+0000', 'last_fullsized': '2023-05-21T16:55:19.904565+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-21T16:55:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-05-21T16:55:26.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-05-21T16:55:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.900319+0000', 'last_change': '2023-05-21T16:55:19.900319+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.900319+0000', 'last_undegraded': '2023-05-21T16:55:19.900319+0000', 'last_fullsized': '2023-05-21T16:55:19.900319+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-21T16:55:26.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-05-21T16:55:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-05-21T16:55:26.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.897761+0000', 'last_change': '2023-05-21T16:55:19.897761+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.897761+0000', 'last_undegraded': '2023-05-21T16:55:19.897761+0000', 'last_fullsized': '2023-05-21T16:55:19.897761+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-21T16:55:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-05-21T16:55:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-05-21T16:55:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.904403+0000', 'last_change': '2023-05-21T16:55:19.904403+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.904403+0000', 'last_undegraded': '2023-05-21T16:55:19.904403+0000', 'last_fullsized': '2023-05-21T16:55:19.904403+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-21T16:55:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-05-21T16:55:26.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-05-21T16:55:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.904180+0000', 'last_change': '2023-05-21T16:55:19.904180+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.904180+0000', 'last_undegraded': '2023-05-21T16:55:19.904180+0000', 'last_fullsized': '2023-05-21T16:55:19.904180+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-21T16:55:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-05-21T16:55:26.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-05-21T16:55:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.902319+0000', 'last_change': '2023-05-21T16:55:19.902319+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.902319+0000', 'last_undegraded': '2023-05-21T16:55:19.902319+0000', 'last_fullsized': '2023-05-21T16:55:19.902319+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-21T16:55:26.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-05-21T16:55:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-05-21T16:55:26.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.902354+0000', 'last_change': '2023-05-21T16:55:19.902354+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.902354+0000', 'last_undegraded': '2023-05-21T16:55:19.902354+0000', 'last_fullsized': '2023-05-21T16:55:19.902354+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-21T16:55:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-05-21T16:55:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-05-21T16:55:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.896316+0000', 'last_change': '2023-05-21T16:55:19.896316+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.896316+0000', 'last_undegraded': '2023-05-21T16:55:19.896316+0000', 'last_fullsized': '2023-05-21T16:55:19.896316+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-21T16:55:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-05-21T16:55:26.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-05-21T16:55:26.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.899017+0000', 'last_change': '2023-05-21T16:55:19.899017+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.899017+0000', 'last_undegraded': '2023-05-21T16:55:19.899017+0000', 'last_fullsized': '2023-05-21T16:55:19.899017+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-21T16:55:26.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-05-21T16:55:26.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-05-21T16:55:26.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.898375+0000', 'last_change': '2023-05-21T16:55:19.898375+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.898375+0000', 'last_undegraded': '2023-05-21T16:55:19.898375+0000', 'last_fullsized': '2023-05-21T16:55:19.898375+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-21T16:55:26.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-05-21T16:55:26.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-05-21T16:55:26.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.909219+0000', 'last_change': '2023-05-21T16:55:19.909219+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.909219+0000', 'last_undegraded': '2023-05-21T16:55:19.909219+0000', 'last_fullsized': '2023-05-21T16:55:19.909219+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-21T16:55:26.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-05-21T16:55:26.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-05-21T16:55:26.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.902096+0000', 'last_change': '2023-05-21T16:55:19.902096+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.902096+0000', 'last_undegraded': '2023-05-21T16:55:19.902096+0000', 'last_fullsized': '2023-05-21T16:55:19.902096+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-21T16:55:26.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-05-21T16:55:26.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-05-21T16:55:26.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.909192+0000', 'last_change': '2023-05-21T16:55:19.909192+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.909192+0000', 'last_undegraded': '2023-05-21T16:55:19.909192+0000', 'last_fullsized': '2023-05-21T16:55:19.909192+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-21T16:55:26.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-05-21T16:55:26.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-05-21T16:55:26.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.906612+0000', 'last_change': '2023-05-21T16:55:19.906612+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.906612+0000', 'last_undegraded': '2023-05-21T16:55:19.906612+0000', 'last_fullsized': '2023-05-21T16:55:19.906612+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-21T16:55:26.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-05-21T16:55:26.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-05-21T16:55:26.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.896830+0000', 'last_change': '2023-05-21T16:55:19.896830+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.896830+0000', 'last_undegraded': '2023-05-21T16:55:19.896830+0000', 'last_fullsized': '2023-05-21T16:55:19.896830+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-21T16:55:26.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-05-21T16:55:26.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-05-21T16:55:26.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.906550+0000', 'last_change': '2023-05-21T16:55:19.906550+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.906550+0000', 'last_undegraded': '2023-05-21T16:55:19.906550+0000', 'last_fullsized': '2023-05-21T16:55:19.906550+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-21T16:55:26.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-05-21T16:55:26.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-05-21T16:55:26.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.896328+0000', 'last_change': '2023-05-21T16:55:19.896328+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.896328+0000', 'last_undegraded': '2023-05-21T16:55:19.896328+0000', 'last_fullsized': '2023-05-21T16:55:19.896328+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-21T16:55:26.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-05-21T16:55:26.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-05-21T16:55:26.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.898488+0000', 'last_change': '2023-05-21T16:55:19.898488+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.898488+0000', 'last_undegraded': '2023-05-21T16:55:19.898488+0000', 'last_fullsized': '2023-05-21T16:55:19.898488+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-21T16:55:26.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-05-21T16:55:26.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-05-21T16:55:26.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.908843+0000', 'last_change': '2023-05-21T16:55:19.908843+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.908843+0000', 'last_undegraded': '2023-05-21T16:55:19.908843+0000', 'last_fullsized': '2023-05-21T16:55:19.908843+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-21T16:55:26.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-05-21T16:55:26.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-05-21T16:55:26.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.905676+0000', 'last_change': '2023-05-21T16:55:19.905676+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.905676+0000', 'last_undegraded': '2023-05-21T16:55:19.905676+0000', 'last_fullsized': '2023-05-21T16:55:19.905676+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-21T16:55:26.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-05-21T16:55:26.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-05-21T16:55:26.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.905934+0000', 'last_change': '2023-05-21T16:55:19.905934+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.905934+0000', 'last_undegraded': '2023-05-21T16:55:19.905934+0000', 'last_fullsized': '2023-05-21T16:55:19.905934+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-21T16:55:26.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-05-21T16:55:26.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-05-21T16:55:26.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.902579+0000', 'last_change': '2023-05-21T16:55:19.902579+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.902579+0000', 'last_undegraded': '2023-05-21T16:55:19.902579+0000', 'last_fullsized': '2023-05-21T16:55:19.902579+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-05-21T16:55:26.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-05-21T16:55:26.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-05-21T16:55:26.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.901182+0000', 'last_change': '2023-05-21T16:55:19.901182+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.901182+0000', 'last_undegraded': '2023-05-21T16:55:19.901182+0000', 'last_fullsized': '2023-05-21T16:55:19.901182+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-21T16:55:26.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-05-21T16:55:26.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-21T16:55:20.890342+0000', 'last_change': '2023-05-21T16:55:20.890342+0000', 'last_active': '2023-05-21T16:55:20.890342+0000', 'last_peered': '2023-05-21T16:55:20.890342+0000', 'last_clean': '2023-05-21T16:55:20.890342+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:20.890342+0000', 'last_undegraded': '2023-05-21T16:55:20.890342+0000', 'last_fullsized': '2023-05-21T16:55:20.890342+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:20.890342+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-21T16:55:26.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-05-21T16:55:26.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-05-21T16:55:19.904380+0000', 'last_change': '2023-05-21T16:55:19.904380+0000', 'last_active': '2023-05-21T16:55:19.886476+0000', 'last_peered': '2023-05-21T16:55:19.886476+0000', 'last_clean': '2023-05-21T16:55:19.886476+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-21T16:55:19.904380+0000', 'last_undegraded': '2023-05-21T16:55:19.904380+0000', 'last_fullsized': '2023-05-21T16:55:19.904380+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'last_clean_scrub_stamp': '2023-05-21T16:55:19.886476+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-21T16:55:26.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-21T16:55:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 Processor -- start 2023-05-21T16:55:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 -- start start 2023-05-21T16:55:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c98070620 0x7f8c980709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c980cac30 0x7f8c9815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c9815e400 0x7f8c9815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980c8fc0 con 0x7f8c98070620 2023-05-21T16:55:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9815ed30 con 0x7f8c9815e400 2023-05-21T16:55:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ee34700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9815a770 con 0x7f8c980cac30 2023-05-21T16:55:26.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9de32700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c98070620 0x7f8c980709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9de32700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c98070620 0x7f8c980709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45400/0 (socket says 172.21.15.46:45400) 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c980cac30 0x7f8c9815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9e633700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c9815e400 0x7f8c9815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9de32700 1 -- 172.21.15.46:0/1032614455 learned_addr learned my addr 172.21.15.46:0/1032614455 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 -- 172.21.15.46:0/1032614455 >> v2:172.21.15.142:3300/0 conn(0x7f8c9815e400 msgr2=0x7f8c9815e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 --2- 172.21.15.46:0/1032614455 >> v2:172.21.15.142:3300/0 conn(0x7f8c9815e400 0x7f8c9815e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 -- 172.21.15.46:0/1032614455 >> v2:172.21.15.46:3300/0 conn(0x7f8c98070620 msgr2=0x7f8c980709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 --2- 172.21.15.46:0/1032614455 >> v2:172.21.15.46:3300/0 conn(0x7f8c98070620 0x7f8c980709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 -- 172.21.15.46:0/1032614455 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98070f30 con 0x7f8c980cac30 2023-05-21T16:55:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9d631700 1 --2- 172.21.15.46:0/1032614455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c980cac30 0x7f8c9815dec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c980703f0 tx=0x7f8c9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bdb77715b930d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ce30700 1 -- 172.21.15.46:0/1032614455 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400e070 con 0x7f8c980cac30 2023-05-21T16:55:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ce30700 1 -- 172.21.15.46:0/1032614455 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9400bb20 con 0x7f8c980cac30 2023-05-21T16:55:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.519+0000 7f8c9ce30700 1 -- 172.21.15.46:0/1032614455 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94012430 con 0x7f8c980cac30 2023-05-21T16:55:26.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1032614455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c980cac30 msgr2=0x7f8c9815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1032614455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c980cac30 0x7f8c9815dec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c980703f0 tx=0x7f8c9400b330 comp rx=0 tx=0).stop 2023-05-21T16:55:26.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1032614455 shutdown_connections 2023-05-21T16:55:26.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1032614455 >> v2:172.21.15.142:3300/0 conn(0x7f8c9815e400 0x7f8c9815e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1032614455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c980cac30 0x7f8c9815dec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1032614455 >> v2:172.21.15.46:3300/0 conn(0x7f8c98070620 0x7f8c980709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1032614455 >> 172.21.15.46:0/1032614455 conn(0x7f8c980ce970 msgr2=0x7f8c980ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1032614455 shutdown_connections 2023-05-21T16:55:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1032614455 wait complete. 2023-05-21T16:55:26.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 Processor -- start 2023-05-21T16:55:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 -- start start 2023-05-21T16:55:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.523+0000 7f8c9ee34700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c98070620 0x7f8c98157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 0x7f8c98155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9815e400 0x7f8c98159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c5b70 con 0x7f8c980cac30 2023-05-21T16:55:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98157d40 con 0x7f8c9815e400 2023-05-21T16:55:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98158020 con 0x7f8c98070620 2023-05-21T16:55:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 0x7f8c98155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 0x7f8c98155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45402/0 (socket says 172.21.15.46:45402) 2023-05-21T16:55:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 -- 172.21.15.46:0/1800421404 learned_addr learned my addr 172.21.15.46:0/1800421404 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9de32700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c98070620 0x7f8c98157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9e633700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9815e400 0x7f8c98159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 -- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c98070620 msgr2=0x7f8c98157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c98070620 0x7f8c98157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 -- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9815e400 msgr2=0x7f8c98159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9815e400 0x7f8c98159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 -- 172.21.15.46:0/1800421404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009a70 con 0x7f8c980cac30 2023-05-21T16:55:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9d631700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 0x7f8c98155a30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c94014040 tx=0x7f8c94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94012430 con 0x7f8c980cac30 2023-05-21T16:55:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94020070 con 0x7f8c980cac30 2023-05-21T16:55:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94004280 con 0x7f8c980cac30 2023-05-21T16:55:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c980c91d0 con 0x7f8c980cac30 2023-05-21T16:55:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9806ad70 con 0x7f8c980cac30 2023-05-21T16:55:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c980c94b0 con 0x7f8c980cac30 2023-05-21T16:55:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.527+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c940043e0 con 0x7f8c980cac30 2023-05-21T16:55:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.531+0000 7f8c8e7fc700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8c7c066320 0x7f8c7c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.531+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c94022070 con 0x7f8c980cac30 2023-05-21T16:55:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.531+0000 7f8c9de32700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8c7c066320 0x7f8c7c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.531+0000 7f8c9de32700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8c7c066320 0x7f8c7c0687d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006d10 tx=0x7f8c88009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.535+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8c94053030 con 0x7f8c980cac30 2023-05-21T16:55:26.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.763+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8c980733b0 con 0x7f8c980cac30 2023-05-21T16:55:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.763+0000 7f8c8e7fc700 1 -- 172.21.15.46:0/1800421404 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1268 (secure 0 0 0) 0x7f8c94056650 con 0x7f8c980cac30 2023-05-21T16:55:26.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:26.766 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1684688045,"num_in_osds":8,"osd_in_since":1684688036,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":87126016,"bytes_avail":773006987264,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5343}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-05-21T16:55:14.801997+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-05-21T16:55:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.763+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8c7c066320 msgr2=0x7f8c7c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.763+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8c7c066320 0x7f8c7c0687d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006d10 tx=0x7f8c88009290 comp rx=0 tx=0).stop 2023-05-21T16:55:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.763+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 msgr2=0x7f8c98155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.763+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 0x7f8c98155a30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c94014040 tx=0x7f8c94004af0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 shutdown_connections 2023-05-21T16:55:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f8c7c066320 0x7f8c7c0687d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9815e400 0x7f8c98159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c980cac30 0x7f8c98155a30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 --2- 172.21.15.46:0/1800421404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c98070620 0x7f8c98157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 >> 172.21.15.46:0/1800421404 conn(0x7f8c980ce970 msgr2=0x7f8c980af830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 shutdown_connections 2023-05-21T16:55:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.767+0000 7f8c9ee34700 1 -- 172.21.15.46:0/1800421404 wait complete. 2023-05-21T16:55:26.781 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-21T16:55:26.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:55:26.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.891+0000 7f18c0b90700 1 Processor -- start 2023-05-21T16:55:26.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.891+0000 7f18c0b90700 1 -- start start 2023-05-21T16:55:26.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18bc06c760 0x7f18bc06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc0cd170 0x7f18bc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc15d8b0 con 0x7f18bc15dd40 2023-05-21T16:55:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc1574e0 con 0x7f18bc06c760 2023-05-21T16:55:26.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc06d070 con 0x7f18bc0cd170 2023-05-21T16:55:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bb7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18bc06c760 0x7f18bc06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18baffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f18bc15dd40 0x7f18bc0cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:50814/0 (socket says 172.21.15.46:50814) 2023-05-21T16:55:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bbfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc0cd170 0x7f18bc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18baffd700 1 -- 172.21.15.46:0/655240320 learned_addr learned my addr 172.21.15.46:0/655240320 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18ba7fc700 1 -- 172.21.15.46:0/655240320 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397791779 0 0) 0x7f18bc15d8b0 con 0x7f18bc15dd40 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18ba7fc700 1 -- 172.21.15.46:0/655240320 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a40035d0 con 0x7f18bc15dd40 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bbfff700 1 -- 172.21.15.46:0/655240320 >> v2:172.21.15.142:3300/0 conn(0x7f18bc06c760 msgr2=0x7f18bc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bbfff700 1 --2- 172.21.15.46:0/655240320 >> v2:172.21.15.142:3300/0 conn(0x7f18bc06c760 0x7f18bc06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bbfff700 1 -- 172.21.15.46:0/655240320 >> v1:172.21.15.142:6789/0 conn(0x7f18bc15dd40 legacy=0x7f18bc0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bbfff700 1 -- 172.21.15.46:0/655240320 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0cdf00 con 0x7f18bc0cd170 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18bbfff700 1 --2- 172.21.15.46:0/655240320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc0cd170 0x7f18bc159ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009d90 tx=0x7f18b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9498ee913674530 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18ba7fc700 1 -- 172.21.15.46:0/655240320 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400e070 con 0x7f18bc0cd170 2023-05-21T16:55:26.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18ba7fc700 1 -- 172.21.15.46:0/655240320 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b400bb20 con 0x7f18bc0cd170 2023-05-21T16:55:26.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18ba7fc700 1 -- 172.21.15.46:0/655240320 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400be90 con 0x7f18bc0cd170 2023-05-21T16:55:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- 172.21.15.46:0/655240320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc0cd170 msgr2=0x7f18bc159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 --2- 172.21.15.46:0/655240320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc0cd170 0x7f18bc159ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009d90 tx=0x7f18b400b330 comp rx=0 tx=0).stop 2023-05-21T16:55:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- 172.21.15.46:0/655240320 shutdown_connections 2023-05-21T16:55:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 --2- 172.21.15.46:0/655240320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc0cd170 0x7f18bc159ad0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 --2- 172.21.15.46:0/655240320 >> v2:172.21.15.142:3300/0 conn(0x7f18bc06c760 0x7f18bc06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- 172.21.15.46:0/655240320 >> 172.21.15.46:0/655240320 conn(0x7f18bc0cf720 msgr2=0x7f18bc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:26.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- 172.21.15.46:0/655240320 shutdown_connections 2023-05-21T16:55:26.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.895+0000 7f18c0b90700 1 -- 172.21.15.46:0/655240320 wait complete. 2023-05-21T16:55:26.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 Processor -- start 2023-05-21T16:55:26.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 -- start start 2023-05-21T16:55:26.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc06c760 0x7f18bc1f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 0x7f18bc153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18bc15dd40 0x7f18bc1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc1f1e10 con 0x7f18bc0cd170 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc156490 con 0x7f18bc15dd40 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc1555a0 con 0x7f18bc06c760 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 0x7f18bc153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 0x7f18bc153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45406/0 (socket says 172.21.15.46:45406) 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 -- 172.21.15.46:0/714168451 learned_addr learned my addr 172.21.15.46:0/714168451 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18bbfff700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18bc15dd40 0x7f18bc1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18bb7fe700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc06c760 0x7f18bc1f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 -- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc06c760 msgr2=0x7f18bc1f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc06c760 0x7f18bc1f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 -- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18bc15dd40 msgr2=0x7f18bc1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:26.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18bc15dd40 0x7f18bc1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 -- 172.21.15.46:0/714168451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009a70 con 0x7f18bc0cd170 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18baffd700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 0x7f18bc153ac0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c4f0 tx=0x7f18b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0005d90 con 0x7f18bc0cd170 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b00070d0 con 0x7f18bc0cd170 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc15d260 con 0x7f18bc0cd170 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0007440 con 0x7f18bc0cd170 2023-05-21T16:55:26.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.899+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc0ce1e0 con 0x7f18bc0cd170 2023-05-21T16:55:26.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.903+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc15d540 con 0x7f18bc0cd170 2023-05-21T16:55:26.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.903+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18b00075a0 con 0x7f18bc0cd170 2023-05-21T16:55:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.903+0000 7f18a3fff700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18a80662f0 0x7f18a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.903+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18b0082f30 con 0x7f18bc0cd170 2023-05-21T16:55:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.903+0000 7f18bb7fe700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18a80662f0 0x7f18a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:26.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.903+0000 7f18bb7fe700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18a80662f0 0x7f18a80687a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b240 tx=0x7f18ac00b450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:26.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:26.911+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f18b00504f0 con 0x7f18bc0cd170 2023-05-21T16:55:27.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.071+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18bc0733b0 con 0x7f18a80662f0 2023-05-21T16:55:27.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.087+0000 7f18a3fff700 1 -- 172.21.15.46:0/714168451 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309638 (secure 0 0 0) 0x7f18bc0733b0 con 0x7f18a80662f0 2023-05-21T16:55:27.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18a80662f0 msgr2=0x7f18a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18a80662f0 0x7f18a80687a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b240 tx=0x7f18ac00b450 comp rx=0 tx=0).stop 2023-05-21T16:55:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 msgr2=0x7f18bc153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:27.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 0x7f18bc153ac0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c4f0 tx=0x7f18b000c800 comp rx=0 tx=0).stop 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 shutdown_connections 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f18a80662f0 0x7f18a80687a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18bc15dd40 0x7f18bc1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18bc0cd170 0x7f18bc153ac0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 --2- 172.21.15.46:0/714168451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18bc06c760 0x7f18bc1f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 >> 172.21.15.46:0/714168451 conn(0x7f18bc0cf720 msgr2=0x7f18bc1576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:27.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 shutdown_connections 2023-05-21T16:55:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:27.091+0000 7f18c0b90700 1 -- 172.21.15.46:0/714168451 wait complete. 2023-05-21T16:55:27.097 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:55:27.109 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-05-21T16:55:26.805408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":86664,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":81984,"kb_avail":754888056,"statfs":{"total":773094113280,"available":773005369344,"internally_reserved":0,"allocated":4726784,"data_stored":2625932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83951616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001831"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222665+0000","last_change":"2023-05-21T16:55:21.334183+0000","last_active":"2023-05-21T16:55:23.222665+0000","last_peered":"2023-05-21T16:55:23.222665+0000","last_clean":"2023-05-21T16:55:23.222665+0000","last_became_active":"2023-05-21T16:55:21.333712+0000","last_became_peered":"2023-05-21T16:55:21.333712+0000","last_unstale":"2023-05-21T16:55:23.222665+0000","last_undegraded":"2023-05-21T16:55:23.222665+0000","last_fullsized":"2023-05-21T16:55:23.222665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:29:39.951398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221414+0000","last_change":"2023-05-21T16:55:21.329156+0000","last_active":"2023-05-21T16:55:23.221414+0000","last_peered":"2023-05-21T16:55:23.221414+0000","last_clean":"2023-05-21T16:55:23.221414+0000","last_became_active":"2023-05-21T16:55:21.328883+0000","last_became_peered":"2023-05-21T16:55:21.328883+0000","last_unstale":"2023-05-21T16:55:23.221414+0000","last_undegraded":"2023-05-21T16:55:23.221414+0000","last_fullsized":"2023-05-21T16:55:23.221414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:04:04.183764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221859+0000","last_change":"2023-05-21T16:55:21.315825+0000","last_active":"2023-05-21T16:55:23.221859+0000","last_peered":"2023-05-21T16:55:23.221859+0000","last_clean":"2023-05-21T16:55:23.221859+0000","last_became_active":"2023-05-21T16:55:21.315507+0000","last_became_peered":"2023-05-21T16:55:21.315507+0000","last_unstale":"2023-05-21T16:55:23.221859+0000","last_undegraded":"2023-05-21T16:55:23.221859+0000","last_fullsized":"2023-05-21T16:55:23.221859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:56:37.953447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312812+0000","last_change":"2023-05-21T16:55:21.336343+0000","last_active":"2023-05-21T16:55:22.312812+0000","last_peered":"2023-05-21T16:55:22.312812+0000","last_clean":"2023-05-21T16:55:22.312812+0000","last_became_active":"2023-05-21T16:55:21.335866+0000","last_became_peered":"2023-05-21T16:55:21.335866+0000","last_unstale":"2023-05-21T16:55:22.312812+0000","last_undegraded":"2023-05-21T16:55:22.312812+0000","last_fullsized":"2023-05-21T16:55:22.312812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:42:21.410706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312329+0000","last_change":"2023-05-21T16:55:21.335673+0000","last_active":"2023-05-21T16:55:22.312329+0000","last_peered":"2023-05-21T16:55:22.312329+0000","last_clean":"2023-05-21T16:55:22.312329+0000","last_became_active":"2023-05-21T16:55:21.335387+0000","last_became_peered":"2023-05-21T16:55:21.335387+0000","last_unstale":"2023-05-21T16:55:22.312329+0000","last_undegraded":"2023-05-21T16:55:22.312329+0000","last_fullsized":"2023-05-21T16:55:22.312329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:33:55.761232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221456+0000","last_change":"2023-05-21T16:55:21.330529+0000","last_active":"2023-05-21T16:55:23.221456+0000","last_peered":"2023-05-21T16:55:23.221456+0000","last_clean":"2023-05-21T16:55:23.221456+0000","last_became_active":"2023-05-21T16:55:21.330214+0000","last_became_peered":"2023-05-21T16:55:21.330214+0000","last_unstale":"2023-05-21T16:55:23.221456+0000","last_undegraded":"2023-05-21T16:55:23.221456+0000","last_fullsized":"2023-05-21T16:55:23.221456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:04:04.183764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312085+0000","last_change":"2023-05-21T16:55:21.334015+0000","last_active":"2023-05-21T16:55:22.312085+0000","last_peered":"2023-05-21T16:55:22.312085+0000","last_clean":"2023-05-21T16:55:22.312085+0000","last_became_active":"2023-05-21T16:55:21.333724+0000","last_became_peered":"2023-05-21T16:55:21.333724+0000","last_unstale":"2023-05-21T16:55:22.312085+0000","last_undegraded":"2023-05-21T16:55:22.312085+0000","last_fullsized":"2023-05-21T16:55:22.312085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:44:48.717106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218974+0000","last_change":"2023-05-21T16:55:21.334381+0000","last_active":"2023-05-21T16:55:23.218974+0000","last_peered":"2023-05-21T16:55:23.218974+0000","last_clean":"2023-05-21T16:55:23.218974+0000","last_became_active":"2023-05-21T16:55:21.334034+0000","last_became_peered":"2023-05-21T16:55:21.334034+0000","last_unstale":"2023-05-21T16:55:23.218974+0000","last_undegraded":"2023-05-21T16:55:23.218974+0000","last_fullsized":"2023-05-21T16:55:23.218974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:02.383388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221250+0000","last_change":"2023-05-21T16:55:21.315863+0000","last_active":"2023-05-21T16:55:23.221250+0000","last_peered":"2023-05-21T16:55:23.221250+0000","last_clean":"2023-05-21T16:55:23.221250+0000","last_became_active":"2023-05-21T16:55:21.315568+0000","last_became_peered":"2023-05-21T16:55:21.315568+0000","last_unstale":"2023-05-21T16:55:23.221250+0000","last_undegraded":"2023-05-21T16:55:23.221250+0000","last_fullsized":"2023-05-21T16:55:23.221250+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:14:14.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314441+0000","last_change":"2023-05-21T16:55:21.311444+0000","last_active":"2023-05-21T16:55:22.314441+0000","last_peered":"2023-05-21T16:55:22.314441+0000","last_clean":"2023-05-21T16:55:22.314441+0000","last_became_active":"2023-05-21T16:55:21.311075+0000","last_became_peered":"2023-05-21T16:55:21.311075+0000","last_unstale":"2023-05-21T16:55:22.314441+0000","last_undegraded":"2023-05-21T16:55:22.314441+0000","last_fullsized":"2023-05-21T16:55:22.314441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:44:38.605771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314453+0000","last_change":"2023-05-21T16:55:21.328328+0000","last_active":"2023-05-21T16:55:22.314453+0000","last_peered":"2023-05-21T16:55:22.314453+0000","last_clean":"2023-05-21T16:55:22.314453+0000","last_became_active":"2023-05-21T16:55:21.328021+0000","last_became_peered":"2023-05-21T16:55:21.328021+0000","last_unstale":"2023-05-21T16:55:22.314453+0000","last_undegraded":"2023-05-21T16:55:22.314453+0000","last_fullsized":"2023-05-21T16:55:22.314453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:48:21.017094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221501+0000","last_change":"2023-05-21T16:55:21.318086+0000","last_active":"2023-05-21T16:55:23.221501+0000","last_peered":"2023-05-21T16:55:23.221501+0000","last_clean":"2023-05-21T16:55:23.221501+0000","last_became_active":"2023-05-21T16:55:21.317776+0000","last_became_peered":"2023-05-21T16:55:21.317776+0000","last_unstale":"2023-05-21T16:55:23.221501+0000","last_undegraded":"2023-05-21T16:55:23.221501+0000","last_fullsized":"2023-05-21T16:55:23.221501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:19:22.258470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314083+0000","last_change":"2023-05-21T16:55:21.316175+0000","last_active":"2023-05-21T16:55:22.314083+0000","last_peered":"2023-05-21T16:55:22.314083+0000","last_clean":"2023-05-21T16:55:22.314083+0000","last_became_active":"2023-05-21T16:55:21.315779+0000","last_became_peered":"2023-05-21T16:55:21.315779+0000","last_unstale":"2023-05-21T16:55:22.314083+0000","last_undegraded":"2023-05-21T16:55:22.314083+0000","last_fullsized":"2023-05-21T16:55:22.314083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:51:24.521619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218848+0000","last_change":"2023-05-21T16:55:21.328629+0000","last_active":"2023-05-21T16:55:23.218848+0000","last_peered":"2023-05-21T16:55:23.218848+0000","last_clean":"2023-05-21T16:55:23.218848+0000","last_became_active":"2023-05-21T16:55:21.328005+0000","last_became_peered":"2023-05-21T16:55:21.328005+0000","last_unstale":"2023-05-21T16:55:23.218848+0000","last_undegraded":"2023-05-21T16:55:23.218848+0000","last_fullsized":"2023-05-21T16:55:23.218848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:44:38.605771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313178+0000","last_change":"2023-05-21T16:55:21.321754+0000","last_active":"2023-05-21T16:55:22.313178+0000","last_peered":"2023-05-21T16:55:22.313178+0000","last_clean":"2023-05-21T16:55:22.313178+0000","last_became_active":"2023-05-21T16:55:21.321446+0000","last_became_peered":"2023-05-21T16:55:21.321446+0000","last_unstale":"2023-05-21T16:55:22.313178+0000","last_undegraded":"2023-05-21T16:55:22.313178+0000","last_fullsized":"2023-05-21T16:55:22.313178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:47.781944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312540+0000","last_change":"2023-05-21T16:55:21.317599+0000","last_active":"2023-05-21T16:55:22.312540+0000","last_peered":"2023-05-21T16:55:22.312540+0000","last_clean":"2023-05-21T16:55:22.312540+0000","last_became_active":"2023-05-21T16:55:21.316927+0000","last_became_peered":"2023-05-21T16:55:21.316927+0000","last_unstale":"2023-05-21T16:55:22.312540+0000","last_undegraded":"2023-05-21T16:55:22.312540+0000","last_fullsized":"2023-05-21T16:55:22.312540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:43:54.118874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313358+0000","last_change":"2023-05-21T16:55:21.316491+0000","last_active":"2023-05-21T16:55:22.313358+0000","last_peered":"2023-05-21T16:55:22.313358+0000","last_clean":"2023-05-21T16:55:22.313358+0000","last_became_active":"2023-05-21T16:55:21.315571+0000","last_became_peered":"2023-05-21T16:55:21.315571+0000","last_unstale":"2023-05-21T16:55:22.313358+0000","last_undegraded":"2023-05-21T16:55:22.313358+0000","last_fullsized":"2023-05-21T16:55:22.313358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:26:51.123295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219509+0000","last_change":"2023-05-21T16:55:21.330456+0000","last_active":"2023-05-21T16:55:23.219509+0000","last_peered":"2023-05-21T16:55:23.219509+0000","last_clean":"2023-05-21T16:55:23.219509+0000","last_became_active":"2023-05-21T16:55:21.330123+0000","last_became_peered":"2023-05-21T16:55:21.330123+0000","last_unstale":"2023-05-21T16:55:23.219509+0000","last_undegraded":"2023-05-21T16:55:23.219509+0000","last_fullsized":"2023-05-21T16:55:23.219509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:23:49.119448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313102+0000","last_change":"2023-05-21T16:55:21.326633+0000","last_active":"2023-05-21T16:55:22.313102+0000","last_peered":"2023-05-21T16:55:22.313102+0000","last_clean":"2023-05-21T16:55:22.313102+0000","last_became_active":"2023-05-21T16:55:21.326339+0000","last_became_peered":"2023-05-21T16:55:21.326339+0000","last_unstale":"2023-05-21T16:55:22.313102+0000","last_undegraded":"2023-05-21T16:55:22.313102+0000","last_fullsized":"2023-05-21T16:55:22.313102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:57:18.119787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219431+0000","last_change":"2023-05-21T16:55:21.329150+0000","last_active":"2023-05-21T16:55:23.219431+0000","last_peered":"2023-05-21T16:55:23.219431+0000","last_clean":"2023-05-21T16:55:23.219431+0000","last_became_active":"2023-05-21T16:55:21.328835+0000","last_became_peered":"2023-05-21T16:55:21.328835+0000","last_unstale":"2023-05-21T16:55:23.219431+0000","last_undegraded":"2023-05-21T16:55:23.219431+0000","last_fullsized":"2023-05-21T16:55:23.219431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:47:55.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313724+0000","last_change":"2023-05-21T16:55:21.316045+0000","last_active":"2023-05-21T16:55:22.313724+0000","last_peered":"2023-05-21T16:55:22.313724+0000","last_clean":"2023-05-21T16:55:22.313724+0000","last_became_active":"2023-05-21T16:55:21.315478+0000","last_became_peered":"2023-05-21T16:55:21.315478+0000","last_unstale":"2023-05-21T16:55:22.313724+0000","last_undegraded":"2023-05-21T16:55:22.313724+0000","last_fullsized":"2023-05-21T16:55:22.313724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:27:23.153491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219621+0000","last_change":"2023-05-21T16:55:21.328274+0000","last_active":"2023-05-21T16:55:23.219621+0000","last_peered":"2023-05-21T16:55:23.219621+0000","last_clean":"2023-05-21T16:55:23.219621+0000","last_became_active":"2023-05-21T16:55:21.327324+0000","last_became_peered":"2023-05-21T16:55:21.327324+0000","last_unstale":"2023-05-21T16:55:23.219621+0000","last_undegraded":"2023-05-21T16:55:23.219621+0000","last_fullsized":"2023-05-21T16:55:23.219621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:27:21.411341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312578+0000","last_change":"2023-05-21T16:55:21.320175+0000","last_active":"2023-05-21T16:55:22.312578+0000","last_peered":"2023-05-21T16:55:22.312578+0000","last_clean":"2023-05-21T16:55:22.312578+0000","last_became_active":"2023-05-21T16:55:21.319899+0000","last_became_peered":"2023-05-21T16:55:21.319899+0000","last_unstale":"2023-05-21T16:55:22.312578+0000","last_undegraded":"2023-05-21T16:55:22.312578+0000","last_fullsized":"2023-05-21T16:55:22.312578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:48:21.017094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.311968+0000","last_change":"2023-05-21T16:55:21.325208+0000","last_active":"2023-05-21T16:55:22.311968+0000","last_peered":"2023-05-21T16:55:22.311968+0000","last_clean":"2023-05-21T16:55:22.311968+0000","last_became_active":"2023-05-21T16:55:21.324910+0000","last_became_peered":"2023-05-21T16:55:21.324910+0000","last_unstale":"2023-05-21T16:55:22.311968+0000","last_undegraded":"2023-05-21T16:55:22.311968+0000","last_fullsized":"2023-05-21T16:55:22.311968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:18:40.956260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219895+0000","last_change":"2023-05-21T16:55:21.320780+0000","last_active":"2023-05-21T16:55:23.219895+0000","last_peered":"2023-05-21T16:55:23.219895+0000","last_clean":"2023-05-21T16:55:23.219895+0000","last_became_active":"2023-05-21T16:55:21.319881+0000","last_became_peered":"2023-05-21T16:55:21.319881+0000","last_unstale":"2023-05-21T16:55:23.219895+0000","last_undegraded":"2023-05-21T16:55:23.219895+0000","last_fullsized":"2023-05-21T16:55:23.219895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:39:19.494701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223861+0000","last_change":"2023-05-21T16:55:21.320636+0000","last_active":"2023-05-21T16:55:23.223861+0000","last_peered":"2023-05-21T16:55:23.223861+0000","last_clean":"2023-05-21T16:55:23.223861+0000","last_became_active":"2023-05-21T16:55:21.320304+0000","last_became_peered":"2023-05-21T16:55:21.320304+0000","last_unstale":"2023-05-21T16:55:23.223861+0000","last_undegraded":"2023-05-21T16:55:23.223861+0000","last_fullsized":"2023-05-21T16:55:23.223861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:50:11.350907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220086+0000","last_change":"2023-05-21T16:55:21.319844+0000","last_active":"2023-05-21T16:55:23.220086+0000","last_peered":"2023-05-21T16:55:23.220086+0000","last_clean":"2023-05-21T16:55:23.220086+0000","last_became_active":"2023-05-21T16:55:21.319548+0000","last_became_peered":"2023-05-21T16:55:21.319548+0000","last_unstale":"2023-05-21T16:55:23.220086+0000","last_undegraded":"2023-05-21T16:55:23.220086+0000","last_fullsized":"2023-05-21T16:55:23.220086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:46:18.585575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314432+0000","last_change":"2023-05-21T16:55:21.333803+0000","last_active":"2023-05-21T16:55:22.314432+0000","last_peered":"2023-05-21T16:55:22.314432+0000","last_clean":"2023-05-21T16:55:22.314432+0000","last_became_active":"2023-05-21T16:55:21.333489+0000","last_became_peered":"2023-05-21T16:55:21.333489+0000","last_unstale":"2023-05-21T16:55:22.314432+0000","last_undegraded":"2023-05-21T16:55:22.314432+0000","last_fullsized":"2023-05-21T16:55:22.314432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:43:54.118874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219205+0000","last_change":"2023-05-21T16:55:21.329037+0000","last_active":"2023-05-21T16:55:23.219205+0000","last_peered":"2023-05-21T16:55:23.219205+0000","last_clean":"2023-05-21T16:55:23.219205+0000","last_became_active":"2023-05-21T16:55:21.328615+0000","last_became_peered":"2023-05-21T16:55:21.328615+0000","last_unstale":"2023-05-21T16:55:23.219205+0000","last_undegraded":"2023-05-21T16:55:23.219205+0000","last_fullsized":"2023-05-21T16:55:23.219205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:36:47.822084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219428+0000","last_change":"2023-05-21T16:55:21.334304+0000","last_active":"2023-05-21T16:55:23.219428+0000","last_peered":"2023-05-21T16:55:23.219428+0000","last_clean":"2023-05-21T16:55:23.219428+0000","last_became_active":"2023-05-21T16:55:21.334028+0000","last_became_peered":"2023-05-21T16:55:21.334028+0000","last_unstale":"2023-05-21T16:55:23.219428+0000","last_undegraded":"2023-05-21T16:55:23.219428+0000","last_fullsized":"2023-05-21T16:55:23.219428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:37:44.753303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312783+0000","last_change":"2023-05-21T16:55:21.325855+0000","last_active":"2023-05-21T16:55:22.312783+0000","last_peered":"2023-05-21T16:55:22.312783+0000","last_clean":"2023-05-21T16:55:22.312783+0000","last_became_active":"2023-05-21T16:55:21.324626+0000","last_became_peered":"2023-05-21T16:55:21.324626+0000","last_unstale":"2023-05-21T16:55:22.312783+0000","last_undegraded":"2023-05-21T16:55:22.312783+0000","last_fullsized":"2023-05-21T16:55:22.312783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:24.788452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219863+0000","last_change":"2023-05-21T16:55:21.316032+0000","last_active":"2023-05-21T16:55:23.219863+0000","last_peered":"2023-05-21T16:55:23.219863+0000","last_clean":"2023-05-21T16:55:23.219863+0000","last_became_active":"2023-05-21T16:55:21.315382+0000","last_became_peered":"2023-05-21T16:55:21.315382+0000","last_unstale":"2023-05-21T16:55:23.219863+0000","last_undegraded":"2023-05-21T16:55:23.219863+0000","last_fullsized":"2023-05-21T16:55:23.219863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:50:46.719833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313000+0000","last_change":"2023-05-21T16:55:21.317259+0000","last_active":"2023-05-21T16:55:22.313000+0000","last_peered":"2023-05-21T16:55:22.313000+0000","last_clean":"2023-05-21T16:55:22.313000+0000","last_became_active":"2023-05-21T16:55:21.316818+0000","last_became_peered":"2023-05-21T16:55:21.316818+0000","last_unstale":"2023-05-21T16:55:22.313000+0000","last_undegraded":"2023-05-21T16:55:22.313000+0000","last_fullsized":"2023-05-21T16:55:22.313000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:12:17.004151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219791+0000","last_change":"2023-05-21T16:55:20.918591+0000","last_active":"2023-05-21T16:55:23.219791+0000","last_peered":"2023-05-21T16:55:23.219791+0000","last_clean":"2023-05-21T16:55:23.219791+0000","last_became_active":"2023-05-21T16:55:20.918286+0000","last_became_peered":"2023-05-21T16:55:20.918286+0000","last_unstale":"2023-05-21T16:55:23.219791+0000","last_undegraded":"2023-05-21T16:55:23.219791+0000","last_fullsized":"2023-05-21T16:55:23.219791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:09:18.857229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223145+0000","last_change":"2023-05-21T16:55:21.320645+0000","last_active":"2023-05-21T16:55:23.223145+0000","last_peered":"2023-05-21T16:55:23.223145+0000","last_clean":"2023-05-21T16:55:23.223145+0000","last_became_active":"2023-05-21T16:55:21.320384+0000","last_became_peered":"2023-05-21T16:55:21.320384+0000","last_unstale":"2023-05-21T16:55:23.223145+0000","last_undegraded":"2023-05-21T16:55:23.223145+0000","last_fullsized":"2023-05-21T16:55:23.223145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:01:31.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221954+0000","last_change":"2023-05-21T16:55:20.920752+0000","last_active":"2023-05-21T16:55:23.221954+0000","last_peered":"2023-05-21T16:55:23.221954+0000","last_clean":"2023-05-21T16:55:23.221954+0000","last_became_active":"2023-05-21T16:55:20.920288+0000","last_became_peered":"2023-05-21T16:55:20.920288+0000","last_unstale":"2023-05-21T16:55:23.221954+0000","last_undegraded":"2023-05-21T16:55:23.221954+0000","last_fullsized":"2023-05-21T16:55:23.221954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:10:35.920314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220841+0000","last_change":"2023-05-21T16:55:21.328406+0000","last_active":"2023-05-21T16:55:23.220841+0000","last_peered":"2023-05-21T16:55:23.220841+0000","last_clean":"2023-05-21T16:55:23.220841+0000","last_became_active":"2023-05-21T16:55:21.327457+0000","last_became_peered":"2023-05-21T16:55:21.327457+0000","last_unstale":"2023-05-21T16:55:23.220841+0000","last_undegraded":"2023-05-21T16:55:23.220841+0000","last_fullsized":"2023-05-21T16:55:23.220841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:22:24.032159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223480+0000","last_change":"2023-05-21T16:55:20.925123+0000","last_active":"2023-05-21T16:55:23.223480+0000","last_peered":"2023-05-21T16:55:23.223480+0000","last_clean":"2023-05-21T16:55:23.223480+0000","last_became_active":"2023-05-21T16:55:20.924844+0000","last_became_peered":"2023-05-21T16:55:20.924844+0000","last_unstale":"2023-05-21T16:55:23.223480+0000","last_undegraded":"2023-05-21T16:55:23.223480+0000","last_fullsized":"2023-05-21T16:55:23.223480+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:56:19.034470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222471+0000","last_change":"2023-05-21T16:55:21.333979+0000","last_active":"2023-05-21T16:55:23.222471+0000","last_peered":"2023-05-21T16:55:23.222471+0000","last_clean":"2023-05-21T16:55:23.222471+0000","last_became_active":"2023-05-21T16:55:21.333403+0000","last_became_peered":"2023-05-21T16:55:21.333403+0000","last_unstale":"2023-05-21T16:55:23.222471+0000","last_undegraded":"2023-05-21T16:55:23.222471+0000","last_fullsized":"2023-05-21T16:55:23.222471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:56:20.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220721+0000","last_change":"2023-05-21T16:55:20.925136+0000","last_active":"2023-05-21T16:55:23.220721+0000","last_peered":"2023-05-21T16:55:23.220721+0000","last_clean":"2023-05-21T16:55:23.220721+0000","last_became_active":"2023-05-21T16:55:20.924787+0000","last_became_peered":"2023-05-21T16:55:20.924787+0000","last_unstale":"2023-05-21T16:55:23.220721+0000","last_undegraded":"2023-05-21T16:55:23.220721+0000","last_fullsized":"2023-05-21T16:55:23.220721+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:29.013165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218979+0000","last_change":"2023-05-21T16:55:21.322061+0000","last_active":"2023-05-21T16:55:23.218979+0000","last_peered":"2023-05-21T16:55:23.218979+0000","last_clean":"2023-05-21T16:55:23.218979+0000","last_became_active":"2023-05-21T16:55:21.321811+0000","last_became_peered":"2023-05-21T16:55:21.321811+0000","last_unstale":"2023-05-21T16:55:23.218979+0000","last_undegraded":"2023-05-21T16:55:23.218979+0000","last_fullsized":"2023-05-21T16:55:23.218979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:16:57.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313861+0000","last_change":"2023-05-21T16:55:20.917560+0000","last_active":"2023-05-21T16:55:22.313861+0000","last_peered":"2023-05-21T16:55:22.313861+0000","last_clean":"2023-05-21T16:55:22.313861+0000","last_became_active":"2023-05-21T16:55:20.917267+0000","last_became_peered":"2023-05-21T16:55:20.917267+0000","last_unstale":"2023-05-21T16:55:22.313861+0000","last_undegraded":"2023-05-21T16:55:22.313861+0000","last_fullsized":"2023-05-21T16:55:22.313861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:31:46.916305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313598+0000","last_change":"2023-05-21T16:55:21.321758+0000","last_active":"2023-05-21T16:55:22.313598+0000","last_peered":"2023-05-21T16:55:22.313598+0000","last_clean":"2023-05-21T16:55:22.313598+0000","last_became_active":"2023-05-21T16:55:21.321048+0000","last_became_peered":"2023-05-21T16:55:21.321048+0000","last_unstale":"2023-05-21T16:55:22.313598+0000","last_undegraded":"2023-05-21T16:55:22.313598+0000","last_fullsized":"2023-05-21T16:55:22.313598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:12:54.720047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313232+0000","last_change":"2023-05-21T16:55:20.923169+0000","last_active":"2023-05-21T16:55:22.313232+0000","last_peered":"2023-05-21T16:55:22.313232+0000","last_clean":"2023-05-21T16:55:22.313232+0000","last_became_active":"2023-05-21T16:55:20.922899+0000","last_became_peered":"2023-05-21T16:55:20.922899+0000","last_unstale":"2023-05-21T16:55:22.313232+0000","last_undegraded":"2023-05-21T16:55:22.313232+0000","last_fullsized":"2023-05-21T16:55:22.313232+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:26:01.503903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219993+0000","last_change":"2023-05-21T16:55:21.328452+0000","last_active":"2023-05-21T16:55:23.219993+0000","last_peered":"2023-05-21T16:55:23.219993+0000","last_clean":"2023-05-21T16:55:23.219993+0000","last_became_active":"2023-05-21T16:55:21.327712+0000","last_became_peered":"2023-05-21T16:55:21.327712+0000","last_unstale":"2023-05-21T16:55:23.219993+0000","last_undegraded":"2023-05-21T16:55:23.219993+0000","last_fullsized":"2023-05-21T16:55:23.219993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:24.788452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220934+0000","last_change":"2023-05-21T16:55:20.925274+0000","last_active":"2023-05-21T16:55:23.220934+0000","last_peered":"2023-05-21T16:55:23.220934+0000","last_clean":"2023-05-21T16:55:23.220934+0000","last_became_active":"2023-05-21T16:55:20.925008+0000","last_became_peered":"2023-05-21T16:55:20.925008+0000","last_unstale":"2023-05-21T16:55:23.220934+0000","last_undegraded":"2023-05-21T16:55:23.220934+0000","last_fullsized":"2023-05-21T16:55:23.220934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:14:28.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220103+0000","last_change":"2023-05-21T16:55:21.331912+0000","last_active":"2023-05-21T16:55:23.220103+0000","last_peered":"2023-05-21T16:55:23.220103+0000","last_clean":"2023-05-21T16:55:23.220103+0000","last_became_active":"2023-05-21T16:55:21.330558+0000","last_became_peered":"2023-05-21T16:55:21.330558+0000","last_unstale":"2023-05-21T16:55:23.220103+0000","last_undegraded":"2023-05-21T16:55:23.220103+0000","last_fullsized":"2023-05-21T16:55:23.220103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:52:26.118920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218690+0000","last_change":"2023-05-21T16:55:20.919419+0000","last_active":"2023-05-21T16:55:23.218690+0000","last_peered":"2023-05-21T16:55:23.218690+0000","last_clean":"2023-05-21T16:55:23.218690+0000","last_became_active":"2023-05-21T16:55:20.919047+0000","last_became_peered":"2023-05-21T16:55:20.919047+0000","last_unstale":"2023-05-21T16:55:23.218690+0000","last_undegraded":"2023-05-21T16:55:23.218690+0000","last_fullsized":"2023-05-21T16:55:23.218690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:43:53.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312924+0000","last_change":"2023-05-21T16:55:21.335873+0000","last_active":"2023-05-21T16:55:22.312924+0000","last_peered":"2023-05-21T16:55:22.312924+0000","last_clean":"2023-05-21T16:55:22.312924+0000","last_became_active":"2023-05-21T16:55:21.335546+0000","last_became_peered":"2023-05-21T16:55:21.335546+0000","last_unstale":"2023-05-21T16:55:22.312924+0000","last_undegraded":"2023-05-21T16:55:22.312924+0000","last_fullsized":"2023-05-21T16:55:22.312924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:50:07.183063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222539+0000","last_change":"2023-05-21T16:55:20.920908+0000","last_active":"2023-05-21T16:55:23.222539+0000","last_peered":"2023-05-21T16:55:23.222539+0000","last_clean":"2023-05-21T16:55:23.222539+0000","last_became_active":"2023-05-21T16:55:20.920571+0000","last_became_peered":"2023-05-21T16:55:20.920571+0000","last_unstale":"2023-05-21T16:55:23.222539+0000","last_undegraded":"2023-05-21T16:55:23.222539+0000","last_fullsized":"2023-05-21T16:55:23.222539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:50:10.347041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313130+0000","last_change":"2023-05-21T16:55:21.324675+0000","last_active":"2023-05-21T16:55:22.313130+0000","last_peered":"2023-05-21T16:55:22.313130+0000","last_clean":"2023-05-21T16:55:22.313130+0000","last_became_active":"2023-05-21T16:55:21.324369+0000","last_became_peered":"2023-05-21T16:55:21.324369+0000","last_unstale":"2023-05-21T16:55:22.313130+0000","last_undegraded":"2023-05-21T16:55:22.313130+0000","last_fullsized":"2023-05-21T16:55:22.313130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:42.833642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314762+0000","last_change":"2023-05-21T16:55:20.921697+0000","last_active":"2023-05-21T16:55:22.314762+0000","last_peered":"2023-05-21T16:55:22.314762+0000","last_clean":"2023-05-21T16:55:22.314762+0000","last_became_active":"2023-05-21T16:55:20.921269+0000","last_became_peered":"2023-05-21T16:55:20.921269+0000","last_unstale":"2023-05-21T16:55:22.314762+0000","last_undegraded":"2023-05-21T16:55:22.314762+0000","last_fullsized":"2023-05-21T16:55:22.314762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:03:29.599729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221872+0000","last_change":"2023-05-21T16:55:21.311422+0000","last_active":"2023-05-21T16:55:23.221872+0000","last_peered":"2023-05-21T16:55:23.221872+0000","last_clean":"2023-05-21T16:55:23.221872+0000","last_became_active":"2023-05-21T16:55:21.310468+0000","last_became_peered":"2023-05-21T16:55:21.310468+0000","last_unstale":"2023-05-21T16:55:23.221872+0000","last_undegraded":"2023-05-21T16:55:23.221872+0000","last_fullsized":"2023-05-21T16:55:23.221872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:59:28.480630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314916+0000","last_change":"2023-05-21T16:55:20.925248+0000","last_active":"2023-05-21T16:55:22.314916+0000","last_peered":"2023-05-21T16:55:22.314916+0000","last_clean":"2023-05-21T16:55:22.314916+0000","last_became_active":"2023-05-21T16:55:20.924646+0000","last_became_peered":"2023-05-21T16:55:20.924646+0000","last_unstale":"2023-05-21T16:55:22.314916+0000","last_undegraded":"2023-05-21T16:55:22.314916+0000","last_fullsized":"2023-05-21T16:55:22.314916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:23.784587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220520+0000","last_change":"2023-05-21T16:55:21.327653+0000","last_active":"2023-05-21T16:55:23.220520+0000","last_peered":"2023-05-21T16:55:23.220520+0000","last_clean":"2023-05-21T16:55:23.220520+0000","last_became_active":"2023-05-21T16:55:21.327338+0000","last_became_peered":"2023-05-21T16:55:21.327338+0000","last_unstale":"2023-05-21T16:55:23.220520+0000","last_undegraded":"2023-05-21T16:55:23.220520+0000","last_fullsized":"2023-05-21T16:55:23.220520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:02.904408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221021+0000","last_change":"2023-05-21T16:55:20.923503+0000","last_active":"2023-05-21T16:55:23.221021+0000","last_peered":"2023-05-21T16:55:23.221021+0000","last_clean":"2023-05-21T16:55:23.221021+0000","last_became_active":"2023-05-21T16:55:20.922810+0000","last_became_peered":"2023-05-21T16:55:20.922810+0000","last_unstale":"2023-05-21T16:55:23.221021+0000","last_undegraded":"2023-05-21T16:55:23.221021+0000","last_fullsized":"2023-05-21T16:55:23.221021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:14:28.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221868+0000","last_change":"2023-05-21T16:55:21.317725+0000","last_active":"2023-05-21T16:55:23.221868+0000","last_peered":"2023-05-21T16:55:23.221868+0000","last_clean":"2023-05-21T16:55:23.221868+0000","last_became_active":"2023-05-21T16:55:21.317416+0000","last_became_peered":"2023-05-21T16:55:21.317416+0000","last_unstale":"2023-05-21T16:55:23.221868+0000","last_undegraded":"2023-05-21T16:55:23.221868+0000","last_fullsized":"2023-05-21T16:55:23.221868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:47:50.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221017+0000","last_change":"2023-05-21T16:55:20.922458+0000","last_active":"2023-05-21T16:55:23.221017+0000","last_peered":"2023-05-21T16:55:23.221017+0000","last_clean":"2023-05-21T16:55:23.221017+0000","last_became_active":"2023-05-21T16:55:20.922157+0000","last_became_peered":"2023-05-21T16:55:20.922157+0000","last_unstale":"2023-05-21T16:55:23.221017+0000","last_undegraded":"2023-05-21T16:55:23.221017+0000","last_fullsized":"2023-05-21T16:55:23.221017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:27:06.703381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222183+0000","last_change":"2023-05-21T16:55:21.330313+0000","last_active":"2023-05-21T16:55:23.222183+0000","last_peered":"2023-05-21T16:55:23.222183+0000","last_clean":"2023-05-21T16:55:23.222183+0000","last_became_active":"2023-05-21T16:55:21.330064+0000","last_became_peered":"2023-05-21T16:55:21.330064+0000","last_unstale":"2023-05-21T16:55:23.222183+0000","last_undegraded":"2023-05-21T16:55:23.222183+0000","last_fullsized":"2023-05-21T16:55:23.222183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:01:31.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221706+0000","last_change":"2023-05-21T16:55:20.922360+0000","last_active":"2023-05-21T16:55:23.221706+0000","last_peered":"2023-05-21T16:55:23.221706+0000","last_clean":"2023-05-21T16:55:23.221706+0000","last_became_active":"2023-05-21T16:55:20.922084+0000","last_became_peered":"2023-05-21T16:55:20.922084+0000","last_unstale":"2023-05-21T16:55:23.221706+0000","last_undegraded":"2023-05-21T16:55:23.221706+0000","last_fullsized":"2023-05-21T16:55:23.221706+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:44:39.641353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312557+0000","last_change":"2023-05-21T16:55:21.317388+0000","last_active":"2023-05-21T16:55:22.312557+0000","last_peered":"2023-05-21T16:55:22.312557+0000","last_clean":"2023-05-21T16:55:22.312557+0000","last_became_active":"2023-05-21T16:55:21.317097+0000","last_became_peered":"2023-05-21T16:55:21.317097+0000","last_unstale":"2023-05-21T16:55:22.312557+0000","last_undegraded":"2023-05-21T16:55:22.312557+0000","last_fullsized":"2023-05-21T16:55:22.312557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:44:38.605771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218636+0000","last_change":"2023-05-21T16:55:20.913455+0000","last_active":"2023-05-21T16:55:23.218636+0000","last_peered":"2023-05-21T16:55:23.218636+0000","last_clean":"2023-05-21T16:55:23.218636+0000","last_became_active":"2023-05-21T16:55:20.913077+0000","last_became_peered":"2023-05-21T16:55:20.913077+0000","last_unstale":"2023-05-21T16:55:23.218636+0000","last_undegraded":"2023-05-21T16:55:23.218636+0000","last_fullsized":"2023-05-21T16:55:23.218636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:57:17.115921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220440+0000","last_change":"2023-05-21T16:55:21.332100+0000","last_active":"2023-05-21T16:55:23.220440+0000","last_peered":"2023-05-21T16:55:23.220440+0000","last_clean":"2023-05-21T16:55:23.220440+0000","last_became_active":"2023-05-21T16:55:21.330950+0000","last_became_peered":"2023-05-21T16:55:21.330950+0000","last_unstale":"2023-05-21T16:55:23.220440+0000","last_undegraded":"2023-05-21T16:55:23.220440+0000","last_fullsized":"2023-05-21T16:55:23.220440+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:42.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312289+0000","last_change":"2023-05-21T16:55:20.915169+0000","last_active":"2023-05-21T16:55:22.312289+0000","last_peered":"2023-05-21T16:55:22.312289+0000","last_clean":"2023-05-21T16:55:22.312289+0000","last_became_active":"2023-05-21T16:55:20.914877+0000","last_became_peered":"2023-05-21T16:55:20.914877+0000","last_unstale":"2023-05-21T16:55:22.312289+0000","last_undegraded":"2023-05-21T16:55:22.312289+0000","last_fullsized":"2023-05-21T16:55:22.312289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:33:03.979410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220588+0000","last_change":"2023-05-21T16:55:21.333714+0000","last_active":"2023-05-21T16:55:23.220588+0000","last_peered":"2023-05-21T16:55:23.220588+0000","last_clean":"2023-05-21T16:55:23.220588+0000","last_became_active":"2023-05-21T16:55:21.333364+0000","last_became_peered":"2023-05-21T16:55:21.333364+0000","last_unstale":"2023-05-21T16:55:23.220588+0000","last_undegraded":"2023-05-21T16:55:23.220588+0000","last_fullsized":"2023-05-21T16:55:23.220588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:50:46.719833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.315195+0000","last_change":"2023-05-21T16:55:20.916286+0000","last_active":"2023-05-21T16:55:22.315195+0000","last_peered":"2023-05-21T16:55:22.315195+0000","last_clean":"2023-05-21T16:55:22.315195+0000","last_became_active":"2023-05-21T16:55:20.915916+0000","last_became_peered":"2023-05-21T16:55:20.915916+0000","last_unstale":"2023-05-21T16:55:22.315195+0000","last_undegraded":"2023-05-21T16:55:22.315195+0000","last_fullsized":"2023-05-21T16:55:22.315195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:12:16.000285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.315087+0000","last_change":"2023-05-21T16:55:21.312276+0000","last_active":"2023-05-21T16:55:22.315087+0000","last_peered":"2023-05-21T16:55:22.315087+0000","last_clean":"2023-05-21T16:55:22.315087+0000","last_became_active":"2023-05-21T16:55:21.312006+0000","last_became_peered":"2023-05-21T16:55:21.312006+0000","last_unstale":"2023-05-21T16:55:22.315087+0000","last_undegraded":"2023-05-21T16:55:22.315087+0000","last_fullsized":"2023-05-21T16:55:22.315087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:02.904408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220979+0000","last_change":"2023-05-21T16:55:20.918105+0000","last_active":"2023-05-21T16:55:23.220979+0000","last_peered":"2023-05-21T16:55:23.220979+0000","last_clean":"2023-05-21T16:55:23.220979+0000","last_became_active":"2023-05-21T16:55:20.917836+0000","last_became_peered":"2023-05-21T16:55:20.917836+0000","last_unstale":"2023-05-21T16:55:23.220979+0000","last_undegraded":"2023-05-21T16:55:23.220979+0000","last_fullsized":"2023-05-21T16:55:23.220979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:41.829776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220750+0000","last_change":"2023-05-21T16:55:21.327773+0000","last_active":"2023-05-21T16:55:23.220750+0000","last_peered":"2023-05-21T16:55:23.220750+0000","last_clean":"2023-05-21T16:55:23.220750+0000","last_became_active":"2023-05-21T16:55:21.327113+0000","last_became_peered":"2023-05-21T16:55:21.327113+0000","last_unstale":"2023-05-21T16:55:23.220750+0000","last_undegraded":"2023-05-21T16:55:23.220750+0000","last_fullsized":"2023-05-21T16:55:23.220750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:12:17.004151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313150+0000","last_change":"2023-05-21T16:55:20.921322+0000","last_active":"2023-05-21T16:55:22.313150+0000","last_peered":"2023-05-21T16:55:22.313150+0000","last_clean":"2023-05-21T16:55:22.313150+0000","last_became_active":"2023-05-21T16:55:20.920860+0000","last_became_peered":"2023-05-21T16:55:20.920860+0000","last_unstale":"2023-05-21T16:55:22.313150+0000","last_undegraded":"2023-05-21T16:55:22.313150+0000","last_fullsized":"2023-05-21T16:55:22.313150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:52:36.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313086+0000","last_change":"2023-05-21T16:55:21.335108+0000","last_active":"2023-05-21T16:55:22.313086+0000","last_peered":"2023-05-21T16:55:22.313086+0000","last_clean":"2023-05-21T16:55:22.313086+0000","last_became_active":"2023-05-21T16:55:21.334817+0000","last_became_peered":"2023-05-21T16:55:21.334817+0000","last_unstale":"2023-05-21T16:55:22.313086+0000","last_undegraded":"2023-05-21T16:55:22.313086+0000","last_fullsized":"2023-05-21T16:55:22.313086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:22:46.561040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219618+0000","last_change":"2023-05-21T16:55:20.921105+0000","last_active":"2023-05-21T16:55:23.219618+0000","last_peered":"2023-05-21T16:55:23.219618+0000","last_clean":"2023-05-21T16:55:23.219618+0000","last_became_active":"2023-05-21T16:55:20.920793+0000","last_became_peered":"2023-05-21T16:55:20.920793+0000","last_unstale":"2023-05-21T16:55:23.219618+0000","last_undegraded":"2023-05-21T16:55:23.219618+0000","last_fullsized":"2023-05-21T16:55:23.219618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:41.014227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312875+0000","last_change":"2023-05-21T16:55:21.317761+0000","last_active":"2023-05-21T16:55:22.312875+0000","last_peered":"2023-05-21T16:55:22.312875+0000","last_clean":"2023-05-21T16:55:22.312875+0000","last_became_active":"2023-05-21T16:55:21.317293+0000","last_became_peered":"2023-05-21T16:55:21.317293+0000","last_unstale":"2023-05-21T16:55:22.312875+0000","last_undegraded":"2023-05-21T16:55:22.312875+0000","last_fullsized":"2023-05-21T16:55:22.312875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:02.904408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312482+0000","last_change":"2023-05-21T16:55:20.912949+0000","last_active":"2023-05-21T16:55:22.312482+0000","last_peered":"2023-05-21T16:55:22.312482+0000","last_clean":"2023-05-21T16:55:22.312482+0000","last_became_active":"2023-05-21T16:55:20.912614+0000","last_became_peered":"2023-05-21T16:55:20.912614+0000","last_unstale":"2023-05-21T16:55:22.312482+0000","last_undegraded":"2023-05-21T16:55:22.312482+0000","last_fullsized":"2023-05-21T16:55:22.312482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:50:55.917922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219913+0000","last_change":"2023-05-21T16:55:21.311063+0000","last_active":"2023-05-21T16:55:23.219913+0000","last_peered":"2023-05-21T16:55:23.219913+0000","last_clean":"2023-05-21T16:55:23.219913+0000","last_became_active":"2023-05-21T16:55:21.310640+0000","last_became_peered":"2023-05-21T16:55:21.310640+0000","last_unstale":"2023-05-21T16:55:23.219913+0000","last_undegraded":"2023-05-21T16:55:23.219913+0000","last_fullsized":"2023-05-21T16:55:23.219913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:37:55.326727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312122+0000","last_change":"2023-05-21T16:55:20.920290+0000","last_active":"2023-05-21T16:55:22.312122+0000","last_peered":"2023-05-21T16:55:22.312122+0000","last_clean":"2023-05-21T16:55:22.312122+0000","last_became_active":"2023-05-21T16:55:20.918978+0000","last_became_peered":"2023-05-21T16:55:20.918978+0000","last_unstale":"2023-05-21T16:55:22.312122+0000","last_undegraded":"2023-05-21T16:55:22.312122+0000","last_fullsized":"2023-05-21T16:55:22.312122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:24.938385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313942+0000","last_change":"2023-05-21T16:55:21.322877+0000","last_active":"2023-05-21T16:55:22.313942+0000","last_peered":"2023-05-21T16:55:22.313942+0000","last_clean":"2023-05-21T16:55:22.313942+0000","last_became_active":"2023-05-21T16:55:21.322560+0000","last_became_peered":"2023-05-21T16:55:21.322560+0000","last_unstale":"2023-05-21T16:55:22.313942+0000","last_undegraded":"2023-05-21T16:55:22.313942+0000","last_fullsized":"2023-05-21T16:55:22.313942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:20:22.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312681+0000","last_change":"2023-05-21T16:55:20.922068+0000","last_active":"2023-05-21T16:55:22.312681+0000","last_peered":"2023-05-21T16:55:22.312681+0000","last_clean":"2023-05-21T16:55:22.312681+0000","last_became_active":"2023-05-21T16:55:20.921721+0000","last_became_peered":"2023-05-21T16:55:20.921721+0000","last_unstale":"2023-05-21T16:55:22.312681+0000","last_undegraded":"2023-05-21T16:55:22.312681+0000","last_fullsized":"2023-05-21T16:55:22.312681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:03:29.599729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220790+0000","last_change":"2023-05-21T16:55:21.332282+0000","last_active":"2023-05-21T16:55:23.220790+0000","last_peered":"2023-05-21T16:55:23.220790+0000","last_clean":"2023-05-21T16:55:23.220790+0000","last_became_active":"2023-05-21T16:55:21.331233+0000","last_became_peered":"2023-05-21T16:55:21.331233+0000","last_unstale":"2023-05-21T16:55:23.220790+0000","last_undegraded":"2023-05-21T16:55:23.220790+0000","last_fullsized":"2023-05-21T16:55:23.220790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:08:53.381100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312129+0000","last_change":"2023-05-21T16:55:20.912890+0000","last_active":"2023-05-21T16:55:22.312129+0000","last_peered":"2023-05-21T16:55:22.312129+0000","last_clean":"2023-05-21T16:55:22.312129+0000","last_became_active":"2023-05-21T16:55:20.912630+0000","last_became_peered":"2023-05-21T16:55:20.912630+0000","last_unstale":"2023-05-21T16:55:22.312129+0000","last_undegraded":"2023-05-21T16:55:22.312129+0000","last_fullsized":"2023-05-21T16:55:22.312129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:43:17.654191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314810+0000","last_change":"2023-05-21T16:55:21.333818+0000","last_active":"2023-05-21T16:55:22.314810+0000","last_peered":"2023-05-21T16:55:22.314810+0000","last_clean":"2023-05-21T16:55:22.314810+0000","last_became_active":"2023-05-21T16:55:21.333512+0000","last_became_peered":"2023-05-21T16:55:21.333512+0000","last_unstale":"2023-05-21T16:55:22.314810+0000","last_undegraded":"2023-05-21T16:55:22.314810+0000","last_fullsized":"2023-05-21T16:55:22.314810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:27:21.411341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312999+0000","last_change":"2023-05-21T16:55:20.922009+0000","last_active":"2023-05-21T16:55:22.312999+0000","last_peered":"2023-05-21T16:55:22.312999+0000","last_clean":"2023-05-21T16:55:22.312999+0000","last_became_active":"2023-05-21T16:55:20.921470+0000","last_became_peered":"2023-05-21T16:55:20.921470+0000","last_unstale":"2023-05-21T16:55:22.312999+0000","last_undegraded":"2023-05-21T16:55:22.312999+0000","last_fullsized":"2023-05-21T16:55:22.312999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:22:23.028293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312911+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:55:22.312911+0000","last_peered":"2023-05-21T16:55:22.312911+0000","last_clean":"2023-05-21T16:55:22.312911+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:55:22.312911+0000","last_undegraded":"2023-05-21T16:55:22.312911+0000","last_fullsized":"2023-05-21T16:55:22.312911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:11:16.518532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314153+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:55:22.314153+0000","last_peered":"2023-05-21T16:55:22.314153+0000","last_clean":"2023-05-21T16:55:22.314153+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:55:22.314153+0000","last_undegraded":"2023-05-21T16:55:22.314153+0000","last_fullsized":"2023-05-21T16:55:22.314153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:31:56.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219400+0000","last_change":"2023-05-21T16:55:21.316461+0000","last_active":"2023-05-21T16:55:23.219400+0000","last_peered":"2023-05-21T16:55:23.219400+0000","last_clean":"2023-05-21T16:55:23.219400+0000","last_became_active":"2023-05-21T16:55:21.316200+0000","last_became_peered":"2023-05-21T16:55:21.316200+0000","last_unstale":"2023-05-21T16:55:23.219400+0000","last_undegraded":"2023-05-21T16:55:23.219400+0000","last_fullsized":"2023-05-21T16:55:23.219400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:52:26.118920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.315537+0000","last_change":"2023-05-21T16:55:20.921350+0000","last_active":"2023-05-21T16:55:22.315537+0000","last_peered":"2023-05-21T16:55:22.315537+0000","last_clean":"2023-05-21T16:55:22.315537+0000","last_became_active":"2023-05-21T16:55:20.921104+0000","last_became_peered":"2023-05-21T16:55:20.921104+0000","last_unstale":"2023-05-21T16:55:22.315537+0000","last_undegraded":"2023-05-21T16:55:22.315537+0000","last_fullsized":"2023-05-21T16:55:22.315537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:29.013165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312638+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:55:22.312638+0000","last_peered":"2023-05-21T16:55:22.312638+0000","last_clean":"2023-05-21T16:55:22.312638+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:55:22.312638+0000","last_undegraded":"2023-05-21T16:55:22.312638+0000","last_fullsized":"2023-05-21T16:55:22.312638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:26:13.139215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313361+0000","last_change":"2023-05-21T16:55:21.325556+0000","last_active":"2023-05-21T16:55:22.313361+0000","last_peered":"2023-05-21T16:55:22.313361+0000","last_clean":"2023-05-21T16:55:22.313361+0000","last_became_active":"2023-05-21T16:55:21.325228+0000","last_became_peered":"2023-05-21T16:55:21.325228+0000","last_unstale":"2023-05-21T16:55:22.313361+0000","last_undegraded":"2023-05-21T16:55:22.313361+0000","last_fullsized":"2023-05-21T16:55:22.313361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:54:10.849083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313074+0000","last_change":"2023-05-21T16:55:20.920687+0000","last_active":"2023-05-21T16:55:22.313074+0000","last_peered":"2023-05-21T16:55:22.313074+0000","last_clean":"2023-05-21T16:55:22.313074+0000","last_became_active":"2023-05-21T16:55:20.919442+0000","last_became_peered":"2023-05-21T16:55:20.919442+0000","last_unstale":"2023-05-21T16:55:22.313074+0000","last_undegraded":"2023-05-21T16:55:22.313074+0000","last_fullsized":"2023-05-21T16:55:22.313074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:49.781388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312225+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:55:22.312225+0000","last_peered":"2023-05-21T16:55:22.312225+0000","last_clean":"2023-05-21T16:55:22.312225+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:55:22.312225+0000","last_undegraded":"2023-05-21T16:55:22.312225+0000","last_fullsized":"2023-05-21T16:55:22.312225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:35:18.337478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221594+0000","last_change":"2023-05-21T16:55:21.329678+0000","last_active":"2023-05-21T16:55:23.221594+0000","last_peered":"2023-05-21T16:55:23.221594+0000","last_clean":"2023-05-21T16:55:23.221594+0000","last_became_active":"2023-05-21T16:55:21.329412+0000","last_became_peered":"2023-05-21T16:55:21.329412+0000","last_unstale":"2023-05-21T16:55:23.221594+0000","last_undegraded":"2023-05-21T16:55:23.221594+0000","last_fullsized":"2023-05-21T16:55:23.221594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:44:40.645219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221410+0000","last_change":"2023-05-21T16:55:20.926618+0000","last_active":"2023-05-21T16:55:23.221410+0000","last_peered":"2023-05-21T16:55:23.221410+0000","last_clean":"2023-05-21T16:55:23.221410+0000","last_became_active":"2023-05-21T16:55:20.926330+0000","last_became_peered":"2023-05-21T16:55:20.926330+0000","last_unstale":"2023-05-21T16:55:23.221410+0000","last_undegraded":"2023-05-21T16:55:23.221410+0000","last_fullsized":"2023-05-21T16:55:23.221410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:15:28.872425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314052+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:55:22.314052+0000","last_peered":"2023-05-21T16:55:22.314052+0000","last_clean":"2023-05-21T16:55:22.314052+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:55:22.314052+0000","last_undegraded":"2023-05-21T16:55:22.314052+0000","last_fullsized":"2023-05-21T16:55:22.314052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:39:22.743356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222099+0000","last_change":"2023-05-21T16:55:21.336714+0000","last_active":"2023-05-21T16:55:23.222099+0000","last_peered":"2023-05-21T16:55:23.222099+0000","last_clean":"2023-05-21T16:55:23.222099+0000","last_became_active":"2023-05-21T16:55:21.336419+0000","last_became_peered":"2023-05-21T16:55:21.336419+0000","last_unstale":"2023-05-21T16:55:23.222099+0000","last_undegraded":"2023-05-21T16:55:23.222099+0000","last_fullsized":"2023-05-21T16:55:23.222099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:38:48.182829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221128+0000","last_change":"2023-05-21T16:55:20.921499+0000","last_active":"2023-05-21T16:55:23.221128+0000","last_peered":"2023-05-21T16:55:23.221128+0000","last_clean":"2023-05-21T16:55:23.221128+0000","last_became_active":"2023-05-21T16:55:20.921225+0000","last_became_peered":"2023-05-21T16:55:20.921225+0000","last_unstale":"2023-05-21T16:55:23.221128+0000","last_undegraded":"2023-05-21T16:55:23.221128+0000","last_fullsized":"2023-05-21T16:55:23.221128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:22:54.134085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219898+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:55:23.219898+0000","last_peered":"2023-05-21T16:55:23.219898+0000","last_clean":"2023-05-21T16:55:23.219898+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:55:23.219898+0000","last_undegraded":"2023-05-21T16:55:23.219898+0000","last_fullsized":"2023-05-21T16:55:23.219898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:07:45.108974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220710+0000","last_change":"2023-05-21T16:55:21.321608+0000","last_active":"2023-05-21T16:55:23.220710+0000","last_peered":"2023-05-21T16:55:23.220710+0000","last_clean":"2023-05-21T16:55:23.220710+0000","last_became_active":"2023-05-21T16:55:21.321324+0000","last_became_peered":"2023-05-21T16:55:21.321324+0000","last_unstale":"2023-05-21T16:55:23.220710+0000","last_undegraded":"2023-05-21T16:55:23.220710+0000","last_fullsized":"2023-05-21T16:55:23.220710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:27:07.707246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218953+0000","last_change":"2023-05-21T16:55:20.920902+0000","last_active":"2023-05-21T16:55:23.218953+0000","last_peered":"2023-05-21T16:55:23.218953+0000","last_clean":"2023-05-21T16:55:23.218953+0000","last_became_active":"2023-05-21T16:55:20.920582+0000","last_became_peered":"2023-05-21T16:55:20.920582+0000","last_unstale":"2023-05-21T16:55:23.218953+0000","last_undegraded":"2023-05-21T16:55:23.218953+0000","last_fullsized":"2023-05-21T16:55:23.218953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:52:36.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313547+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:55:22.313547+0000","last_peered":"2023-05-21T16:55:22.313547+0000","last_clean":"2023-05-21T16:55:22.313547+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:55:22.313547+0000","last_undegraded":"2023-05-21T16:55:22.313547+0000","last_fullsized":"2023-05-21T16:55:22.313547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:42:22.331814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219854+0000","last_change":"2023-05-21T16:55:21.336236+0000","last_active":"2023-05-21T16:55:23.219854+0000","last_peered":"2023-05-21T16:55:23.219854+0000","last_clean":"2023-05-21T16:55:23.219854+0000","last_became_active":"2023-05-21T16:55:21.335801+0000","last_became_peered":"2023-05-21T16:55:21.335801+0000","last_unstale":"2023-05-21T16:55:23.219854+0000","last_undegraded":"2023-05-21T16:55:23.219854+0000","last_fullsized":"2023-05-21T16:55:23.219854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:03:30.603595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218917+0000","last_change":"2023-05-21T16:55:20.925944+0000","last_active":"2023-05-21T16:55:23.218917+0000","last_peered":"2023-05-21T16:55:23.218917+0000","last_clean":"2023-05-21T16:55:23.218917+0000","last_became_active":"2023-05-21T16:55:20.925505+0000","last_became_peered":"2023-05-21T16:55:20.925505+0000","last_unstale":"2023-05-21T16:55:23.218917+0000","last_undegraded":"2023-05-21T16:55:23.218917+0000","last_fullsized":"2023-05-21T16:55:23.218917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:48:20.013228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223971+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:55:23.223971+0000","last_peered":"2023-05-21T16:55:23.223971+0000","last_clean":"2023-05-21T16:55:23.223971+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:55:23.223971+0000","last_undegraded":"2023-05-21T16:55:23.223971+0000","last_fullsized":"2023-05-21T16:55:23.223971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:28:31.679272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313543+0000","last_change":"2023-05-21T16:55:21.324549+0000","last_active":"2023-05-21T16:55:22.313543+0000","last_peered":"2023-05-21T16:55:22.313543+0000","last_clean":"2023-05-21T16:55:22.313543+0000","last_became_active":"2023-05-21T16:55:21.324265+0000","last_became_peered":"2023-05-21T16:55:21.324265+0000","last_unstale":"2023-05-21T16:55:22.313543+0000","last_undegraded":"2023-05-21T16:55:22.313543+0000","last_fullsized":"2023-05-21T16:55:22.313543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:34:45.801191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218991+0000","last_change":"2023-05-21T16:55:20.922524+0000","last_active":"2023-05-21T16:55:23.218991+0000","last_peered":"2023-05-21T16:55:23.218991+0000","last_clean":"2023-05-21T16:55:23.218991+0000","last_became_active":"2023-05-21T16:55:20.922008+0000","last_became_peered":"2023-05-21T16:55:20.922008+0000","last_unstale":"2023-05-21T16:55:23.218991+0000","last_undegraded":"2023-05-21T16:55:23.218991+0000","last_fullsized":"2023-05-21T16:55:23.218991+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:04:06.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220076+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:55:23.220076+0000","last_peered":"2023-05-21T16:55:23.220076+0000","last_clean":"2023-05-21T16:55:23.220076+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:55:23.220076+0000","last_undegraded":"2023-05-21T16:55:23.220076+0000","last_fullsized":"2023-05-21T16:55:23.220076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:57.025750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":1044480,"data_stored":772061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.093}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.214},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.0760000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.1830000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":438272,"data_stored":180641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.034},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.82099999999999995}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.72799999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8504,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363336,"statfs":{"total":96636764160,"available":96628056064,"internally_reserved":0,"allocated":442368,"data_stored":180171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.65900000000000003}]},{"osd":1,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.74299999999999999}]},{"osd":2,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0569999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.93999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8632,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363208,"statfs":{"total":96636764160,"available":96627924992,"internally_reserved":0,"allocated":442368,"data_stored":180663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.746}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.119}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.1679999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.004}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12672,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359168,"statfs":{"total":96636764160,"available":96623788032,"internally_reserved":0,"allocated":450560,"data_stored":181657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.312},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.57299999999999995}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.024},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.91900000000000004}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.878}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12532,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359308,"statfs":{"total":96636764160,"available":96623931392,"internally_reserved":0,"allocated":438272,"data_stored":180129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.1140000000000001}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.89500000000000002}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.2070000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.0249999999999999}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.389}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.458},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.254}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.353},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.502}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12596,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359244,"statfs":{"total":96636764160,"available":96623865856,"internally_reserved":0,"allocated":438272,"data_stored":180149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.505},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.129},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.081},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.88600000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.248},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.052}]},{"osd":7,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.163},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.1899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13688,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358152,"statfs":{"total":96636764160,"available":96622747648,"internally_reserved":0,"allocated":1032192,"data_stored":770461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.442}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.72299999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0349999999999999}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:55:30.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-21T16:55:30.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff862388700 1 Processor -- start 2023-05-21T16:55:30.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff862388700 1 -- start start 2023-05-21T16:55:30.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff862388700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff85c0b5ce0 0x7ff85c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff862388700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c0b8ea0 con 0x7ff85c0b8ad0 2023-05-21T16:55:30.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff862388700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c0d09d0 con 0x7ff85c0b4910 2023-05-21T16:55:30.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff862388700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c0d0cb0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff861386700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff85c0b8ad0 0x7ff85c06a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54134/0 (socket says 172.21.15.46:54134) 2023-05-21T16:55:30.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff861386700 1 -- 172.21.15.46:0/2236259405 learned_addr learned my addr 172.21.15.46:0/2236259405 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:30.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff860b85700 1 --2- 172.21.15.46:0/2236259405 >> v2:172.21.15.142:3300/0 conn(0x7ff85c0b5ce0 0x7ff85c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425455309 0 0) 0x7ff85c0b8ea0 con 0x7ff85c0b8ad0 2023-05-21T16:55:30.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8480035d0 con 0x7ff85c0b8ad0 2023-05-21T16:55:30.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354645313 0 0) 0x7ff85c0d09d0 con 0x7ff85c0b4910 2023-05-21T16:55:30.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff85c0b8ea0 con 0x7ff85c0b4910 2023-05-21T16:55:30.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff860b85700 1 -- 172.21.15.46:0/2236259405 >> v1:172.21.15.142:6789/0 conn(0x7ff85c0b4910 legacy=0x7ff85c0d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861562541 0 0) 0x7ff8480035d0 con 0x7ff85c0b8ad0 2023-05-21T16:55:30.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff860b85700 1 -- 172.21.15.46:0/2236259405 >> v1:172.21.15.46:6789/0 conn(0x7ff85c0b8ad0 legacy=0x7ff85c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff860b85700 1 -- 172.21.15.46:0/2236259405 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c0cd4f0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff860b85700 1 --2- 172.21.15.46:0/2236259405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c0cf310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009850 tx=0x7ff84c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3d56bfa91f621bf server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858001670 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c004030 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.239+0000 7ff853fff700 1 -- 172.21.15.46:0/2236259405 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0043a0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 -- 172.21.15.46:0/2236259405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b5ce0 msgr2=0x7ff85c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 --2- 172.21.15.46:0/2236259405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c0cf310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009850 tx=0x7ff84c009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 -- 172.21.15.46:0/2236259405 shutdown_connections 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 --2- 172.21.15.46:0/2236259405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c0cf310 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 -- 172.21.15.46:0/2236259405 >> 172.21.15.46:0/2236259405 conn(0x7ff85c0d3ae0 msgr2=0x7ff85c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 -- 172.21.15.46:0/2236259405 shutdown_connections 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 -- 172.21.15.46:0/2236259405 wait complete. 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.243+0000 7ff862388700 1 Processor -- start 2023-05-21T16:55:30.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 -- start start 2023-05-21T16:55:30.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b4910 0x7ff85c1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85c0b8ad0 0x7ff85c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15eac0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15f080 con 0x7ff85c0b4910 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0aab50 con 0x7ff85c0b8ad0 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c15d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45416/0 (socket says 172.21.15.46:45416) 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 -- 172.21.15.46:0/1916883561 learned_addr learned my addr 172.21.15.46:0/1916883561 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff861386700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b4910 0x7ff85c1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff861b87700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85c0b8ad0 0x7ff85c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 -- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85c0b8ad0 msgr2=0x7ff85c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85c0b8ad0 0x7ff85c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 -- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b4910 msgr2=0x7ff85c1f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b4910 0x7ff85c1f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 -- 172.21.15.46:0/1916883561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0094b0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff861386700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b4910 0x7ff85c1f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff861b87700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85c0b8ad0 0x7ff85c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-21T16:55:30.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff860b85700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c15d190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0b55f0 tx=0x7ff84c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c011630 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c01f070 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c0cda70 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0119f0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.247+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c0cd790 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.251+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c0b4db0 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.251+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff84c011b50 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.251+0000 7ff851ffb700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff8400662f0 0x7ff8400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.251+0000 7ff861386700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff8400662f0 0x7ff8400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.251+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff84c021070 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.251+0000 7ff861386700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff8400662f0 0x7ff8400687a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff8580017a0 tx=0x7ff858001570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.259+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff84c052b30 con 0x7ff85c0b5ce0 2023-05-21T16:55:30.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.423+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff85c0733b0 con 0x7ff8400662f0 2023-05-21T16:55:30.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.431+0000 7ff851ffb700 1 -- 172.21.15.46:0/1916883561 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309638 (secure 0 0 0) 0x7ff85c0733b0 con 0x7ff8400662f0 2023-05-21T16:55:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff8400662f0 msgr2=0x7ff8400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff8400662f0 0x7ff8400687a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff8580017a0 tx=0x7ff858001570 comp rx=0 tx=0).stop 2023-05-21T16:55:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 msgr2=0x7ff85c15d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c15d190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0b55f0 tx=0x7ff84c004770 comp rx=0 tx=0).stop 2023-05-21T16:55:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 shutdown_connections 2023-05-21T16:55:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff8400662f0 0x7ff8400687a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff85c0b8ad0 0x7ff85c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff85c0b5ce0 0x7ff85c15d190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 --2- 172.21.15.46:0/1916883561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff85c0b4910 0x7ff85c1f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 >> 172.21.15.46:0/1916883561 conn(0x7ff85c0d3ae0 msgr2=0x7ff85c0c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:30.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 shutdown_connections 2023-05-21T16:55:30.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.435+0000 7ff862388700 1 -- 172.21.15.46:0/1916883561 wait complete. 2023-05-21T16:55:30.442 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-21T16:55:30.455 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-05-21T16:55:28.806435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":86664,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":81984,"kb_avail":754888056,"statfs":{"total":773094113280,"available":773005369344,"internally_reserved":0,"allocated":4726784,"data_stored":2625932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83951616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.909176"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222665+0000","last_change":"2023-05-21T16:55:21.334183+0000","last_active":"2023-05-21T16:55:23.222665+0000","last_peered":"2023-05-21T16:55:23.222665+0000","last_clean":"2023-05-21T16:55:23.222665+0000","last_became_active":"2023-05-21T16:55:21.333712+0000","last_became_peered":"2023-05-21T16:55:21.333712+0000","last_unstale":"2023-05-21T16:55:23.222665+0000","last_undegraded":"2023-05-21T16:55:23.222665+0000","last_fullsized":"2023-05-21T16:55:23.222665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:29:39.951398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221414+0000","last_change":"2023-05-21T16:55:21.329156+0000","last_active":"2023-05-21T16:55:23.221414+0000","last_peered":"2023-05-21T16:55:23.221414+0000","last_clean":"2023-05-21T16:55:23.221414+0000","last_became_active":"2023-05-21T16:55:21.328883+0000","last_became_peered":"2023-05-21T16:55:21.328883+0000","last_unstale":"2023-05-21T16:55:23.221414+0000","last_undegraded":"2023-05-21T16:55:23.221414+0000","last_fullsized":"2023-05-21T16:55:23.221414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:04:04.183764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221859+0000","last_change":"2023-05-21T16:55:21.315825+0000","last_active":"2023-05-21T16:55:23.221859+0000","last_peered":"2023-05-21T16:55:23.221859+0000","last_clean":"2023-05-21T16:55:23.221859+0000","last_became_active":"2023-05-21T16:55:21.315507+0000","last_became_peered":"2023-05-21T16:55:21.315507+0000","last_unstale":"2023-05-21T16:55:23.221859+0000","last_undegraded":"2023-05-21T16:55:23.221859+0000","last_fullsized":"2023-05-21T16:55:23.221859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:56:37.953447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312812+0000","last_change":"2023-05-21T16:55:21.336343+0000","last_active":"2023-05-21T16:55:22.312812+0000","last_peered":"2023-05-21T16:55:22.312812+0000","last_clean":"2023-05-21T16:55:22.312812+0000","last_became_active":"2023-05-21T16:55:21.335866+0000","last_became_peered":"2023-05-21T16:55:21.335866+0000","last_unstale":"2023-05-21T16:55:22.312812+0000","last_undegraded":"2023-05-21T16:55:22.312812+0000","last_fullsized":"2023-05-21T16:55:22.312812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:42:21.410706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312329+0000","last_change":"2023-05-21T16:55:21.335673+0000","last_active":"2023-05-21T16:55:22.312329+0000","last_peered":"2023-05-21T16:55:22.312329+0000","last_clean":"2023-05-21T16:55:22.312329+0000","last_became_active":"2023-05-21T16:55:21.335387+0000","last_became_peered":"2023-05-21T16:55:21.335387+0000","last_unstale":"2023-05-21T16:55:22.312329+0000","last_undegraded":"2023-05-21T16:55:22.312329+0000","last_fullsized":"2023-05-21T16:55:22.312329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:33:55.761232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221456+0000","last_change":"2023-05-21T16:55:21.330529+0000","last_active":"2023-05-21T16:55:23.221456+0000","last_peered":"2023-05-21T16:55:23.221456+0000","last_clean":"2023-05-21T16:55:23.221456+0000","last_became_active":"2023-05-21T16:55:21.330214+0000","last_became_peered":"2023-05-21T16:55:21.330214+0000","last_unstale":"2023-05-21T16:55:23.221456+0000","last_undegraded":"2023-05-21T16:55:23.221456+0000","last_fullsized":"2023-05-21T16:55:23.221456+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:04:04.183764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312085+0000","last_change":"2023-05-21T16:55:21.334015+0000","last_active":"2023-05-21T16:55:22.312085+0000","last_peered":"2023-05-21T16:55:22.312085+0000","last_clean":"2023-05-21T16:55:22.312085+0000","last_became_active":"2023-05-21T16:55:21.333724+0000","last_became_peered":"2023-05-21T16:55:21.333724+0000","last_unstale":"2023-05-21T16:55:22.312085+0000","last_undegraded":"2023-05-21T16:55:22.312085+0000","last_fullsized":"2023-05-21T16:55:22.312085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:44:48.717106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218974+0000","last_change":"2023-05-21T16:55:21.334381+0000","last_active":"2023-05-21T16:55:23.218974+0000","last_peered":"2023-05-21T16:55:23.218974+0000","last_clean":"2023-05-21T16:55:23.218974+0000","last_became_active":"2023-05-21T16:55:21.334034+0000","last_became_peered":"2023-05-21T16:55:21.334034+0000","last_unstale":"2023-05-21T16:55:23.218974+0000","last_undegraded":"2023-05-21T16:55:23.218974+0000","last_fullsized":"2023-05-21T16:55:23.218974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:35:02.383388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221250+0000","last_change":"2023-05-21T16:55:21.315863+0000","last_active":"2023-05-21T16:55:23.221250+0000","last_peered":"2023-05-21T16:55:23.221250+0000","last_clean":"2023-05-21T16:55:23.221250+0000","last_became_active":"2023-05-21T16:55:21.315568+0000","last_became_peered":"2023-05-21T16:55:21.315568+0000","last_unstale":"2023-05-21T16:55:23.221250+0000","last_undegraded":"2023-05-21T16:55:23.221250+0000","last_fullsized":"2023-05-21T16:55:23.221250+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:14:14.090465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314441+0000","last_change":"2023-05-21T16:55:21.311444+0000","last_active":"2023-05-21T16:55:22.314441+0000","last_peered":"2023-05-21T16:55:22.314441+0000","last_clean":"2023-05-21T16:55:22.314441+0000","last_became_active":"2023-05-21T16:55:21.311075+0000","last_became_peered":"2023-05-21T16:55:21.311075+0000","last_unstale":"2023-05-21T16:55:22.314441+0000","last_undegraded":"2023-05-21T16:55:22.314441+0000","last_fullsized":"2023-05-21T16:55:22.314441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:44:38.605771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314453+0000","last_change":"2023-05-21T16:55:21.328328+0000","last_active":"2023-05-21T16:55:22.314453+0000","last_peered":"2023-05-21T16:55:22.314453+0000","last_clean":"2023-05-21T16:55:22.314453+0000","last_became_active":"2023-05-21T16:55:21.328021+0000","last_became_peered":"2023-05-21T16:55:21.328021+0000","last_unstale":"2023-05-21T16:55:22.314453+0000","last_undegraded":"2023-05-21T16:55:22.314453+0000","last_fullsized":"2023-05-21T16:55:22.314453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:48:21.017094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221501+0000","last_change":"2023-05-21T16:55:21.318086+0000","last_active":"2023-05-21T16:55:23.221501+0000","last_peered":"2023-05-21T16:55:23.221501+0000","last_clean":"2023-05-21T16:55:23.221501+0000","last_became_active":"2023-05-21T16:55:21.317776+0000","last_became_peered":"2023-05-21T16:55:21.317776+0000","last_unstale":"2023-05-21T16:55:23.221501+0000","last_undegraded":"2023-05-21T16:55:23.221501+0000","last_fullsized":"2023-05-21T16:55:23.221501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:19:22.258470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314083+0000","last_change":"2023-05-21T16:55:21.316175+0000","last_active":"2023-05-21T16:55:22.314083+0000","last_peered":"2023-05-21T16:55:22.314083+0000","last_clean":"2023-05-21T16:55:22.314083+0000","last_became_active":"2023-05-21T16:55:21.315779+0000","last_became_peered":"2023-05-21T16:55:21.315779+0000","last_unstale":"2023-05-21T16:55:22.314083+0000","last_undegraded":"2023-05-21T16:55:22.314083+0000","last_fullsized":"2023-05-21T16:55:22.314083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:51:24.521619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218848+0000","last_change":"2023-05-21T16:55:21.328629+0000","last_active":"2023-05-21T16:55:23.218848+0000","last_peered":"2023-05-21T16:55:23.218848+0000","last_clean":"2023-05-21T16:55:23.218848+0000","last_became_active":"2023-05-21T16:55:21.328005+0000","last_became_peered":"2023-05-21T16:55:21.328005+0000","last_unstale":"2023-05-21T16:55:23.218848+0000","last_undegraded":"2023-05-21T16:55:23.218848+0000","last_fullsized":"2023-05-21T16:55:23.218848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:44:38.605771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313178+0000","last_change":"2023-05-21T16:55:21.321754+0000","last_active":"2023-05-21T16:55:22.313178+0000","last_peered":"2023-05-21T16:55:22.313178+0000","last_clean":"2023-05-21T16:55:22.313178+0000","last_became_active":"2023-05-21T16:55:21.321446+0000","last_became_peered":"2023-05-21T16:55:21.321446+0000","last_unstale":"2023-05-21T16:55:22.313178+0000","last_undegraded":"2023-05-21T16:55:22.313178+0000","last_fullsized":"2023-05-21T16:55:22.313178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:47.781944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312540+0000","last_change":"2023-05-21T16:55:21.317599+0000","last_active":"2023-05-21T16:55:22.312540+0000","last_peered":"2023-05-21T16:55:22.312540+0000","last_clean":"2023-05-21T16:55:22.312540+0000","last_became_active":"2023-05-21T16:55:21.316927+0000","last_became_peered":"2023-05-21T16:55:21.316927+0000","last_unstale":"2023-05-21T16:55:22.312540+0000","last_undegraded":"2023-05-21T16:55:22.312540+0000","last_fullsized":"2023-05-21T16:55:22.312540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:43:54.118874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313358+0000","last_change":"2023-05-21T16:55:21.316491+0000","last_active":"2023-05-21T16:55:22.313358+0000","last_peered":"2023-05-21T16:55:22.313358+0000","last_clean":"2023-05-21T16:55:22.313358+0000","last_became_active":"2023-05-21T16:55:21.315571+0000","last_became_peered":"2023-05-21T16:55:21.315571+0000","last_unstale":"2023-05-21T16:55:22.313358+0000","last_undegraded":"2023-05-21T16:55:22.313358+0000","last_fullsized":"2023-05-21T16:55:22.313358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:26:51.123295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219509+0000","last_change":"2023-05-21T16:55:21.330456+0000","last_active":"2023-05-21T16:55:23.219509+0000","last_peered":"2023-05-21T16:55:23.219509+0000","last_clean":"2023-05-21T16:55:23.219509+0000","last_became_active":"2023-05-21T16:55:21.330123+0000","last_became_peered":"2023-05-21T16:55:21.330123+0000","last_unstale":"2023-05-21T16:55:23.219509+0000","last_undegraded":"2023-05-21T16:55:23.219509+0000","last_fullsized":"2023-05-21T16:55:23.219509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:23:49.119448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313102+0000","last_change":"2023-05-21T16:55:21.326633+0000","last_active":"2023-05-21T16:55:22.313102+0000","last_peered":"2023-05-21T16:55:22.313102+0000","last_clean":"2023-05-21T16:55:22.313102+0000","last_became_active":"2023-05-21T16:55:21.326339+0000","last_became_peered":"2023-05-21T16:55:21.326339+0000","last_unstale":"2023-05-21T16:55:22.313102+0000","last_undegraded":"2023-05-21T16:55:22.313102+0000","last_fullsized":"2023-05-21T16:55:22.313102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:57:18.119787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219431+0000","last_change":"2023-05-21T16:55:21.329150+0000","last_active":"2023-05-21T16:55:23.219431+0000","last_peered":"2023-05-21T16:55:23.219431+0000","last_clean":"2023-05-21T16:55:23.219431+0000","last_became_active":"2023-05-21T16:55:21.328835+0000","last_became_peered":"2023-05-21T16:55:21.328835+0000","last_unstale":"2023-05-21T16:55:23.219431+0000","last_undegraded":"2023-05-21T16:55:23.219431+0000","last_fullsized":"2023-05-21T16:55:23.219431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:47:55.628682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313724+0000","last_change":"2023-05-21T16:55:21.316045+0000","last_active":"2023-05-21T16:55:22.313724+0000","last_peered":"2023-05-21T16:55:22.313724+0000","last_clean":"2023-05-21T16:55:22.313724+0000","last_became_active":"2023-05-21T16:55:21.315478+0000","last_became_peered":"2023-05-21T16:55:21.315478+0000","last_unstale":"2023-05-21T16:55:22.313724+0000","last_undegraded":"2023-05-21T16:55:22.313724+0000","last_fullsized":"2023-05-21T16:55:22.313724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:27:23.153491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219621+0000","last_change":"2023-05-21T16:55:21.328274+0000","last_active":"2023-05-21T16:55:23.219621+0000","last_peered":"2023-05-21T16:55:23.219621+0000","last_clean":"2023-05-21T16:55:23.219621+0000","last_became_active":"2023-05-21T16:55:21.327324+0000","last_became_peered":"2023-05-21T16:55:21.327324+0000","last_unstale":"2023-05-21T16:55:23.219621+0000","last_undegraded":"2023-05-21T16:55:23.219621+0000","last_fullsized":"2023-05-21T16:55:23.219621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:27:21.411341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312578+0000","last_change":"2023-05-21T16:55:21.320175+0000","last_active":"2023-05-21T16:55:22.312578+0000","last_peered":"2023-05-21T16:55:22.312578+0000","last_clean":"2023-05-21T16:55:22.312578+0000","last_became_active":"2023-05-21T16:55:21.319899+0000","last_became_peered":"2023-05-21T16:55:21.319899+0000","last_unstale":"2023-05-21T16:55:22.312578+0000","last_undegraded":"2023-05-21T16:55:22.312578+0000","last_fullsized":"2023-05-21T16:55:22.312578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:48:21.017094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.311968+0000","last_change":"2023-05-21T16:55:21.325208+0000","last_active":"2023-05-21T16:55:22.311968+0000","last_peered":"2023-05-21T16:55:22.311968+0000","last_clean":"2023-05-21T16:55:22.311968+0000","last_became_active":"2023-05-21T16:55:21.324910+0000","last_became_peered":"2023-05-21T16:55:21.324910+0000","last_unstale":"2023-05-21T16:55:22.311968+0000","last_undegraded":"2023-05-21T16:55:22.311968+0000","last_fullsized":"2023-05-21T16:55:22.311968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:18:40.956260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219895+0000","last_change":"2023-05-21T16:55:21.320780+0000","last_active":"2023-05-21T16:55:23.219895+0000","last_peered":"2023-05-21T16:55:23.219895+0000","last_clean":"2023-05-21T16:55:23.219895+0000","last_became_active":"2023-05-21T16:55:21.319881+0000","last_became_peered":"2023-05-21T16:55:21.319881+0000","last_unstale":"2023-05-21T16:55:23.219895+0000","last_undegraded":"2023-05-21T16:55:23.219895+0000","last_fullsized":"2023-05-21T16:55:23.219895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:39:19.494701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223861+0000","last_change":"2023-05-21T16:55:21.320636+0000","last_active":"2023-05-21T16:55:23.223861+0000","last_peered":"2023-05-21T16:55:23.223861+0000","last_clean":"2023-05-21T16:55:23.223861+0000","last_became_active":"2023-05-21T16:55:21.320304+0000","last_became_peered":"2023-05-21T16:55:21.320304+0000","last_unstale":"2023-05-21T16:55:23.223861+0000","last_undegraded":"2023-05-21T16:55:23.223861+0000","last_fullsized":"2023-05-21T16:55:23.223861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:50:11.350907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220086+0000","last_change":"2023-05-21T16:55:21.319844+0000","last_active":"2023-05-21T16:55:23.220086+0000","last_peered":"2023-05-21T16:55:23.220086+0000","last_clean":"2023-05-21T16:55:23.220086+0000","last_became_active":"2023-05-21T16:55:21.319548+0000","last_became_peered":"2023-05-21T16:55:21.319548+0000","last_unstale":"2023-05-21T16:55:23.220086+0000","last_undegraded":"2023-05-21T16:55:23.220086+0000","last_fullsized":"2023-05-21T16:55:23.220086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:46:18.585575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314432+0000","last_change":"2023-05-21T16:55:21.333803+0000","last_active":"2023-05-21T16:55:22.314432+0000","last_peered":"2023-05-21T16:55:22.314432+0000","last_clean":"2023-05-21T16:55:22.314432+0000","last_became_active":"2023-05-21T16:55:21.333489+0000","last_became_peered":"2023-05-21T16:55:21.333489+0000","last_unstale":"2023-05-21T16:55:22.314432+0000","last_undegraded":"2023-05-21T16:55:22.314432+0000","last_fullsized":"2023-05-21T16:55:22.314432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:43:54.118874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219205+0000","last_change":"2023-05-21T16:55:21.329037+0000","last_active":"2023-05-21T16:55:23.219205+0000","last_peered":"2023-05-21T16:55:23.219205+0000","last_clean":"2023-05-21T16:55:23.219205+0000","last_became_active":"2023-05-21T16:55:21.328615+0000","last_became_peered":"2023-05-21T16:55:21.328615+0000","last_unstale":"2023-05-21T16:55:23.219205+0000","last_undegraded":"2023-05-21T16:55:23.219205+0000","last_fullsized":"2023-05-21T16:55:23.219205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:36:47.822084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219428+0000","last_change":"2023-05-21T16:55:21.334304+0000","last_active":"2023-05-21T16:55:23.219428+0000","last_peered":"2023-05-21T16:55:23.219428+0000","last_clean":"2023-05-21T16:55:23.219428+0000","last_became_active":"2023-05-21T16:55:21.334028+0000","last_became_peered":"2023-05-21T16:55:21.334028+0000","last_unstale":"2023-05-21T16:55:23.219428+0000","last_undegraded":"2023-05-21T16:55:23.219428+0000","last_fullsized":"2023-05-21T16:55:23.219428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:37:44.753303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312783+0000","last_change":"2023-05-21T16:55:21.325855+0000","last_active":"2023-05-21T16:55:22.312783+0000","last_peered":"2023-05-21T16:55:22.312783+0000","last_clean":"2023-05-21T16:55:22.312783+0000","last_became_active":"2023-05-21T16:55:21.324626+0000","last_became_peered":"2023-05-21T16:55:21.324626+0000","last_unstale":"2023-05-21T16:55:22.312783+0000","last_undegraded":"2023-05-21T16:55:22.312783+0000","last_fullsized":"2023-05-21T16:55:22.312783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:24.788452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219863+0000","last_change":"2023-05-21T16:55:21.316032+0000","last_active":"2023-05-21T16:55:23.219863+0000","last_peered":"2023-05-21T16:55:23.219863+0000","last_clean":"2023-05-21T16:55:23.219863+0000","last_became_active":"2023-05-21T16:55:21.315382+0000","last_became_peered":"2023-05-21T16:55:21.315382+0000","last_unstale":"2023-05-21T16:55:23.219863+0000","last_undegraded":"2023-05-21T16:55:23.219863+0000","last_fullsized":"2023-05-21T16:55:23.219863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:50:46.719833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313000+0000","last_change":"2023-05-21T16:55:21.317259+0000","last_active":"2023-05-21T16:55:22.313000+0000","last_peered":"2023-05-21T16:55:22.313000+0000","last_clean":"2023-05-21T16:55:22.313000+0000","last_became_active":"2023-05-21T16:55:21.316818+0000","last_became_peered":"2023-05-21T16:55:21.316818+0000","last_unstale":"2023-05-21T16:55:22.313000+0000","last_undegraded":"2023-05-21T16:55:22.313000+0000","last_fullsized":"2023-05-21T16:55:22.313000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:12:17.004151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219791+0000","last_change":"2023-05-21T16:55:20.918591+0000","last_active":"2023-05-21T16:55:23.219791+0000","last_peered":"2023-05-21T16:55:23.219791+0000","last_clean":"2023-05-21T16:55:23.219791+0000","last_became_active":"2023-05-21T16:55:20.918286+0000","last_became_peered":"2023-05-21T16:55:20.918286+0000","last_unstale":"2023-05-21T16:55:23.219791+0000","last_undegraded":"2023-05-21T16:55:23.219791+0000","last_fullsized":"2023-05-21T16:55:23.219791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:09:18.857229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223145+0000","last_change":"2023-05-21T16:55:21.320645+0000","last_active":"2023-05-21T16:55:23.223145+0000","last_peered":"2023-05-21T16:55:23.223145+0000","last_clean":"2023-05-21T16:55:23.223145+0000","last_became_active":"2023-05-21T16:55:21.320384+0000","last_became_peered":"2023-05-21T16:55:21.320384+0000","last_unstale":"2023-05-21T16:55:23.223145+0000","last_undegraded":"2023-05-21T16:55:23.223145+0000","last_fullsized":"2023-05-21T16:55:23.223145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:01:31.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221954+0000","last_change":"2023-05-21T16:55:20.920752+0000","last_active":"2023-05-21T16:55:23.221954+0000","last_peered":"2023-05-21T16:55:23.221954+0000","last_clean":"2023-05-21T16:55:23.221954+0000","last_became_active":"2023-05-21T16:55:20.920288+0000","last_became_peered":"2023-05-21T16:55:20.920288+0000","last_unstale":"2023-05-21T16:55:23.221954+0000","last_undegraded":"2023-05-21T16:55:23.221954+0000","last_fullsized":"2023-05-21T16:55:23.221954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:10:35.920314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220841+0000","last_change":"2023-05-21T16:55:21.328406+0000","last_active":"2023-05-21T16:55:23.220841+0000","last_peered":"2023-05-21T16:55:23.220841+0000","last_clean":"2023-05-21T16:55:23.220841+0000","last_became_active":"2023-05-21T16:55:21.327457+0000","last_became_peered":"2023-05-21T16:55:21.327457+0000","last_unstale":"2023-05-21T16:55:23.220841+0000","last_undegraded":"2023-05-21T16:55:23.220841+0000","last_fullsized":"2023-05-21T16:55:23.220841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:22:24.032159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223480+0000","last_change":"2023-05-21T16:55:20.925123+0000","last_active":"2023-05-21T16:55:23.223480+0000","last_peered":"2023-05-21T16:55:23.223480+0000","last_clean":"2023-05-21T16:55:23.223480+0000","last_became_active":"2023-05-21T16:55:20.924844+0000","last_became_peered":"2023-05-21T16:55:20.924844+0000","last_unstale":"2023-05-21T16:55:23.223480+0000","last_undegraded":"2023-05-21T16:55:23.223480+0000","last_fullsized":"2023-05-21T16:55:23.223480+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:56:19.034470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222471+0000","last_change":"2023-05-21T16:55:21.333979+0000","last_active":"2023-05-21T16:55:23.222471+0000","last_peered":"2023-05-21T16:55:23.222471+0000","last_clean":"2023-05-21T16:55:23.222471+0000","last_became_active":"2023-05-21T16:55:21.333403+0000","last_became_peered":"2023-05-21T16:55:21.333403+0000","last_unstale":"2023-05-21T16:55:23.222471+0000","last_undegraded":"2023-05-21T16:55:23.222471+0000","last_fullsized":"2023-05-21T16:55:23.222471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:56:20.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220721+0000","last_change":"2023-05-21T16:55:20.925136+0000","last_active":"2023-05-21T16:55:23.220721+0000","last_peered":"2023-05-21T16:55:23.220721+0000","last_clean":"2023-05-21T16:55:23.220721+0000","last_became_active":"2023-05-21T16:55:20.924787+0000","last_became_peered":"2023-05-21T16:55:20.924787+0000","last_unstale":"2023-05-21T16:55:23.220721+0000","last_undegraded":"2023-05-21T16:55:23.220721+0000","last_fullsized":"2023-05-21T16:55:23.220721+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:29.013165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218979+0000","last_change":"2023-05-21T16:55:21.322061+0000","last_active":"2023-05-21T16:55:23.218979+0000","last_peered":"2023-05-21T16:55:23.218979+0000","last_clean":"2023-05-21T16:55:23.218979+0000","last_became_active":"2023-05-21T16:55:21.321811+0000","last_became_peered":"2023-05-21T16:55:21.321811+0000","last_unstale":"2023-05-21T16:55:23.218979+0000","last_undegraded":"2023-05-21T16:55:23.218979+0000","last_fullsized":"2023-05-21T16:55:23.218979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:16:57.522388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313861+0000","last_change":"2023-05-21T16:55:20.917560+0000","last_active":"2023-05-21T16:55:22.313861+0000","last_peered":"2023-05-21T16:55:22.313861+0000","last_clean":"2023-05-21T16:55:22.313861+0000","last_became_active":"2023-05-21T16:55:20.917267+0000","last_became_peered":"2023-05-21T16:55:20.917267+0000","last_unstale":"2023-05-21T16:55:22.313861+0000","last_undegraded":"2023-05-21T16:55:22.313861+0000","last_fullsized":"2023-05-21T16:55:22.313861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:31:46.916305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313598+0000","last_change":"2023-05-21T16:55:21.321758+0000","last_active":"2023-05-21T16:55:22.313598+0000","last_peered":"2023-05-21T16:55:22.313598+0000","last_clean":"2023-05-21T16:55:22.313598+0000","last_became_active":"2023-05-21T16:55:21.321048+0000","last_became_peered":"2023-05-21T16:55:21.321048+0000","last_unstale":"2023-05-21T16:55:22.313598+0000","last_undegraded":"2023-05-21T16:55:22.313598+0000","last_fullsized":"2023-05-21T16:55:22.313598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:12:54.720047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313232+0000","last_change":"2023-05-21T16:55:20.923169+0000","last_active":"2023-05-21T16:55:22.313232+0000","last_peered":"2023-05-21T16:55:22.313232+0000","last_clean":"2023-05-21T16:55:22.313232+0000","last_became_active":"2023-05-21T16:55:20.922899+0000","last_became_peered":"2023-05-21T16:55:20.922899+0000","last_unstale":"2023-05-21T16:55:22.313232+0000","last_undegraded":"2023-05-21T16:55:22.313232+0000","last_fullsized":"2023-05-21T16:55:22.313232+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:26:01.503903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219993+0000","last_change":"2023-05-21T16:55:21.328452+0000","last_active":"2023-05-21T16:55:23.219993+0000","last_peered":"2023-05-21T16:55:23.219993+0000","last_clean":"2023-05-21T16:55:23.219993+0000","last_became_active":"2023-05-21T16:55:21.327712+0000","last_became_peered":"2023-05-21T16:55:21.327712+0000","last_unstale":"2023-05-21T16:55:23.219993+0000","last_undegraded":"2023-05-21T16:55:23.219993+0000","last_fullsized":"2023-05-21T16:55:23.219993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:24.788452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220934+0000","last_change":"2023-05-21T16:55:20.925274+0000","last_active":"2023-05-21T16:55:23.220934+0000","last_peered":"2023-05-21T16:55:23.220934+0000","last_clean":"2023-05-21T16:55:23.220934+0000","last_became_active":"2023-05-21T16:55:20.925008+0000","last_became_peered":"2023-05-21T16:55:20.925008+0000","last_unstale":"2023-05-21T16:55:23.220934+0000","last_undegraded":"2023-05-21T16:55:23.220934+0000","last_fullsized":"2023-05-21T16:55:23.220934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:14:28.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220103+0000","last_change":"2023-05-21T16:55:21.331912+0000","last_active":"2023-05-21T16:55:23.220103+0000","last_peered":"2023-05-21T16:55:23.220103+0000","last_clean":"2023-05-21T16:55:23.220103+0000","last_became_active":"2023-05-21T16:55:21.330558+0000","last_became_peered":"2023-05-21T16:55:21.330558+0000","last_unstale":"2023-05-21T16:55:23.220103+0000","last_undegraded":"2023-05-21T16:55:23.220103+0000","last_fullsized":"2023-05-21T16:55:23.220103+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:52:26.118920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218690+0000","last_change":"2023-05-21T16:55:20.919419+0000","last_active":"2023-05-21T16:55:23.218690+0000","last_peered":"2023-05-21T16:55:23.218690+0000","last_clean":"2023-05-21T16:55:23.218690+0000","last_became_active":"2023-05-21T16:55:20.919047+0000","last_became_peered":"2023-05-21T16:55:20.919047+0000","last_unstale":"2023-05-21T16:55:23.218690+0000","last_undegraded":"2023-05-21T16:55:23.218690+0000","last_fullsized":"2023-05-21T16:55:23.218690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:43:53.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312924+0000","last_change":"2023-05-21T16:55:21.335873+0000","last_active":"2023-05-21T16:55:22.312924+0000","last_peered":"2023-05-21T16:55:22.312924+0000","last_clean":"2023-05-21T16:55:22.312924+0000","last_became_active":"2023-05-21T16:55:21.335546+0000","last_became_peered":"2023-05-21T16:55:21.335546+0000","last_unstale":"2023-05-21T16:55:22.312924+0000","last_undegraded":"2023-05-21T16:55:22.312924+0000","last_fullsized":"2023-05-21T16:55:22.312924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:50:07.183063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222539+0000","last_change":"2023-05-21T16:55:20.920908+0000","last_active":"2023-05-21T16:55:23.222539+0000","last_peered":"2023-05-21T16:55:23.222539+0000","last_clean":"2023-05-21T16:55:23.222539+0000","last_became_active":"2023-05-21T16:55:20.920571+0000","last_became_peered":"2023-05-21T16:55:20.920571+0000","last_unstale":"2023-05-21T16:55:23.222539+0000","last_undegraded":"2023-05-21T16:55:23.222539+0000","last_fullsized":"2023-05-21T16:55:23.222539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:50:10.347041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313130+0000","last_change":"2023-05-21T16:55:21.324675+0000","last_active":"2023-05-21T16:55:22.313130+0000","last_peered":"2023-05-21T16:55:22.313130+0000","last_clean":"2023-05-21T16:55:22.313130+0000","last_became_active":"2023-05-21T16:55:21.324369+0000","last_became_peered":"2023-05-21T16:55:21.324369+0000","last_unstale":"2023-05-21T16:55:22.313130+0000","last_undegraded":"2023-05-21T16:55:22.313130+0000","last_fullsized":"2023-05-21T16:55:22.313130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:42.833642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314762+0000","last_change":"2023-05-21T16:55:20.921697+0000","last_active":"2023-05-21T16:55:22.314762+0000","last_peered":"2023-05-21T16:55:22.314762+0000","last_clean":"2023-05-21T16:55:22.314762+0000","last_became_active":"2023-05-21T16:55:20.921269+0000","last_became_peered":"2023-05-21T16:55:20.921269+0000","last_unstale":"2023-05-21T16:55:22.314762+0000","last_undegraded":"2023-05-21T16:55:22.314762+0000","last_fullsized":"2023-05-21T16:55:22.314762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:03:29.599729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221872+0000","last_change":"2023-05-21T16:55:21.311422+0000","last_active":"2023-05-21T16:55:23.221872+0000","last_peered":"2023-05-21T16:55:23.221872+0000","last_clean":"2023-05-21T16:55:23.221872+0000","last_became_active":"2023-05-21T16:55:21.310468+0000","last_became_peered":"2023-05-21T16:55:21.310468+0000","last_unstale":"2023-05-21T16:55:23.221872+0000","last_undegraded":"2023-05-21T16:55:23.221872+0000","last_fullsized":"2023-05-21T16:55:23.221872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T16:59:28.480630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314916+0000","last_change":"2023-05-21T16:55:20.925248+0000","last_active":"2023-05-21T16:55:22.314916+0000","last_peered":"2023-05-21T16:55:22.314916+0000","last_clean":"2023-05-21T16:55:22.314916+0000","last_became_active":"2023-05-21T16:55:20.924646+0000","last_became_peered":"2023-05-21T16:55:20.924646+0000","last_unstale":"2023-05-21T16:55:22.314916+0000","last_undegraded":"2023-05-21T16:55:22.314916+0000","last_fullsized":"2023-05-21T16:55:22.314916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:23.784587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220520+0000","last_change":"2023-05-21T16:55:21.327653+0000","last_active":"2023-05-21T16:55:23.220520+0000","last_peered":"2023-05-21T16:55:23.220520+0000","last_clean":"2023-05-21T16:55:23.220520+0000","last_became_active":"2023-05-21T16:55:21.327338+0000","last_became_peered":"2023-05-21T16:55:21.327338+0000","last_unstale":"2023-05-21T16:55:23.220520+0000","last_undegraded":"2023-05-21T16:55:23.220520+0000","last_fullsized":"2023-05-21T16:55:23.220520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:02.904408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221021+0000","last_change":"2023-05-21T16:55:20.923503+0000","last_active":"2023-05-21T16:55:23.221021+0000","last_peered":"2023-05-21T16:55:23.221021+0000","last_clean":"2023-05-21T16:55:23.221021+0000","last_became_active":"2023-05-21T16:55:20.922810+0000","last_became_peered":"2023-05-21T16:55:20.922810+0000","last_unstale":"2023-05-21T16:55:23.221021+0000","last_undegraded":"2023-05-21T16:55:23.221021+0000","last_fullsized":"2023-05-21T16:55:23.221021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:14:28.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221868+0000","last_change":"2023-05-21T16:55:21.317725+0000","last_active":"2023-05-21T16:55:23.221868+0000","last_peered":"2023-05-21T16:55:23.221868+0000","last_clean":"2023-05-21T16:55:23.221868+0000","last_became_active":"2023-05-21T16:55:21.317416+0000","last_became_peered":"2023-05-21T16:55:21.317416+0000","last_unstale":"2023-05-21T16:55:23.221868+0000","last_undegraded":"2023-05-21T16:55:23.221868+0000","last_fullsized":"2023-05-21T16:55:23.221868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:47:50.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221017+0000","last_change":"2023-05-21T16:55:20.922458+0000","last_active":"2023-05-21T16:55:23.221017+0000","last_peered":"2023-05-21T16:55:23.221017+0000","last_clean":"2023-05-21T16:55:23.221017+0000","last_became_active":"2023-05-21T16:55:20.922157+0000","last_became_peered":"2023-05-21T16:55:20.922157+0000","last_unstale":"2023-05-21T16:55:23.221017+0000","last_undegraded":"2023-05-21T16:55:23.221017+0000","last_fullsized":"2023-05-21T16:55:23.221017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:27:06.703381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222183+0000","last_change":"2023-05-21T16:55:21.330313+0000","last_active":"2023-05-21T16:55:23.222183+0000","last_peered":"2023-05-21T16:55:23.222183+0000","last_clean":"2023-05-21T16:55:23.222183+0000","last_became_active":"2023-05-21T16:55:21.330064+0000","last_became_peered":"2023-05-21T16:55:21.330064+0000","last_unstale":"2023-05-21T16:55:23.222183+0000","last_undegraded":"2023-05-21T16:55:23.222183+0000","last_fullsized":"2023-05-21T16:55:23.222183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:01:31.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221706+0000","last_change":"2023-05-21T16:55:20.922360+0000","last_active":"2023-05-21T16:55:23.221706+0000","last_peered":"2023-05-21T16:55:23.221706+0000","last_clean":"2023-05-21T16:55:23.221706+0000","last_became_active":"2023-05-21T16:55:20.922084+0000","last_became_peered":"2023-05-21T16:55:20.922084+0000","last_unstale":"2023-05-21T16:55:23.221706+0000","last_undegraded":"2023-05-21T16:55:23.221706+0000","last_fullsized":"2023-05-21T16:55:23.221706+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:44:39.641353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312557+0000","last_change":"2023-05-21T16:55:21.317388+0000","last_active":"2023-05-21T16:55:22.312557+0000","last_peered":"2023-05-21T16:55:22.312557+0000","last_clean":"2023-05-21T16:55:22.312557+0000","last_became_active":"2023-05-21T16:55:21.317097+0000","last_became_peered":"2023-05-21T16:55:21.317097+0000","last_unstale":"2023-05-21T16:55:22.312557+0000","last_undegraded":"2023-05-21T16:55:22.312557+0000","last_fullsized":"2023-05-21T16:55:22.312557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:44:38.605771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218636+0000","last_change":"2023-05-21T16:55:20.913455+0000","last_active":"2023-05-21T16:55:23.218636+0000","last_peered":"2023-05-21T16:55:23.218636+0000","last_clean":"2023-05-21T16:55:23.218636+0000","last_became_active":"2023-05-21T16:55:20.913077+0000","last_became_peered":"2023-05-21T16:55:20.913077+0000","last_unstale":"2023-05-21T16:55:23.218636+0000","last_undegraded":"2023-05-21T16:55:23.218636+0000","last_fullsized":"2023-05-21T16:55:23.218636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:57:17.115921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220440+0000","last_change":"2023-05-21T16:55:21.332100+0000","last_active":"2023-05-21T16:55:23.220440+0000","last_peered":"2023-05-21T16:55:23.220440+0000","last_clean":"2023-05-21T16:55:23.220440+0000","last_became_active":"2023-05-21T16:55:21.330950+0000","last_became_peered":"2023-05-21T16:55:21.330950+0000","last_unstale":"2023-05-21T16:55:23.220440+0000","last_undegraded":"2023-05-21T16:55:23.220440+0000","last_fullsized":"2023-05-21T16:55:23.220440+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:42.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312289+0000","last_change":"2023-05-21T16:55:20.915169+0000","last_active":"2023-05-21T16:55:22.312289+0000","last_peered":"2023-05-21T16:55:22.312289+0000","last_clean":"2023-05-21T16:55:22.312289+0000","last_became_active":"2023-05-21T16:55:20.914877+0000","last_became_peered":"2023-05-21T16:55:20.914877+0000","last_unstale":"2023-05-21T16:55:22.312289+0000","last_undegraded":"2023-05-21T16:55:22.312289+0000","last_fullsized":"2023-05-21T16:55:22.312289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:33:03.979410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220588+0000","last_change":"2023-05-21T16:55:21.333714+0000","last_active":"2023-05-21T16:55:23.220588+0000","last_peered":"2023-05-21T16:55:23.220588+0000","last_clean":"2023-05-21T16:55:23.220588+0000","last_became_active":"2023-05-21T16:55:21.333364+0000","last_became_peered":"2023-05-21T16:55:21.333364+0000","last_unstale":"2023-05-21T16:55:23.220588+0000","last_undegraded":"2023-05-21T16:55:23.220588+0000","last_fullsized":"2023-05-21T16:55:23.220588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:50:46.719833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.315195+0000","last_change":"2023-05-21T16:55:20.916286+0000","last_active":"2023-05-21T16:55:22.315195+0000","last_peered":"2023-05-21T16:55:22.315195+0000","last_clean":"2023-05-21T16:55:22.315195+0000","last_became_active":"2023-05-21T16:55:20.915916+0000","last_became_peered":"2023-05-21T16:55:20.915916+0000","last_unstale":"2023-05-21T16:55:22.315195+0000","last_undegraded":"2023-05-21T16:55:22.315195+0000","last_fullsized":"2023-05-21T16:55:22.315195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:12:16.000285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.315087+0000","last_change":"2023-05-21T16:55:21.312276+0000","last_active":"2023-05-21T16:55:22.315087+0000","last_peered":"2023-05-21T16:55:22.315087+0000","last_clean":"2023-05-21T16:55:22.315087+0000","last_became_active":"2023-05-21T16:55:21.312006+0000","last_became_peered":"2023-05-21T16:55:21.312006+0000","last_unstale":"2023-05-21T16:55:22.315087+0000","last_undegraded":"2023-05-21T16:55:22.315087+0000","last_fullsized":"2023-05-21T16:55:22.315087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:02.904408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220979+0000","last_change":"2023-05-21T16:55:20.918105+0000","last_active":"2023-05-21T16:55:23.220979+0000","last_peered":"2023-05-21T16:55:23.220979+0000","last_clean":"2023-05-21T16:55:23.220979+0000","last_became_active":"2023-05-21T16:55:20.917836+0000","last_became_peered":"2023-05-21T16:55:20.917836+0000","last_unstale":"2023-05-21T16:55:23.220979+0000","last_undegraded":"2023-05-21T16:55:23.220979+0000","last_fullsized":"2023-05-21T16:55:23.220979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:41.829776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220750+0000","last_change":"2023-05-21T16:55:21.327773+0000","last_active":"2023-05-21T16:55:23.220750+0000","last_peered":"2023-05-21T16:55:23.220750+0000","last_clean":"2023-05-21T16:55:23.220750+0000","last_became_active":"2023-05-21T16:55:21.327113+0000","last_became_peered":"2023-05-21T16:55:21.327113+0000","last_unstale":"2023-05-21T16:55:23.220750+0000","last_undegraded":"2023-05-21T16:55:23.220750+0000","last_fullsized":"2023-05-21T16:55:23.220750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:12:17.004151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313150+0000","last_change":"2023-05-21T16:55:20.921322+0000","last_active":"2023-05-21T16:55:22.313150+0000","last_peered":"2023-05-21T16:55:22.313150+0000","last_clean":"2023-05-21T16:55:22.313150+0000","last_became_active":"2023-05-21T16:55:20.920860+0000","last_became_peered":"2023-05-21T16:55:20.920860+0000","last_unstale":"2023-05-21T16:55:22.313150+0000","last_undegraded":"2023-05-21T16:55:22.313150+0000","last_fullsized":"2023-05-21T16:55:22.313150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:52:36.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313086+0000","last_change":"2023-05-21T16:55:21.335108+0000","last_active":"2023-05-21T16:55:22.313086+0000","last_peered":"2023-05-21T16:55:22.313086+0000","last_clean":"2023-05-21T16:55:22.313086+0000","last_became_active":"2023-05-21T16:55:21.334817+0000","last_became_peered":"2023-05-21T16:55:21.334817+0000","last_unstale":"2023-05-21T16:55:22.313086+0000","last_undegraded":"2023-05-21T16:55:22.313086+0000","last_fullsized":"2023-05-21T16:55:22.313086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:22:46.561040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219618+0000","last_change":"2023-05-21T16:55:20.921105+0000","last_active":"2023-05-21T16:55:23.219618+0000","last_peered":"2023-05-21T16:55:23.219618+0000","last_clean":"2023-05-21T16:55:23.219618+0000","last_became_active":"2023-05-21T16:55:20.920793+0000","last_became_peered":"2023-05-21T16:55:20.920793+0000","last_unstale":"2023-05-21T16:55:23.219618+0000","last_undegraded":"2023-05-21T16:55:23.219618+0000","last_fullsized":"2023-05-21T16:55:23.219618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:10:41.014227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312875+0000","last_change":"2023-05-21T16:55:21.317761+0000","last_active":"2023-05-21T16:55:22.312875+0000","last_peered":"2023-05-21T16:55:22.312875+0000","last_clean":"2023-05-21T16:55:22.312875+0000","last_became_active":"2023-05-21T16:55:21.317293+0000","last_became_peered":"2023-05-21T16:55:21.317293+0000","last_unstale":"2023-05-21T16:55:22.312875+0000","last_undegraded":"2023-05-21T16:55:22.312875+0000","last_fullsized":"2023-05-21T16:55:22.312875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:07:02.904408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312482+0000","last_change":"2023-05-21T16:55:20.912949+0000","last_active":"2023-05-21T16:55:22.312482+0000","last_peered":"2023-05-21T16:55:22.312482+0000","last_clean":"2023-05-21T16:55:22.312482+0000","last_became_active":"2023-05-21T16:55:20.912614+0000","last_became_peered":"2023-05-21T16:55:20.912614+0000","last_unstale":"2023-05-21T16:55:22.312482+0000","last_undegraded":"2023-05-21T16:55:22.312482+0000","last_fullsized":"2023-05-21T16:55:22.312482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:50:55.917922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219913+0000","last_change":"2023-05-21T16:55:21.311063+0000","last_active":"2023-05-21T16:55:23.219913+0000","last_peered":"2023-05-21T16:55:23.219913+0000","last_clean":"2023-05-21T16:55:23.219913+0000","last_became_active":"2023-05-21T16:55:21.310640+0000","last_became_peered":"2023-05-21T16:55:21.310640+0000","last_unstale":"2023-05-21T16:55:23.219913+0000","last_undegraded":"2023-05-21T16:55:23.219913+0000","last_fullsized":"2023-05-21T16:55:23.219913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:37:55.326727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312122+0000","last_change":"2023-05-21T16:55:20.920290+0000","last_active":"2023-05-21T16:55:22.312122+0000","last_peered":"2023-05-21T16:55:22.312122+0000","last_clean":"2023-05-21T16:55:22.312122+0000","last_became_active":"2023-05-21T16:55:20.918978+0000","last_became_peered":"2023-05-21T16:55:20.918978+0000","last_unstale":"2023-05-21T16:55:22.312122+0000","last_undegraded":"2023-05-21T16:55:22.312122+0000","last_fullsized":"2023-05-21T16:55:22.312122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:52:24.938385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313942+0000","last_change":"2023-05-21T16:55:21.322877+0000","last_active":"2023-05-21T16:55:22.313942+0000","last_peered":"2023-05-21T16:55:22.313942+0000","last_clean":"2023-05-21T16:55:22.313942+0000","last_became_active":"2023-05-21T16:55:21.322560+0000","last_became_peered":"2023-05-21T16:55:21.322560+0000","last_unstale":"2023-05-21T16:55:22.313942+0000","last_undegraded":"2023-05-21T16:55:22.313942+0000","last_fullsized":"2023-05-21T16:55:22.313942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:20:22.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312681+0000","last_change":"2023-05-21T16:55:20.922068+0000","last_active":"2023-05-21T16:55:22.312681+0000","last_peered":"2023-05-21T16:55:22.312681+0000","last_clean":"2023-05-21T16:55:22.312681+0000","last_became_active":"2023-05-21T16:55:20.921721+0000","last_became_peered":"2023-05-21T16:55:20.921721+0000","last_unstale":"2023-05-21T16:55:22.312681+0000","last_undegraded":"2023-05-21T16:55:22.312681+0000","last_fullsized":"2023-05-21T16:55:22.312681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:03:29.599729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220790+0000","last_change":"2023-05-21T16:55:21.332282+0000","last_active":"2023-05-21T16:55:23.220790+0000","last_peered":"2023-05-21T16:55:23.220790+0000","last_clean":"2023-05-21T16:55:23.220790+0000","last_became_active":"2023-05-21T16:55:21.331233+0000","last_became_peered":"2023-05-21T16:55:21.331233+0000","last_unstale":"2023-05-21T16:55:23.220790+0000","last_undegraded":"2023-05-21T16:55:23.220790+0000","last_fullsized":"2023-05-21T16:55:23.220790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:08:53.381100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312129+0000","last_change":"2023-05-21T16:55:20.912890+0000","last_active":"2023-05-21T16:55:22.312129+0000","last_peered":"2023-05-21T16:55:22.312129+0000","last_clean":"2023-05-21T16:55:22.312129+0000","last_became_active":"2023-05-21T16:55:20.912630+0000","last_became_peered":"2023-05-21T16:55:20.912630+0000","last_unstale":"2023-05-21T16:55:22.312129+0000","last_undegraded":"2023-05-21T16:55:22.312129+0000","last_fullsized":"2023-05-21T16:55:22.312129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:43:17.654191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314810+0000","last_change":"2023-05-21T16:55:21.333818+0000","last_active":"2023-05-21T16:55:22.314810+0000","last_peered":"2023-05-21T16:55:22.314810+0000","last_clean":"2023-05-21T16:55:22.314810+0000","last_became_active":"2023-05-21T16:55:21.333512+0000","last_became_peered":"2023-05-21T16:55:21.333512+0000","last_unstale":"2023-05-21T16:55:22.314810+0000","last_undegraded":"2023-05-21T16:55:22.314810+0000","last_fullsized":"2023-05-21T16:55:22.314810+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:27:21.411341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312999+0000","last_change":"2023-05-21T16:55:20.922009+0000","last_active":"2023-05-21T16:55:22.312999+0000","last_peered":"2023-05-21T16:55:22.312999+0000","last_clean":"2023-05-21T16:55:22.312999+0000","last_became_active":"2023-05-21T16:55:20.921470+0000","last_became_peered":"2023-05-21T16:55:20.921470+0000","last_unstale":"2023-05-21T16:55:22.312999+0000","last_undegraded":"2023-05-21T16:55:22.312999+0000","last_fullsized":"2023-05-21T16:55:22.312999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:22:23.028293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312911+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-21T16:55:22.312911+0000","last_peered":"2023-05-21T16:55:22.312911+0000","last_clean":"2023-05-21T16:55:22.312911+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-21T16:55:22.312911+0000","last_undegraded":"2023-05-21T16:55:22.312911+0000","last_fullsized":"2023-05-21T16:55:22.312911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:11:16.518532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314153+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-21T16:55:22.314153+0000","last_peered":"2023-05-21T16:55:22.314153+0000","last_clean":"2023-05-21T16:55:22.314153+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-21T16:55:22.314153+0000","last_undegraded":"2023-05-21T16:55:22.314153+0000","last_fullsized":"2023-05-21T16:55:22.314153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:31:56.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219400+0000","last_change":"2023-05-21T16:55:21.316461+0000","last_active":"2023-05-21T16:55:23.219400+0000","last_peered":"2023-05-21T16:55:23.219400+0000","last_clean":"2023-05-21T16:55:23.219400+0000","last_became_active":"2023-05-21T16:55:21.316200+0000","last_became_peered":"2023-05-21T16:55:21.316200+0000","last_unstale":"2023-05-21T16:55:23.219400+0000","last_undegraded":"2023-05-21T16:55:23.219400+0000","last_fullsized":"2023-05-21T16:55:23.219400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:52:26.118920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.315537+0000","last_change":"2023-05-21T16:55:20.921350+0000","last_active":"2023-05-21T16:55:22.315537+0000","last_peered":"2023-05-21T16:55:22.315537+0000","last_clean":"2023-05-21T16:55:22.315537+0000","last_became_active":"2023-05-21T16:55:20.921104+0000","last_became_peered":"2023-05-21T16:55:20.921104+0000","last_unstale":"2023-05-21T16:55:22.315537+0000","last_undegraded":"2023-05-21T16:55:22.315537+0000","last_fullsized":"2023-05-21T16:55:22.315537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:12:29.013165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312638+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-21T16:55:22.312638+0000","last_peered":"2023-05-21T16:55:22.312638+0000","last_clean":"2023-05-21T16:55:22.312638+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-21T16:55:22.312638+0000","last_undegraded":"2023-05-21T16:55:22.312638+0000","last_fullsized":"2023-05-21T16:55:22.312638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:26:13.139215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313361+0000","last_change":"2023-05-21T16:55:21.325556+0000","last_active":"2023-05-21T16:55:22.313361+0000","last_peered":"2023-05-21T16:55:22.313361+0000","last_clean":"2023-05-21T16:55:22.313361+0000","last_became_active":"2023-05-21T16:55:21.325228+0000","last_became_peered":"2023-05-21T16:55:21.325228+0000","last_unstale":"2023-05-21T16:55:22.313361+0000","last_undegraded":"2023-05-21T16:55:22.313361+0000","last_fullsized":"2023-05-21T16:55:22.313361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:54:10.849083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313074+0000","last_change":"2023-05-21T16:55:20.920687+0000","last_active":"2023-05-21T16:55:22.313074+0000","last_peered":"2023-05-21T16:55:22.313074+0000","last_clean":"2023-05-21T16:55:22.313074+0000","last_became_active":"2023-05-21T16:55:20.919442+0000","last_became_peered":"2023-05-21T16:55:20.919442+0000","last_unstale":"2023-05-21T16:55:22.313074+0000","last_undegraded":"2023-05-21T16:55:22.313074+0000","last_fullsized":"2023-05-21T16:55:22.313074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:15:49.781388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.312225+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-21T16:55:22.312225+0000","last_peered":"2023-05-21T16:55:22.312225+0000","last_clean":"2023-05-21T16:55:22.312225+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-21T16:55:22.312225+0000","last_undegraded":"2023-05-21T16:55:22.312225+0000","last_fullsized":"2023-05-21T16:55:22.312225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:35:18.337478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221594+0000","last_change":"2023-05-21T16:55:21.329678+0000","last_active":"2023-05-21T16:55:23.221594+0000","last_peered":"2023-05-21T16:55:23.221594+0000","last_clean":"2023-05-21T16:55:23.221594+0000","last_became_active":"2023-05-21T16:55:21.329412+0000","last_became_peered":"2023-05-21T16:55:21.329412+0000","last_unstale":"2023-05-21T16:55:23.221594+0000","last_undegraded":"2023-05-21T16:55:23.221594+0000","last_fullsized":"2023-05-21T16:55:23.221594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:44:40.645219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221410+0000","last_change":"2023-05-21T16:55:20.926618+0000","last_active":"2023-05-21T16:55:23.221410+0000","last_peered":"2023-05-21T16:55:23.221410+0000","last_clean":"2023-05-21T16:55:23.221410+0000","last_became_active":"2023-05-21T16:55:20.926330+0000","last_became_peered":"2023-05-21T16:55:20.926330+0000","last_unstale":"2023-05-21T16:55:23.221410+0000","last_undegraded":"2023-05-21T16:55:23.221410+0000","last_fullsized":"2023-05-21T16:55:23.221410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:15:28.872425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.314052+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-21T16:55:22.314052+0000","last_peered":"2023-05-21T16:55:22.314052+0000","last_clean":"2023-05-21T16:55:22.314052+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-21T16:55:22.314052+0000","last_undegraded":"2023-05-21T16:55:22.314052+0000","last_fullsized":"2023-05-21T16:55:22.314052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:39:22.743356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.222099+0000","last_change":"2023-05-21T16:55:21.336714+0000","last_active":"2023-05-21T16:55:23.222099+0000","last_peered":"2023-05-21T16:55:23.222099+0000","last_clean":"2023-05-21T16:55:23.222099+0000","last_became_active":"2023-05-21T16:55:21.336419+0000","last_became_peered":"2023-05-21T16:55:21.336419+0000","last_unstale":"2023-05-21T16:55:23.222099+0000","last_undegraded":"2023-05-21T16:55:23.222099+0000","last_fullsized":"2023-05-21T16:55:23.222099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T23:38:48.182829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.221128+0000","last_change":"2023-05-21T16:55:20.921499+0000","last_active":"2023-05-21T16:55:23.221128+0000","last_peered":"2023-05-21T16:55:23.221128+0000","last_clean":"2023-05-21T16:55:23.221128+0000","last_became_active":"2023-05-21T16:55:20.921225+0000","last_became_peered":"2023-05-21T16:55:20.921225+0000","last_unstale":"2023-05-21T16:55:23.221128+0000","last_undegraded":"2023-05-21T16:55:23.221128+0000","last_fullsized":"2023-05-21T16:55:23.221128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:22:54.134085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219898+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-21T16:55:23.219898+0000","last_peered":"2023-05-21T16:55:23.219898+0000","last_clean":"2023-05-21T16:55:23.219898+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-21T16:55:23.219898+0000","last_undegraded":"2023-05-21T16:55:23.219898+0000","last_fullsized":"2023-05-21T16:55:23.219898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:07:45.108974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220710+0000","last_change":"2023-05-21T16:55:21.321608+0000","last_active":"2023-05-21T16:55:23.220710+0000","last_peered":"2023-05-21T16:55:23.220710+0000","last_clean":"2023-05-21T16:55:23.220710+0000","last_became_active":"2023-05-21T16:55:21.321324+0000","last_became_peered":"2023-05-21T16:55:21.321324+0000","last_unstale":"2023-05-21T16:55:23.220710+0000","last_undegraded":"2023-05-21T16:55:23.220710+0000","last_fullsized":"2023-05-21T16:55:23.220710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T18:27:07.707246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218953+0000","last_change":"2023-05-21T16:55:20.920902+0000","last_active":"2023-05-21T16:55:23.218953+0000","last_peered":"2023-05-21T16:55:23.218953+0000","last_clean":"2023-05-21T16:55:23.218953+0000","last_became_active":"2023-05-21T16:55:20.920582+0000","last_became_peered":"2023-05-21T16:55:20.920582+0000","last_unstale":"2023-05-21T16:55:23.218953+0000","last_undegraded":"2023-05-21T16:55:23.218953+0000","last_fullsized":"2023-05-21T16:55:23.218953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:52:36.454574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313547+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-21T16:55:22.313547+0000","last_peered":"2023-05-21T16:55:22.313547+0000","last_clean":"2023-05-21T16:55:22.313547+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-21T16:55:22.313547+0000","last_undegraded":"2023-05-21T16:55:22.313547+0000","last_fullsized":"2023-05-21T16:55:22.313547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:42:22.331814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.219854+0000","last_change":"2023-05-21T16:55:21.336236+0000","last_active":"2023-05-21T16:55:23.219854+0000","last_peered":"2023-05-21T16:55:23.219854+0000","last_clean":"2023-05-21T16:55:23.219854+0000","last_became_active":"2023-05-21T16:55:21.335801+0000","last_became_peered":"2023-05-21T16:55:21.335801+0000","last_unstale":"2023-05-21T16:55:23.219854+0000","last_undegraded":"2023-05-21T16:55:23.219854+0000","last_fullsized":"2023-05-21T16:55:23.219854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T19:03:30.603595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218917+0000","last_change":"2023-05-21T16:55:20.925944+0000","last_active":"2023-05-21T16:55:23.218917+0000","last_peered":"2023-05-21T16:55:23.218917+0000","last_clean":"2023-05-21T16:55:23.218917+0000","last_became_active":"2023-05-21T16:55:20.925505+0000","last_became_peered":"2023-05-21T16:55:20.925505+0000","last_unstale":"2023-05-21T16:55:23.218917+0000","last_undegraded":"2023-05-21T16:55:23.218917+0000","last_fullsized":"2023-05-21T16:55:23.218917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:48:20.013228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.223971+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-21T16:55:23.223971+0000","last_peered":"2023-05-21T16:55:23.223971+0000","last_clean":"2023-05-21T16:55:23.223971+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-21T16:55:23.223971+0000","last_undegraded":"2023-05-21T16:55:23.223971+0000","last_fullsized":"2023-05-21T16:55:23.223971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:28:31.679272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:22.313543+0000","last_change":"2023-05-21T16:55:21.324549+0000","last_active":"2023-05-21T16:55:22.313543+0000","last_peered":"2023-05-21T16:55:22.313543+0000","last_clean":"2023-05-21T16:55:22.313543+0000","last_became_active":"2023-05-21T16:55:21.324265+0000","last_became_peered":"2023-05-21T16:55:21.324265+0000","last_unstale":"2023-05-21T16:55:22.313543+0000","last_undegraded":"2023-05-21T16:55:22.313543+0000","last_fullsized":"2023-05-21T16:55:22.313543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:20.890342+0000","last_clean_scrub_stamp":"2023-05-21T16:55:20.890342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:34:45.801191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.218991+0000","last_change":"2023-05-21T16:55:20.922524+0000","last_active":"2023-05-21T16:55:23.218991+0000","last_peered":"2023-05-21T16:55:23.218991+0000","last_clean":"2023-05-21T16:55:23.218991+0000","last_became_active":"2023-05-21T16:55:20.922008+0000","last_became_peered":"2023-05-21T16:55:20.922008+0000","last_unstale":"2023-05-21T16:55:23.218991+0000","last_undegraded":"2023-05-21T16:55:23.218991+0000","last_fullsized":"2023-05-21T16:55:23.218991+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:55:19.886476+0000","last_clean_scrub_stamp":"2023-05-21T16:55:19.886476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:04:06.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-21T16:55:23.220076+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-21T16:55:23.220076+0000","last_peered":"2023-05-21T16:55:23.220076+0000","last_clean":"2023-05-21T16:55:23.220076+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-21T16:55:23.220076+0000","last_undegraded":"2023-05-21T16:55:23.220076+0000","last_fullsized":"2023-05-21T16:55:23.220076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T17:08:57.025750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":1044480,"data_stored":772061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.093}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.214},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.0760000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.1830000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":438272,"data_stored":180641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.034},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.82099999999999995}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.72799999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.98999999999999999}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.878}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8504,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363336,"statfs":{"total":96636764160,"available":96628056064,"internally_reserved":0,"allocated":442368,"data_stored":180171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.65900000000000003}]},{"osd":1,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.74299999999999999}]},{"osd":2,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0569999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.93999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8632,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363208,"statfs":{"total":96636764160,"available":96627924992,"internally_reserved":0,"allocated":442368,"data_stored":180663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.746}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.119}]},{"osd":2,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.0329999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.1679999999999999}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.004}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12672,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359168,"statfs":{"total":96636764160,"available":96623788032,"internally_reserved":0,"allocated":450560,"data_stored":181657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.312},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.57299999999999995}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.024},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.91900000000000004}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.878}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12532,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359308,"statfs":{"total":96636764160,"available":96623931392,"internally_reserved":0,"allocated":438272,"data_stored":180129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.1140000000000001}]},{"osd":1,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.89500000000000002}]},{"osd":3,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.2070000000000001}]},{"osd":4,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.0249999999999999}]},{"osd":5,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.389}]},{"osd":6,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.458},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.254}]},{"osd":7,"last update":"Sun May 21 16:55:06 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.353},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.502}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12596,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359244,"statfs":{"total":96636764160,"available":96623865856,"internally_reserved":0,"allocated":438272,"data_stored":180149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.505},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.129},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.081},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.88600000000000001}]},{"osd":6,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.248},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.052}]},{"osd":7,"last update":"Sun May 21 16:55:09 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.163},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.1899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13688,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358152,"statfs":{"total":96636764160,"available":96622747648,"internally_reserved":0,"allocated":1032192,"data_stored":770461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.442}]},{"osd":3,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.72299999999999998}]},{"osd":4,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0349999999999999}]},{"osd":6,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun May 21 16:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-21T16:55:30.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-21T16:55:30.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-21T16:55:30.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 Processor -- start 2023-05-21T16:55:30.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 -- start start 2023-05-21T16:55:30.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50600cc9d0 0x7f50600cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50600ccda0 0x7f5060160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cf360 0x7f5060160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50600af130 con 0x7f50600ccda0 2023-05-21T16:55:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50601610c0 con 0x7f50600cc9d0 2023-05-21T16:55:30.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600ce340 con 0x7f50600cf360 2023-05-21T16:55:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50600ccda0 0x7f5060160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50600ccda0 0x7f5060160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45420/0 (socket says 172.21.15.46:45420) 2023-05-21T16:55:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 -- 172.21.15.46:0/473956662 learned_addr learned my addr 172.21.15.46:0/473956662 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505f7fe700 1 --2- 172.21.15.46:0/473956662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cf360 0x7f5060160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505effd700 1 --2- 172.21.15.46:0/473956662 >> v2:172.21.15.142:3300/0 conn(0x7f50600cc9d0 0x7f50600cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 -- 172.21.15.46:0/473956662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cf360 msgr2=0x7f5060160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 --2- 172.21.15.46:0/473956662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cf360 0x7f5060160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 -- 172.21.15.46:0/473956662 >> v2:172.21.15.142:3300/0 conn(0x7f50600cc9d0 msgr2=0x7f50600cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 --2- 172.21.15.46:0/473956662 >> v2:172.21.15.142:3300/0 conn(0x7f50600cc9d0 0x7f50600cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.583+0000 7f505e7fc700 1 -- 172.21.15.46:0/473956662 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600ce620 con 0x7f50600ccda0 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505e7fc700 1 --2- 172.21.15.46:0/473956662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f5060160520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5060072520 tx=0x7f5054009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7911de4623ea1850 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505dffb700 1 -- 172.21.15.46:0/473956662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400b8a0 con 0x7f50600ccda0 2023-05-21T16:55:30.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505dffb700 1 -- 172.21.15.46:0/473956662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400ba00 con 0x7f50600ccda0 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505dffb700 1 -- 172.21.15.46:0/473956662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400bd90 con 0x7f50600ccda0 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 -- 172.21.15.46:0/473956662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 msgr2=0x7f5060160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 --2- 172.21.15.46:0/473956662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f5060160520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5060072520 tx=0x7f5054009bf0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 -- 172.21.15.46:0/473956662 shutdown_connections 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 --2- 172.21.15.46:0/473956662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cf360 0x7f5060160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 --2- 172.21.15.46:0/473956662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f5060160520 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 --2- 172.21.15.46:0/473956662 >> v2:172.21.15.142:3300/0 conn(0x7f50600cc9d0 0x7f50600cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 -- 172.21.15.46:0/473956662 >> 172.21.15.46:0/473956662 conn(0x7f506006d930 msgr2=0x7f506006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 -- 172.21.15.46:0/473956662 shutdown_connections 2023-05-21T16:55:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.587+0000 7f505ffff700 1 -- 172.21.15.46:0/473956662 wait complete. 2023-05-21T16:55:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 Processor -- start 2023-05-21T16:55:30.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 -- start start 2023-05-21T16:55:30.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cc9d0 0x7f50600c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f50600c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50600cf360 0x7f506015f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600c44f0 con 0x7f50600ccda0 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600c9a10 con 0x7f50600cf360 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600c35d0 con 0x7f50600cc9d0 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f50600c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f50600c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45430/0 (socket says 172.21.15.46:45430) 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 -- 172.21.15.46:0/2446329349 learned_addr learned my addr 172.21.15.46:0/2446329349 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505effd700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cc9d0 0x7f50600c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505f7fe700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50600cf360 0x7f506015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 -- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cc9d0 msgr2=0x7f50600c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cc9d0 0x7f50600c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 -- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50600cf360 msgr2=0x7f506015f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50600cf360 0x7f506015f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 -- 172.21.15.46:0/2446329349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054009570 con 0x7f50600ccda0 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505f7fe700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50600cf360 0x7f506015f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505effd700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cc9d0 0x7f50600c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:30.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505e7fc700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f50600c4910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f506006f510 tx=0x7f5054004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50540036c0 con 0x7f50600ccda0 2023-05-21T16:55:30.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505401f070 con 0x7f50600ccda0 2023-05-21T16:55:30.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50601613a0 con 0x7f50600ccda0 2023-05-21T16:55:30.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.591+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054003a80 con 0x7f50600ccda0 2023-05-21T16:55:30.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.595+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50600ce900 con 0x7f50600ccda0 2023-05-21T16:55:30.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.595+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50600ca8e0 con 0x7f50600ccda0 2023-05-21T16:55:30.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.595+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5054021030 con 0x7f50600ccda0 2023-05-21T16:55:30.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.595+0000 7f50477fe700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f504c0662f0 0x7f504c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.595+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5054085380 con 0x7f50600ccda0 2023-05-21T16:55:30.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.595+0000 7f505effd700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f504c0662f0 0x7f504c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.599+0000 7f505effd700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f504c0662f0 0x7f504c0687a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5060151970 tx=0x7f5050008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.603+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f50540529b0 con 0x7f50600ccda0 2023-05-21T16:55:30.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.827+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5060073cb0 con 0x7f50600ccda0 2023-05-21T16:55:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.835+0000 7f50477fe700 1 -- 172.21.15.46:0/2446329349 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5054055fd0 con 0x7f50600ccda0 2023-05-21T16:55:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f504c0662f0 msgr2=0x7f504c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f504c0662f0 0x7f504c0687a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5060151970 tx=0x7f5050008040 comp rx=0 tx=0).stop 2023-05-21T16:55:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 msgr2=0x7f50600c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f50600c4910 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f506006f510 tx=0x7f5054004770 comp rx=0 tx=0).stop 2023-05-21T16:55:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 shutdown_connections 2023-05-21T16:55:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f504c0662f0 0x7f504c0687a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50600cf360 0x7f506015f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50600ccda0 0x7f50600c4910 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 --2- 172.21.15.46:0/2446329349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50600cc9d0 0x7f50600c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 >> 172.21.15.46:0/2446329349 conn(0x7f506006d930 msgr2=0x7f506015e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 shutdown_connections 2023-05-21T16:55:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.839+0000 7f505ffff700 1 -- 172.21.15.46:0/2446329349 wait complete. 2023-05-21T16:55:30.845 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2023-05-21T16:55:30.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-21T16:55:30.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.963+0000 7f6404997700 1 Processor -- start 2023-05-21T16:55:30.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.963+0000 7f6404997700 1 -- start start 2023-05-21T16:55:30.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f640006c760 0x7f64000caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640015aea0 con 0x7f6400154de0 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6400071790 con 0x7f640015e210 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640015ac20 con 0x7f640006c760 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63ff7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6400154de0 0x7f640015b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54146/0 (socket says 172.21.15.46:54146) 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63ff7fe700 1 -- 172.21.15.46:0/1861019954 learned_addr learned my addr 172.21.15.46:0/1861019954 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63feffd700 1 --2- 172.21.15.46:0/1861019954 >> v2:172.21.15.142:3300/0 conn(0x7f640006c760 0x7f64000caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63fe7fc700 1 -- 172.21.15.46:0/1861019954 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721554894 0 0) 0x7f640015aea0 con 0x7f6400154de0 2023-05-21T16:55:30.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63fe7fc700 1 -- 172.21.15.46:0/1861019954 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e80035d0 con 0x7f6400154de0 2023-05-21T16:55:30.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63feffd700 1 -- 172.21.15.46:0/1861019954 >> v1:172.21.15.142:6789/0 conn(0x7f640015e210 legacy=0x7f64000c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63feffd700 1 -- 172.21.15.46:0/1861019954 >> v1:172.21.15.46:6789/0 conn(0x7f6400154de0 legacy=0x7f640015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63feffd700 1 -- 172.21.15.46:0/1861019954 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640006cdd0 con 0x7f640006c760 2023-05-21T16:55:30.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63feffd700 1 --2- 172.21.15.46:0/1861019954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f640006c760 0x7f64000caea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009d90 tx=0x7f63f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13957320231cfcfd server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63fe7fc700 1 -- 172.21.15.46:0/1861019954 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000e070 con 0x7f640006c760 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63fe7fc700 1 -- 172.21.15.46:0/1861019954 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000bb20 con 0x7f640006c760 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f63fe7fc700 1 -- 172.21.15.46:0/1861019954 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000be90 con 0x7f640006c760 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- 172.21.15.46:0/1861019954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f640006c760 msgr2=0x7f64000caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 --2- 172.21.15.46:0/1861019954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f640006c760 0x7f64000caea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009d90 tx=0x7f63f000b330 comp rx=0 tx=0).stop 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- 172.21.15.46:0/1861019954 shutdown_connections 2023-05-21T16:55:30.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 --2- 172.21.15.46:0/1861019954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f640006c760 0x7f64000caea0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- 172.21.15.46:0/1861019954 >> 172.21.15.46:0/1861019954 conn(0x7f64000cf720 msgr2=0x7f64000cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:30.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- 172.21.15.46:0/1861019954 shutdown_connections 2023-05-21T16:55:30.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.967+0000 7f6404997700 1 -- 172.21.15.46:0/1861019954 wait complete. 2023-05-21T16:55:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 Processor -- start 2023-05-21T16:55:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 -- start start 2023-05-21T16:55:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 0x7f64000cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6400154de0 0x7f64000c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f640015e210 0x7f6400154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c4b00 con 0x7f640006c760 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000cd8e0 con 0x7f6400154de0 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6400154740 con 0x7f640015e210 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 0x7f64000cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 0x7f64000cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45444/0 (socket says 172.21.15.46:45444) 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 -- 172.21.15.46:0/3622246460 learned_addr learned my addr 172.21.15.46:0/3622246460 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:30.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63feffd700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6400154de0 0x7f64000c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63fffff700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f640015e210 0x7f6400154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 -- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f640015e210 msgr2=0x7f6400154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f640015e210 0x7f6400154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 -- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6400154de0 msgr2=0x7f64000c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6400154de0 0x7f64000c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 -- 172.21.15.46:0/3622246460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0009a70 con 0x7f640006c760 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63ff7fe700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 0x7f64000cc5d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c700 tx=0x7f63f400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4005d90 con 0x7f640006c760 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40070d0 con 0x7f640006c760 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640006d390 con 0x7f640006c760 2023-05-21T16:55:30.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007480 con 0x7f640006c760 2023-05-21T16:55:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.971+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640006d0b0 con 0x7f640006c760 2023-05-21T16:55:30.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.975+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640015ba40 con 0x7f640006c760 2023-05-21T16:55:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.975+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63f40075e0 con 0x7f640006c760 2023-05-21T16:55:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.975+0000 7f63e7fff700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f63ec066320 0x7f63ec0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.975+0000 7f63feffd700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f63ec066320 0x7f63ec0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.975+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63f40832c0 con 0x7f640006c760 2023-05-21T16:55:30.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.975+0000 7f63feffd700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f63ec066320 0x7f63ec0687d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f63f000b370 tx=0x7f63f0011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:30.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:30.987+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f63f40506a0 con 0x7f640006c760 2023-05-21T16:55:31.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.183+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64000733b0 con 0x7f640006c760 2023-05-21T16:55:31.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f63e7fff700 1 -- 172.21.15.46:0/3622246460 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f63f4053cc0 con 0x7f640006c760 2023-05-21T16:55:31.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:31.190 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:55:21.293141+0000","modified":"2023-05-21T16:55:24.614864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/2842509941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":2842509941},{"type":"v1","addr":"172.21.15.46:6837","nonce":2842509941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-21T16:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f63ec066320 msgr2=0x7f63ec0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f63ec066320 0x7f63ec0687d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f63f000b370 tx=0x7f63f0011000 comp rx=0 tx=0).stop 2023-05-21T16:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 msgr2=0x7f64000cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 0x7f64000cc5d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c700 tx=0x7f63f400ca10 comp rx=0 tx=0).stop 2023-05-21T16:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 shutdown_connections 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f63ec066320 0x7f63ec0687d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f640015e210 0x7f6400154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6400154de0 0x7f64000c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 --2- 172.21.15.46:0/3622246460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f640006c760 0x7f64000cc5d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 >> 172.21.15.46:0/3622246460 conn(0x7f64000cf720 msgr2=0x7f640015b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 shutdown_connections 2023-05-21T16:55:31.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.187+0000 7f6404997700 1 -- 172.21.15.46:0/3622246460 wait complete. 2023-05-21T16:55:31.194 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-05-21T16:55:31.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-21T16:55:21.293141+0000', 'modified': '2023-05-21T16:55:24.614864+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5343}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5343': {'gid': 5343, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6837/2842509941', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 2842509941}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 2842509941}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-21T16:55:31.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-21T16:55:31.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-21T16:55:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.731+0000 7f25c0acc700 1 Processor -- start 2023-05-21T16:55:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.731+0000 7f25c0acc700 1 -- start start 2023-05-21T16:55:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25bc06c760 0x7f25bc15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25bc0c9cd0 0x7f25bc0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc06b9d0 con 0x7f25bc15dbb0 2023-05-21T16:55:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc06b450 con 0x7f25bc06c760 2023-05-21T16:55:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc159a90 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25b3fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f25bc15dbb0 0x7f25bc06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54162/0 (socket says 172.21.15.46:54162) 2023-05-21T16:55:31.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25b3fff700 1 -- 172.21.15.46:0/2826321556 learned_addr learned my addr 172.21.15.46:0/2826321556 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:31.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/2826321556 >> v2:172.21.15.46:3300/0 conn(0x7f25bc06c760 0x7f25bc15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bbfff700 1 --2- 172.21.15.46:0/2826321556 >> v2:172.21.15.142:3300/0 conn(0x7f25bc0c9cd0 0x7f25bc0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25baffd700 1 -- 172.21.15.46:0/2826321556 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654041515 0 0) 0x7f25bc06b9d0 con 0x7f25bc15dbb0 2023-05-21T16:55:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25baffd700 1 -- 172.21.15.46:0/2826321556 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a80035d0 con 0x7f25bc15dbb0 2023-05-21T16:55:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bbfff700 1 -- 172.21.15.46:0/2826321556 >> v2:172.21.15.46:3300/0 conn(0x7f25bc06c760 msgr2=0x7f25bc15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bbfff700 1 --2- 172.21.15.46:0/2826321556 >> v2:172.21.15.46:3300/0 conn(0x7f25bc06c760 0x7f25bc15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bbfff700 1 -- 172.21.15.46:0/2826321556 >> v1:172.21.15.46:6789/0 conn(0x7f25bc15dbb0 legacy=0x7f25bc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bbfff700 1 -- 172.21.15.46:0/2826321556 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc06b6f0 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/2826321556 >> v2:172.21.15.46:3300/0 conn(0x7f25bc06c760 0x7f25bc15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25bbfff700 1 --2- 172.21.15.46:0/2826321556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0ca150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0c5a60 tx=0x7f25b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e321f3340747a426 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25baffd700 1 -- 172.21.15.46:0/2826321556 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400e070 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25baffd700 1 -- 172.21.15.46:0/2826321556 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400bb20 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- 172.21.15.46:0/2826321556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc0c9cd0 msgr2=0x7f25bc0ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 --2- 172.21.15.46:0/2826321556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0ca150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0c5a60 tx=0x7f25b400b330 comp rx=0 tx=0).stop 2023-05-21T16:55:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- 172.21.15.46:0/2826321556 shutdown_connections 2023-05-21T16:55:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 --2- 172.21.15.46:0/2826321556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0ca150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 --2- 172.21.15.46:0/2826321556 >> v2:172.21.15.46:3300/0 conn(0x7f25bc06c760 0x7f25bc15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- 172.21.15.46:0/2826321556 >> 172.21.15.46:0/2826321556 conn(0x7f25bc0cf720 msgr2=0x7f25bc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- 172.21.15.46:0/2826321556 shutdown_connections 2023-05-21T16:55:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.735+0000 7f25c0acc700 1 -- 172.21.15.46:0/2826321556 wait complete. 2023-05-21T16:55:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 Processor -- start 2023-05-21T16:55:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 -- start start 2023-05-21T16:55:31.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc06c760 0x7f25bc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25bc15dbb0 0x7f25bc0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc0c5250 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc0b3750 con 0x7f25bc06c760 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25c0acc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc0b3a30 con 0x7f25bc15dbb0 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45474/0 (socket says 172.21.15.46:45474) 2023-05-21T16:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 -- 172.21.15.46:0/3514333601 learned_addr learned my addr 172.21.15.46:0/3514333601 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:31.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc06c760 0x7f25bc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25bbfff700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25bc15dbb0 0x7f25bc0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 -- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25bc15dbb0 msgr2=0x7f25bc0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25bc15dbb0 0x7f25bc0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 -- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc06c760 msgr2=0x7f25bc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc06c760 0x7f25bc15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 -- 172.21.15.46:0/3514333601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a40094b0 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.739+0000 7f25b3fff700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0c3ef0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00c4d0 tx=0x7f25ac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25b8ff9700 1 -- 172.21.15.46:0/3514333601 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac005d90 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25b8ff9700 1 -- 172.21.15.46:0/3514333601 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0070d0 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25b8ff9700 1 -- 172.21.15.46:0/3514333601 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac007480 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b4009a70 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc15a030 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25b8ff9700 1 -- 172.21.15.46:0/3514333601 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25ac0075e0 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25b8ff9700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f259c0662f0 0x7f259c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f259c0662f0 0x7f259c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.743+0000 7f25b8ff9700 1 -- 172.21.15.46:0/3514333601 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25ac083130 con 0x7f25bc0c9cd0 2023-05-21T16:55:31.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f259c0662f0 0x7f259c0687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0abc90 tx=0x7f25a4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 Processor -- start 2023-05-21T16:55:31.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 -- start start 2023-05-21T16:55:31.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1f4f4f0 0x2037390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x20378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 0x20009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f0bb30 con 0x1d7eae0 2023-05-21T16:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f5e710 con 0x1f4f4f0 2023-05-21T16:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f57970 con 0x1d7eeb0 2023-05-21T16:55:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 0x20009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 0x20009c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45488/0 (socket says 172.21.15.46:45488) 2023-05-21T16:55:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25bbfff700 1 -- 172.21.15.46:0/542712489 learned_addr learned my addr 172.21.15.46:0/542712489 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1f4f4f0 0x2037390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.747+0000 7f25b3fff700 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x20378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 msgr2=0x20378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x20378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1f4f4f0 msgr2=0x2037390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1f4f4f0 0x2037390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/542712489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f1da10 con 0x1d7eae0 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1f4f4f0 0x2037390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 0x20009c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f25b4013000 tx=0x7f25b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38690c480fa721f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25b17fa700 1 -- 172.21.15.46:0/542712489 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4012730 con 0x1d7eae0 2023-05-21T16:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25b17fa700 1 -- 172.21.15.46:0/542712489 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4012890 con 0x1d7eae0 2023-05-21T16:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25b17fa700 1 -- 172.21.15.46:0/542712489 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4012c00 con 0x1d7eae0 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- 172.21.15.46:0/542712489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 msgr2=0x20009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 0x20009c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f25b4013000 tx=0x7f25b4011000 comp rx=0 tx=0).stop 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- 172.21.15.46:0/542712489 shutdown_connections 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eae0 0x20009c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x20378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- 172.21.15.46:0/542712489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1f4f4f0 0x2037390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- 172.21.15.46:0/542712489 >> 172.21.15.46:0/542712489 conn(0x1fe8310 msgr2=0x2019790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- 172.21.15.46:0/542712489 shutdown_connections 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- 172.21.15.46:0/542712489 wait complete. 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- start start 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 Processor -- start 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2033410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x1ff11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 0x1ff1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ef5b00 con 0x1f4f4f0 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f1ad60 con 0x1d7eae0 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e03b20 con 0x1d7eeb0 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25c4fad740 10 client.0 _ll_register_callbacks cb 0x1f51210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 0x1ff1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 0x1ff1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45502/0 (socket says 172.21.15.46:45502) 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/3886464564 learned_addr learned my addr 172.21.15.46:0/3886464564 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:31.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25b3fff700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x1ff11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2033410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 msgr2=0x1ff11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x1ff11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 msgr2=0x2033410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2033410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.751+0000 7f25bbfff700 1 -- 172.21.15.46:0/3886464564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc06b6f0 con 0x1f4f4f0 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25bbfff700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 0x1ff1720 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f25b400b370 tx=0x7f25b4004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5897c30cc4af6a3b server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 1 -- 172.21.15.46:0/3886464564 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4012e10 con 0x1f4f4f0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f50950 con 0x1f4f4f0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 1 -- 172.21.15.46:0/3886464564 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25b4020070 con 0x1f4f4f0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 1 -- 172.21.15.46:0/3886464564 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b4004040 con 0x1f4f4f0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 10 client.5535 fetch_fsmap learned FSMap version 15 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x1dca9e0 con 0x1f4f4f0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 1 -- 172.21.15.46:0/3886464564 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f50950 con 0x1f4f4f0 2023-05-21T16:55:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 1 -- 172.21.15.46:0/3886464564 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f25b40041a0 con 0x1f4f4f0 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 10 client.5535 fetch_fsmap finished waiting for FSMap version 15 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 10 client.5535 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 20 client.5535 populate_metadata read hostname 'smithi046' 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1d7e710 0x203da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 4 client.5535 mds_command: new command op to 5343 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 --> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f12830 con 0x1d7e710 2023-05-21T16:55:31.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1d7e710 0x203da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1d7e710 0x203da80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7954a97ee536c069 server_cookie=bfecad631726db52 in_seq=0 out_seq=0 2023-05-21T16:55:31.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 10 client.5535 ms_handle_connect on v2:172.21.15.46:6836/2842509941 2023-05-21T16:55:31.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 1 -- 172.21.15.46:0/3886464564 <== mds.0 v2:172.21.15.46:6836/2842509941 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x1f12830 con 0x1d7e710 2023-05-21T16:55:31.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 10 client.5535 handle_command_reply: tid=0 2023-05-21T16:55:31.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 client.5535 shutdown 2023-05-21T16:55:31.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 msgr2=0x1ff1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 0x1ff1720 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f25b400b370 tx=0x7f25b4004b60 comp rx=0 tx=0).stop 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 shutdown_connections 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1d7e710 0x203da80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f259a7fc700 0 client.5535 ms_handle_reset on v2:172.21.15.46:6836/2842509941 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1f4f4f0 0x1ff1720 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x1ff11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 --2- 172.21.15.46:0/3886464564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2033410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.755+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 >> 172.21.15.46:0/3886464564 conn(0x1fe8310 msgr2=0x1ff1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.759+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 shutdown_connections 2023-05-21T16:55:31.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.759+0000 7f25c4fad740 1 -- 172.21.15.46:0/3886464564 wait complete. 2023-05-21T16:55:31.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.759+0000 7f25c4fad740 20 client.5535 trim_cache size 0 max 16384 2023-05-21T16:55:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 Processor -- start 2023-05-21T16:55:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- start start 2023-05-21T16:55:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7e710 0x2045d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2046240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 0x2015970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f532e0 con 0x1d7eeb0 2023-05-21T16:55:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f189b0 con 0x1d7eae0 2023-05-21T16:55:31.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f226a0 con 0x1d7e710 2023-05-21T16:55:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 0x2015970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 0x2015970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45504/0 (socket says 172.21.15.46:45504) 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 -- 172.21.15.46:0/1699866622 learned_addr learned my addr 172.21.15.46:0/1699866622 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7e710 0x2045d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25b3fff700 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2046240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 -- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7e710 msgr2=0x2045d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7e710 0x2045d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 -- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 msgr2=0x2046240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2046240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 -- 172.21.15.46:0/1699866622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0c4cd0 con 0x1d7eeb0 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25bbfff700 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 0x2015970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f25b4002230 tx=0x7f25b402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befe8d5877ebf62f server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25b1ffb700 1 -- 172.21.15.46:0/1699866622 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4004840 con 0x1d7eeb0 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25b1ffb700 1 -- 172.21.15.46:0/1699866622 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b40387b0 con 0x1d7eeb0 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25b1ffb700 1 -- 172.21.15.46:0/1699866622 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4038920 con 0x1d7eeb0 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- 172.21.15.46:0/1699866622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 msgr2=0x2015970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 0x2015970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f25b4002230 tx=0x7f25b402f000 comp rx=0 tx=0).stop 2023-05-21T16:55:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- 172.21.15.46:0/1699866622 shutdown_connections 2023-05-21T16:55:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7eeb0 0x2015970 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x2046240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 --2- 172.21.15.46:0/1699866622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7e710 0x2045d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- 172.21.15.46:0/1699866622 >> 172.21.15.46:0/1699866622 conn(0x1fe8310 msgr2=0x203da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- 172.21.15.46:0/1699866622 shutdown_connections 2023-05-21T16:55:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.779+0000 7f25c4fad740 1 -- 172.21.15.46:0/1699866622 wait complete. 2023-05-21T16:55:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 -- start start 2023-05-21T16:55:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 Processor -- start 2023-05-21T16:55:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 0x1fec6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x1fecc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x203a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ef8850 con 0x1d7e710 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f5b970 con 0x1d7eae0 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f54d70 con 0x1d7eeb0 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25c4fad740 10 client.0 _ll_register_callbacks cb 0x7f25a8003760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 0x1fec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 0x1fec6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45516/0 (socket says 172.21.15.46:45516) 2023-05-21T16:55:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 -- 172.21.15.46:0/201180819 learned_addr learned my addr 172.21.15.46:0/201180819 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bbfff700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x203a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25b3fff700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x1fecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 -- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 msgr2=0x203a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x203a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 -- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 msgr2=0x1fecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x1fecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25bb7fe700 1 -- 172.21.15.46:0/201180819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1dca9e0 con 0x1d7e710 2023-05-21T16:55:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.783+0000 7f25b3fff700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x1fecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-21T16:55:31.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-05-21T16:55:31.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25bb7fe700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 0x1fec6f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f25a40042f0 tx=0x7f25a40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb30170037f997 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 1 -- 172.21.15.46:0/201180819 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a402a460 con 0x1d7e710 2023-05-21T16:55:31.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 1 -- 172.21.15.46:0/201180819 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25a401c040 con 0x1d7e710 2023-05-21T16:55:31.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x20173a0 con 0x1d7e710 2023-05-21T16:55:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 1 -- 172.21.15.46:0/201180819 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25a402a5c0 con 0x1d7e710 2023-05-21T16:55:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 10 client.5541 fetch_fsmap learned FSMap version 15 2023-05-21T16:55:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x1f03e40 con 0x1d7e710 2023-05-21T16:55:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 1 -- 172.21.15.46:0/201180819 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x20173a0 con 0x1d7e710 2023-05-21T16:55:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 1 -- 172.21.15.46:0/201180819 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f25a4003a50 con 0x1d7e710 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 10 client.5541 fetch_fsmap finished waiting for FSMap version 15 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 10 client.5541 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 20 client.5541 populate_metadata read hostname 'smithi046' 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1f4f4f0 0x203a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 4 client.5541 mds_command: new command op to 5343 tid=0[{"prefix": "status"}] 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 --> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f25b4012890 con 0x1f4f4f0 2023-05-21T16:55:31.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25b3fff700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1f4f4f0 0x203a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 10 client.5541 ms_handle_connect on v2:172.21.15.46:6836/2842509941 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25b3fff700 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1f4f4f0 0x203a600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb548c298a2d218d server_cookie=4a21f0534bcb43a1 in_seq=0 out_seq=0 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 1 -- 172.21.15.46:0/201180819 <== mds.0 v2:172.21.15.46:6836/2842509941 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f25b4012890 con 0x1f4f4f0 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 10 client.5541 handle_command_reply: tid=0 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 client.5541 shutdown 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 msgr2=0x1fec6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 0x1fec6f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f25a40042f0 tx=0x7f25a40047e0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 shutdown_connections 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:6836/2842509941,v1:172.21.15.46:6837/2842509941] conn(0x1f4f4f0 0x203a600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x1d7eeb0 0x203a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x1d7eae0 0x1fecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f259a7fc700 0 client.5541 ms_handle_reset on v2:172.21.15.46:6836/2842509941 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 --2- 172.21.15.46:0/201180819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d7e710 0x1fec6f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 >> 172.21.15.46:0/201180819 conn(0x1fe8310 msgr2=0x2015970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 shutdown_connections 2023-05-21T16:55:31.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 1 -- 172.21.15.46:0/201180819 wait complete. 2023-05-21T16:55:31.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.787+0000 7f25c4fad740 20 client.5541 trim_cache size 0 max 16384 2023-05-21T16:55:31.798 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-21T16:55:31.798 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "88c6000c-747d-47ed-bada-4d7002233c90", 2023-05-21T16:55:31.798 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-05-21T16:55:31.799 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5343, 2023-05-21T16:55:31.799 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-05-21T16:55:31.799 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-05-21T16:55:31.799 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-05-21T16:55:31.799 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 10.494405180999999, 2023-05-21T16:55:31.799 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 15, 2023-05-21T16:55:31.800 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 38, 2023-05-21T16:55:31.800 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 38, 2023-05-21T16:55:31.800 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 17.759086275000001 2023-05-21T16:55:31.800 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-21T16:55:31.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f259c0662f0 msgr2=0x7f259c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f259c0662f0 0x7f259c0687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0abc90 tx=0x7f25a4009240 comp rx=0 tx=0).stop 2023-05-21T16:55:31.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 msgr2=0x7f25bc0c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0c3ef0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00c4d0 tx=0x7f25ac00c7e0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 shutdown_connections 2023-05-21T16:55:31.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f259c0662f0 0x7f259c0687a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25bc15dbb0 0x7f25bc0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25bc0c9cd0 0x7f25bc0c3ef0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 --2- 172.21.15.46:0/3514333601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25bc06c760 0x7f25bc15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 >> 172.21.15.46:0/3514333601 conn(0x7f25bc0cf720 msgr2=0x7f25bc0b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 shutdown_connections 2023-05-21T16:55:31.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.791+0000 7f25c0acc700 1 -- 172.21.15.46:0/3514333601 wait complete. 2023-05-21T16:55:31.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-21T16:55:31.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 Processor -- start 2023-05-21T16:55:31.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 -- start start 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51500b6230 0x7f51500ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5150070a60 0x7f51500b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500cf240 con 0x7f51500d06a0 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500cd4d0 con 0x7f5150070a60 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.923+0000 7f5155565700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500cd2e0 con 0x7f51500b6230 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5154d64700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5150070a60 0x7f51500b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5147fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f51500d06a0 0x7f5150070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54174/0 (socket says 172.21.15.46:54174) 2023-05-21T16:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5147fff700 1 -- 172.21.15.46:0/3619063102 learned_addr learned my addr 172.21.15.46:0/3619063102 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f514ffff700 1 --2- 172.21.15.46:0/3619063102 >> v2:172.21.15.142:3300/0 conn(0x7f51500b6230 0x7f51500ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f514f7fe700 1 -- 172.21.15.46:0/3619063102 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243616659 0 0) 0x7f51500cf240 con 0x7f51500d06a0 2023-05-21T16:55:31.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f514f7fe700 1 -- 172.21.15.46:0/3619063102 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f513c0035d0 con 0x7f51500d06a0 2023-05-21T16:55:31.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5154d64700 1 -- 172.21.15.46:0/3619063102 >> v2:172.21.15.142:3300/0 conn(0x7f51500b6230 msgr2=0x7f51500ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:31.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5154d64700 1 --2- 172.21.15.46:0/3619063102 >> v2:172.21.15.142:3300/0 conn(0x7f51500b6230 0x7f51500ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5154d64700 1 -- 172.21.15.46:0/3619063102 >> v1:172.21.15.46:6789/0 conn(0x7f51500d06a0 legacy=0x7f5150070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5154d64700 1 -- 172.21.15.46:0/3619063102 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500cb450 con 0x7f5150070a60 2023-05-21T16:55:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5154d64700 1 --2- 172.21.15.46:0/3619063102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5150070a60 0x7f51500b00f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f51500cd640 tx=0x7f514800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b49f9e6be64e42 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f514f7fe700 1 -- 172.21.15.46:0/3619063102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800e070 con 0x7f5150070a60 2023-05-21T16:55:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f514f7fe700 1 -- 172.21.15.46:0/3619063102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800bb20 con 0x7f5150070a60 2023-05-21T16:55:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f514f7fe700 1 -- 172.21.15.46:0/3619063102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148012430 con 0x7f5150070a60 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 -- 172.21.15.46:0/3619063102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5150070a60 msgr2=0x7f51500b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 --2- 172.21.15.46:0/3619063102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5150070a60 0x7f51500b00f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f51500cd640 tx=0x7f514800b330 comp rx=0 tx=0).stop 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 -- 172.21.15.46:0/3619063102 shutdown_connections 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 --2- 172.21.15.46:0/3619063102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5150070a60 0x7f51500b00f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 --2- 172.21.15.46:0/3619063102 >> v2:172.21.15.142:3300/0 conn(0x7f51500b6230 0x7f51500ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 -- 172.21.15.46:0/3619063102 >> 172.21.15.46:0/3619063102 conn(0x7f51500d0c60 msgr2=0x7f51500d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:31.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 -- 172.21.15.46:0/3619063102 shutdown_connections 2023-05-21T16:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.927+0000 7f5155565700 1 -- 172.21.15.46:0/3619063102 wait complete. 2023-05-21T16:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 Processor -- start 2023-05-21T16:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 -- start start 2023-05-21T16:55:31.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 0x7f515014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51500b6230 0x7f51501565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 0x7f5150156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500c8d20 con 0x7f51500d06a0 2023-05-21T16:55:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500c8110 con 0x7f5150070a60 2023-05-21T16:55:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5155565700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500c83f0 con 0x7f51500b6230 2023-05-21T16:55:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 0x7f515014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5154d64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 0x7f5150156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5147fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51500b6230 0x7f51501565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 0x7f515014ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:50716/0 (socket says 172.21.15.46:50716) 2023-05-21T16:55:31.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 -- 172.21.15.46:0/1973983846 learned_addr learned my addr 172.21.15.46:0/1973983846 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:31.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5154d64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 0x7f5150156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45528/0 (socket says 172.21.15.46:45528) 2023-05-21T16:55:31.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 -- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51500b6230 msgr2=0x7f51501565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51500b6230 0x7f51501565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 -- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 msgr2=0x7f5150156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:31.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 0x7f5150156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:31.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f514ffff700 1 -- 172.21.15.46:0/1973983846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009a70 con 0x7f5150070a60 2023-05-21T16:55:31.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.931+0000 7f5154d64700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 0x7f5150156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:31.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514ffff700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 0x7f515014ef30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f514000e9d0 tx=0x7f514000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140009720 con 0x7f5150070a60 2023-05-21T16:55:31.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514000ee70 con 0x7f5150070a60 2023-05-21T16:55:31.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51500cf490 con 0x7f5150070a60 2023-05-21T16:55:31.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000ca50 con 0x7f5150070a60 2023-05-21T16:55:31.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51500cb730 con 0x7f5150070a60 2023-05-21T16:55:31.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51500b24f0 con 0x7f5150070a60 2023-05-21T16:55:31.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f514000cbb0 con 0x7f5150070a60 2023-05-21T16:55:31.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514d7fa700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5130066320 0x7f51300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:31.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51400840d0 con 0x7f5150070a60 2023-05-21T16:55:31.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.935+0000 7f5147fff700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5130066320 0x7f51300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:31.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.939+0000 7f5147fff700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5130066320 0x7f51300687d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f51500c7920 tx=0x7f5138007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:31.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:31.947+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5140054f60 con 0x7f5150070a60 2023-05-21T16:55:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.147+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5150067ac0 con 0x7f5150070a60 2023-05-21T16:55:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.147+0000 7f514d7fa700 1 -- 172.21.15.46:0/1973983846 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f514000ce60 con 0x7f5150070a60 2023-05-21T16:55:32.152 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-21T16:55:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5130066320 msgr2=0x7f51300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5130066320 0x7f51300687d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f51500c7920 tx=0x7f5138007de0 comp rx=0 tx=0).stop 2023-05-21T16:55:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 msgr2=0x7f515014ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 0x7f515014ef30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f514000e9d0 tx=0x7f514000ece0 comp rx=0 tx=0).stop 2023-05-21T16:55:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 shutdown_connections 2023-05-21T16:55:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5130066320 0x7f51300687d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500d06a0 0x7f5150156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51500b6230 0x7f51501565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 --2- 172.21.15.46:0/1973983846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5150070a60 0x7f515014ef30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 >> 172.21.15.46:0/1973983846 conn(0x7f51500d0c60 msgr2=0x7f51500b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 shutdown_connections 2023-05-21T16:55:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:32.151+0000 7f5155565700 1 -- 172.21.15.46:0/1973983846 wait complete. 2023-05-21T16:55:32.166 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-21T16:55:32.167 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-21T16:55:32.167 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-05-21T16:55:32.167 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-21T16:55:32.167 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-21T16:55:32.168 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-21T16:55:32.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-21T16:55:32.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-21T16:55:32.169 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-21T16:55:32.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.169 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-05-21T16:55:32.177 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-21T16:55:32.177 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-21T16:55:32.178 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-05-21T16:55:32.178 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.178 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-05-21T16:55:32.178 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.178 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:55:32.178 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42541sec preferred_lft 42541sec 2023-05-21T16:55:32.179 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-05-21T16:55:32.180 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.180 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-21T16:55:32.180 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:55:32.180 INFO:teuthology.orchestra.run.smithi046.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-21T16:55:32.180 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 02:42:3f:7c:3c:7d brd ff:ff:ff:ff:ff:ff 2023-05-21T16:55:32.181 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-21T16:55:32.181 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.181 INFO:teuthology.orchestra.run.smithi046.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-21T16:55:32.181 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether b6:73:ea:bd:05:00 brd ff:ff:ff:ff:ff:ff 2023-05-21T16:55:32.181 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-21T16:55:32.181 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.182 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::3c45:97ff:feb4:fb6e/64 scope link 2023-05-21T16:55:32.182 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.182 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-21T16:55:32.182 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether b6:73:ea:bd:05:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-21T16:55:32.182 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::b473:eaff:febd:500/64 scope link 2023-05-21T16:55:32.183 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.183 INFO:teuthology.orchestra.run.smithi046.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-21T16:55:32.183 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether ba:7c:a6:bb:75:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-21T16:55:32.183 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::b87c:a6ff:febb:7551/64 scope link 2023-05-21T16:55:32.183 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-05-21T16:55:32.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.184 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-21T16:55:32.236 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-05-21T16:55:32.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.238 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-05-21T16:55:32.246 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-05-21T16:55:32.247 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-21T16:55:32.247 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-21T16:55:32.247 INFO:teuthology.orchestra.run.smithi046.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-21T16:55:32.247 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-21T16:55:32.247 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-21T16:55:32.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-05-21T16:55:32.248 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-05-21T16:55:32.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-21T16:55:32.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-21T16:55:32.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-21T16:55:32.250 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-05-21T16:55:32.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.328 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-05-21T16:55:32.334 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-21T16:55:32.335 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-21T16:55:32.335 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-21T16:55:32.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-05-21T16:55:32.352 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-21T16:55:32.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:55:32.353 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-21T16:55:32.398 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-21T16:55:32.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-21T16:55:32.399 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-21T16:55:32.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:55:32.423 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:55:32.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:55:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:55:32.481 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:55:32.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.482 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:55:32.489 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-21T16:55:32.489 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-21T16:55:32.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:55:32.507 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:55:32.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:55:32.561 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:55:32.562 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:55:32.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:32.563 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:55:32.581 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2023-05-21T16:55:32.579+0000 7f688d045640 -1 init, newargv = 0x564819a90140 newargc=15 2023-05-21T16:55:32.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45098]: starting ceph client 2023-05-21T16:55:32.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45098]: starting fuse 2023-05-21T16:55:33.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-05-21T16:55:33.688 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-21T16:55:33.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-21T16:55:33.752 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-21T16:55:33.753 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-21T16:55:33.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:33.755 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-05-21T16:55:33.762 INFO:teuthology.orchestra.run.smithi046.stdout:52 2023-05-21T16:55:33.762 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-05-21T16:55:33.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-21T16:55:33.763 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2023-05-21T16:55:33.763 DEBUG:teuthology.orchestra.run.smithi046:> import re 2023-05-21T16:55:33.763 DEBUG:teuthology.orchestra.run.smithi046:> import os 2023-05-21T16:55:33.764 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2023-05-21T16:55:33.764 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:55:33.764 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2023-05-21T16:55:33.765 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-21T16:55:33.765 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2023-05-21T16:55:33.765 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-21T16:55:33.765 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:55:33.766 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2023-05-21T16:55:33.766 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2023-05-21T16:55:33.766 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2023-05-21T16:55:33.767 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2023-05-21T16:55:33.767 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:55:33.767 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2023-05-21T16:55:33.767 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-21T16:55:33.768 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-21T16:55:33.768 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-21T16:55:33.768 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2023-05-21T16:55:33.769 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2023-05-21T16:55:33.769 DEBUG:teuthology.orchestra.run.smithi046:> return f 2023-05-21T16:55:33.769 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-21T16:55:33.770 DEBUG:teuthology.orchestra.run.smithi046:> 2023-05-21T16:55:33.770 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2023-05-21T16:55:33.770 DEBUG:teuthology.orchestra.run.smithi046:> ' 2023-05-21T16:55:33.857 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.45098.asok 2023-05-21T16:55:34.040 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45098.asok 2023-05-21T16:55:34.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45098.asok status 2023-05-21T16:55:34.148 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-21T16:55:34.148 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1", 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.0.0-3996-g5ca1fdcf (5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1) reef (dev)", 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "45098", 2023-05-21T16:55:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5556, 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2023-05-21T16:55:34.150 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 5556 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1644692401 2023-05-21T16:55:34.151 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-05-21T16:55:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-05-21T16:55:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-05-21T16:55:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-05-21T16:55:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1644692401 2023-05-21T16:55:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-05-21T16:55:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.5556 192.168.0.1:0/1644692401", 2023-05-21T16:55:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/1644692401", 2023-05-21T16:55:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2023-05-21T16:55:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 15, 2023-05-21T16:55:34.154 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 38, 2023-05-21T16:55:34.154 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2023-05-21T16:55:34.154 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2023-05-21T16:55:34.154 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2023-05-21T16:55:34.154 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-21T16:55:34.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.159 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2023-05-21T16:55:34.159 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-21T16:55:34.165 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2023-05-21T16:55:34.165 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-21T16:55:34.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-21T16:55:34.182 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=xfstests-dev 2023-05-21T16:55:34.188 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.wfxug4os5zxfstests-dev 2023-05-21T16:55:34.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.wfxug4os5zxfstests-dev) 2023-05-21T16:55:34.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.wfxug4os5zxfstests-dev) 2023-05-21T16:55:34.227 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/tmp/tmp.wfxug4os5zxfstests-dev'... 2023-05-21T16:55:34.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-21T16:55:34.944 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=test 2023-05-21T16:55:34.950 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.g8r3hAr3OQtest 2023-05-21T16:55:34.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:55:34.951 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-21T16:55:35.005 DEBUG:teuthology.orchestra.run.smithi046:> mktemp -d --suffix=scratch 2023-05-21T16:55:35.012 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.rbmUz4EauFscratch 2023-05-21T16:55:35.012 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-05-21T16:55:35.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-05-21T16:55:35.088 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2023-05-21T16:55:35.290 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2023-05-21T16:55:35.290 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2023-05-21T16:55:35.475 INFO:teuthology.orchestra.run.smithi046.stdout:attr is already the newest version (1:2.4.48-5). 2023-05-21T16:55:35.475 INFO:teuthology.orchestra.run.smithi046.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-05-21T16:55:35.476 INFO:teuthology.orchestra.run.smithi046.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-05-21T16:55:35.476 INFO:teuthology.orchestra.run.smithi046.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-05-21T16:55:35.476 INFO:teuthology.orchestra.run.smithi046.stdout:gcc set to manually installed. 2023-05-21T16:55:35.476 INFO:teuthology.orchestra.run.smithi046.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-05-21T16:55:35.476 INFO:teuthology.orchestra.run.smithi046.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-05-21T16:55:35.476 INFO:teuthology.orchestra.run.smithi046.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:make is already the newest version (4.2.1-1.2). 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:make set to manually installed. 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:quota is already the newest version (4.05-1). 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-05-21T16:55:35.477 INFO:teuthology.orchestra.run.smithi046.stdout:dbench is already the newest version (4.0-2build1). 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:python2 set to manually installed. 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:uuid-runtime is already the newest version (2.34-0.1ubuntu9.3). 2023-05-21T16:55:35.478 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2023-05-21T16:55:35.479 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-05-21T16:55:35.479 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-21T16:55:35.479 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2023-05-21T16:55:35.480 INFO:teuthology.orchestra.run.smithi046.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-05-21T16:55:35.480 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2023-05-21T16:55:35.480 INFO:teuthology.orchestra.run.smithi046.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-05-21T16:55:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2023-05-21T16:55:35.512 INFO:teuthology.orchestra.run.smithi046.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-05-21T16:55:35.514 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages will be upgraded: 2023-05-21T16:55:35.514 INFO:teuthology.orchestra.run.smithi046.stdout: libsqlite3-0 2023-05-21T16:55:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:1 upgraded, 7 newly installed, 0 to remove and 162 not upgraded. 2023-05-21T16:55:35.715 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 2,428 kB of archives. 2023-05-21T16:55:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-05-21T16:55:35.716 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-05-21T16:55:36.263 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-05-21T16:55:36.293 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-05-21T16:55:36.296 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-05-21T16:55:36.301 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-05-21T16:55:36.308 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-05-21T16:55:36.384 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-05-21T16:55:36.393 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-05-21T16:55:36.729 INFO:teuthology.orchestra.run.smithi046.stderr:debconf: unable to initialize frontend: Dialog 2023-05-21T16:55:36.735 INFO:teuthology.orchestra.run.smithi046.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-05-21T16:55:36.735 INFO:teuthology.orchestra.run.smithi046.stderr:debconf: falling back to frontend: Readline 2023-05-21T16:55:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:debconf: unable to initialize frontend: Readline 2023-05-21T16:55:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:debconf: (This frontend requires a controlling tty.) 2023-05-21T16:55:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:debconf: falling back to frontend: Teletype 2023-05-21T16:55:36.755 INFO:teuthology.orchestra.run.smithi046.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-05-21T16:55:36.812 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 2,428 kB in 1s (2,610 kB/s) 2023-05-21T16:55:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 155309 files and directories currently installed.) 2023-05-21T16:55:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../0-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-05-21T16:55:37.208 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-05-21T16:55:37.621 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-05-21T16:55:37.640 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../1-libglusterfs0_7.2-2build1_amd64.deb ... 2023-05-21T16:55:37.679 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-05-21T16:55:38.074 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-05-21T16:55:38.092 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../2-libgfxdr0_7.2-2build1_amd64.deb ... 2023-05-21T16:55:38.132 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-05-21T16:55:38.460 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-05-21T16:55:38.477 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../3-libgfrpc0_7.2-2build1_amd64.deb ... 2023-05-21T16:55:38.509 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-05-21T16:55:38.796 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-05-21T16:55:38.816 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../4-libgfapi0_7.2-2build1_amd64.deb ... 2023-05-21T16:55:38.854 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-05-21T16:55:39.232 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package fio. 2023-05-21T16:55:39.252 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../5-fio_3.16-1_amd64.deb ... 2023-05-21T16:55:39.290 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking fio (3.16-1) ... 2023-05-21T16:55:39.703 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-05-21T16:55:39.724 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../6-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-05-21T16:55:39.770 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-05-21T16:55:40.181 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package sqlite3. 2023-05-21T16:55:40.200 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../7-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-05-21T16:55:40.239 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-05-21T16:55:40.633 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-05-21T16:55:40.760 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-05-21T16:55:40.887 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-05-21T16:55:41.013 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-05-21T16:55:41.172 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-05-21T16:55:41.298 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-05-21T16:55:41.424 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-05-21T16:55:41.650 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up fio (3.16-1) ... 2023-05-21T16:55:42.078 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-05-21T16:55:42.237 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-05-21T16:55:42.522 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-05-21T16:55:44.291 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-05-21T16:55:44.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd -m fsgqa 2023-05-21T16:55:44.888 INFO:teuthology.orchestra.run.smithi046.stderr:useradd: user 'fsgqa' already exists 2023-05-21T16:55:44.890 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-21T16:55:44.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo groupadd fsgqa 2023-05-21T16:55:44.948 INFO:teuthology.orchestra.run.smithi046.stderr:groupadd: group 'fsgqa' already exists 2023-05-21T16:55:44.948 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-21T16:55:44.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd fsgqa2 2023-05-21T16:55:45.321 DEBUG:teuthology.orchestra.run.smithi046:> sudo useradd 123456-fsgqa 2023-05-21T16:55:45.742 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-21T16:55:45.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 Processor -- start 2023-05-21T16:55:45.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 -- start start 2023-05-21T16:55:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba980cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba981600c0 0x7fba980b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:45.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9806afd0 con 0x7fba980b2140 2023-05-21T16:55:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980cd6b0 con 0x7fba981600c0 2023-05-21T16:55:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9f4c2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980cd990 con 0x7fba980b85b0 2023-05-21T16:55:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9ecc1700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fba980b2140 0x7fba98069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57492/0 (socket says 172.21.15.46:57492) 2023-05-21T16:55:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9ecc1700 1 -- 172.21.15.46:0/524108072 learned_addr learned my addr 172.21.15.46:0/524108072 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9dcbf700 1 --2- 172.21.15.46:0/524108072 >> v2:172.21.15.142:3300/0 conn(0x7fba981600c0 0x7fba980b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:45.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.859+0000 7fba9e4c0700 1 --2- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba980cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9dcbf700 1 -- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 msgr2=0x7fba980cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-21T16:55:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9dcbf700 1 --2- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba980cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9d4be700 1 -- 172.21.15.46:0/524108072 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480132673 0 0) 0x7fba9806afd0 con 0x7fba980b2140 2023-05-21T16:55:45.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9dcbf700 1 -- 172.21.15.46:0/524108072 >> v1:172.21.15.46:6789/0 conn(0x7fba980b2140 legacy=0x7fba98069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9dcbf700 1 -- 172.21.15.46:0/524108072 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9806b220 con 0x7fba981600c0 2023-05-21T16:55:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9dcbf700 1 --2- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba980b4940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba94009850 tx=0x7fba94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b1af6a0021ae7b server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9d4be700 1 -- 172.21.15.46:0/524108072 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011830 con 0x7fba981600c0 2023-05-21T16:55:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9d4be700 1 -- 172.21.15.46:0/524108072 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94011990 con 0x7fba981600c0 2023-05-21T16:55:45.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9d4be700 1 -- 172.21.15.46:0/524108072 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94011d40 con 0x7fba981600c0 2023-05-21T16:55:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 -- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 msgr2=0x7fba980b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba980b4940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba94009850 tx=0x7fba94009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 -- 172.21.15.46:0/524108072 shutdown_connections 2023-05-21T16:55:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba980b4940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:45.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/524108072 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba980cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 -- 172.21.15.46:0/524108072 >> 172.21.15.46:0/524108072 conn(0x7fba9806cc00 msgr2=0x7fba980cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 -- 172.21.15.46:0/524108072 shutdown_connections 2023-05-21T16:55:45.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 -- 172.21.15.46:0/524108072 wait complete. 2023-05-21T16:55:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 Processor -- start 2023-05-21T16:55:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.863+0000 7fba9f4c2700 1 -- start start 2023-05-21T16:55:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba98150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba981547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:45.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 0x7fba9815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815e910 con 0x7fba98154d20 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980b3a70 con 0x7fba981600c0 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980b3d50 con 0x7fba980b85b0 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 0x7fba9815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 0x7fba9815cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49790/0 (socket says 172.21.15.46:49790) 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 -- 172.21.15.46:0/1783594837 learned_addr learned my addr 172.21.15.46:0/1783594837 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9e4c0700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba98150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:45.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9dcbf700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba981547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:45.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 -- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 msgr2=0x7fba98150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba98150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 -- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 msgr2=0x7fba981547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba981547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 -- 172.21.15.46:0/1783594837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba940094b0 con 0x7fba98154d20 2023-05-21T16:55:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9e4c0700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba98150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:45.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9dcbf700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba981547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-21T16:55:45.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9ecc1700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 0x7fba9815cde0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fba9000cc70 tx=0x7fba9000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:45.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000aaa0 con 0x7fba98154d20 2023-05-21T16:55:45.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000ac20 con 0x7fba98154d20 2023-05-21T16:55:45.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba980b8980 con 0x7fba98154d20 2023-05-21T16:55:45.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900070d0 con 0x7fba98154d20 2023-05-21T16:55:45.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.867+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9806b500 con 0x7fba98154d20 2023-05-21T16:55:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.871+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980cf5b0 con 0x7fba98154d20 2023-05-21T16:55:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.871+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba90007230 con 0x7fba98154d20 2023-05-21T16:55:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.871+0000 7fba8effd700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba7c066320 0x7fba7c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.871+0000 7fba9e4c0700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba7c066320 0x7fba7c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:45.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.871+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba90083ab0 con 0x7fba98154d20 2023-05-21T16:55:45.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.871+0000 7fba9e4c0700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba7c066320 0x7fba7c0687d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba880112c0 tx=0x7fba88009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:45.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:45.879+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fba90050f20 con 0x7fba98154d20 2023-05-21T16:55:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.095+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fba98067ac0 con 0x7fba98154d20 2023-05-21T16:55:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.095+0000 7fba8effd700 1 -- 172.21.15.46:0/1783594837 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fba90018090 con 0x7fba98154d20 2023-05-21T16:55:46.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:55:46.101 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","modified":"2023-05-21T16:53:17.211547Z","created":"2023-05-21T16:53:17.211547Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3301","nonce":0},{"type":"v1","addr":"172.21.15.142:6790","nonce":0}]},"addr":"172.21.15.142:6790/0","public_addr":"172.21.15.142:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-21T16:55:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba7c066320 msgr2=0x7fba7c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba7c066320 0x7fba7c0687d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba880112c0 tx=0x7fba88009240 comp rx=0 tx=0).stop 2023-05-21T16:55:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 msgr2=0x7fba9815cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 0x7fba9815cde0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fba9000cc70 tx=0x7fba9000cf80 comp rx=0 tx=0).stop 2023-05-21T16:55:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 shutdown_connections 2023-05-21T16:55:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba7c066320 0x7fba7c0687d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba98154d20 0x7fba9815cde0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba981600c0 0x7fba981547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 --2- 172.21.15.46:0/1783594837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba980b85b0 0x7fba98150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 >> 172.21.15.46:0/1783594837 conn(0x7fba980b2140 msgr2=0x7fba980d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 shutdown_connections 2023-05-21T16:55:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.099+0000 7fba9f4c2700 1 -- 172.21.15.46:0/1783594837 wait complete. 2023-05-21T16:55:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:dumped monmap epoch 1 2023-05-21T16:55:46.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-21T16:55:46.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3336848700 1 Processor -- start 2023-05-21T16:55:46.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3336848700 1 -- start start 2023-05-21T16:55:46.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3336848700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3330154de0 0x7f333006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:46.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3336848700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333015aea0 con 0x7f33300caea0 2023-05-21T16:55:46.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3336848700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3330071790 con 0x7f333015e210 2023-05-21T16:55:46.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3336848700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333015ac20 con 0x7f3330154de0 2023-05-21T16:55:46.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3335045700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f33300caea0 0x7f333015b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57496/0 (socket says 172.21.15.46:57496) 2023-05-21T16:55:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3335045700 1 -- 172.21.15.46:0/139896104 learned_addr learned my addr 172.21.15.46:0/139896104 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-21T16:55:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3335846700 1 --2- 172.21.15.46:0/139896104 >> v2:172.21.15.142:3300/0 conn(0x7f3330154de0 0x7f333006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.231+0000 7f3334844700 1 -- 172.21.15.46:0/139896104 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424102336 0 0) 0x7f333015aea0 con 0x7f33300caea0 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3334844700 1 -- 172.21.15.46:0/139896104 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f331c0035d0 con 0x7f33300caea0 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3335846700 1 -- 172.21.15.46:0/139896104 >> v1:172.21.15.142:6789/0 conn(0x7f333015e210 legacy=0x7f33300c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3335846700 1 -- 172.21.15.46:0/139896104 >> v1:172.21.15.46:6789/0 conn(0x7f33300caea0 legacy=0x7f333015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3335846700 1 -- 172.21.15.46:0/139896104 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33300cb340 con 0x7f3330154de0 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3335846700 1 --2- 172.21.15.46:0/139896104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333006c760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3320009850 tx=0x7f3320009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f8a938c67cce7 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:46.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3334844700 1 -- 172.21.15.46:0/139896104 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320011830 con 0x7f3330154de0 2023-05-21T16:55:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3334844700 1 -- 172.21.15.46:0/139896104 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320011990 con 0x7f3330154de0 2023-05-21T16:55:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3334844700 1 -- 172.21.15.46:0/139896104 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320011d40 con 0x7f3330154de0 2023-05-21T16:55:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 -- 172.21.15.46:0/139896104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 msgr2=0x7f333006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 --2- 172.21.15.46:0/139896104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333006c760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3320009850 tx=0x7f3320009b60 comp rx=0 tx=0).stop 2023-05-21T16:55:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 -- 172.21.15.46:0/139896104 shutdown_connections 2023-05-21T16:55:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 --2- 172.21.15.46:0/139896104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333006c760 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 -- 172.21.15.46:0/139896104 >> 172.21.15.46:0/139896104 conn(0x7f33300cf720 msgr2=0x7f33300cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 -- 172.21.15.46:0/139896104 shutdown_connections 2023-05-21T16:55:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 -- 172.21.15.46:0/139896104 wait complete. 2023-05-21T16:55:46.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 Processor -- start 2023-05-21T16:55:46.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.235+0000 7f3336848700 1 -- start start 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33300caea0 0x7f333014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 0x7f333015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33300af8f0 con 0x7f333015e210 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33300aeaa0 con 0x7f3330154de0 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33300aed80 con 0x7f33300caea0 2023-05-21T16:55:46.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 0x7f333015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 0x7f333015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49802/0 (socket says 172.21.15.46:49802) 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 -- 172.21.15.46:0/4206326193 learned_addr learned my addr 172.21.15.46:0/4206326193 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3335045700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3335846700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33300caea0 0x7f333014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 -- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33300caea0 msgr2=0x7f333014dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33300caea0 0x7f333014dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 -- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 msgr2=0x7f333014bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333014bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 -- 172.21.15.46:0/4206326193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33200094b0 con 0x7f333015e210 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336047700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 0x7f333015c520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f332800cb50 tx=0x7f332800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328003c20 con 0x7f333015e210 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3328003d80 con 0x7f333015e210 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333006d0b0 con 0x7f333015e210 2023-05-21T16:55:46.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800ab70 con 0x7f333015e210 2023-05-21T16:55:46.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333006cdd0 con 0x7f333015e210 2023-05-21T16:55:46.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.239+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333006d390 con 0x7f333015e210 2023-05-21T16:55:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.243+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f332800acd0 con 0x7f333015e210 2023-05-21T16:55:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.243+0000 7f33267fc700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33140662f0 0x7f33140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-21T16:55:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.243+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3328083db0 con 0x7f333015e210 2023-05-21T16:55:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.243+0000 7f3335846700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33140662f0 0x7f33140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-21T16:55:46.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.243+0000 7f3335846700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33140662f0 0x7f33140687a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f33200090b0 tx=0x7f3320008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-21T16:55:46.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.247+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f33280511b0 con 0x7f333015e210 2023-05-21T16:55:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.467+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f33300afa30 con 0x7f333015e210 2023-05-21T16:55:46.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f33267fc700 1 -- 172.21.15.46:0/4206326193 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v9) v1 ==== 82+0+151 (secure 0 0 0) 0x7f33280547d0 con 0x7f333015e210 2023-05-21T16:55:46.473 INFO:teuthology.orchestra.run.smithi046.stdout:[client.admin] 2023-05-21T16:55:46.473 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB9TGpki66cFhAATmRKuQwdSltOVjWabveoKw== 2023-05-21T16:55:46.474 INFO:teuthology.orchestra.run.smithi046.stdout: caps mds = "allow *" 2023-05-21T16:55:46.474 INFO:teuthology.orchestra.run.smithi046.stdout: caps mgr = "allow *" 2023-05-21T16:55:46.474 INFO:teuthology.orchestra.run.smithi046.stdout: caps mon = "allow *" 2023-05-21T16:55:46.474 INFO:teuthology.orchestra.run.smithi046.stdout: caps osd = "allow *" 2023-05-21T16:55:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33140662f0 msgr2=0x7f33140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33140662f0 0x7f33140687a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f33200090b0 tx=0x7f3320008030 comp rx=0 tx=0).stop 2023-05-21T16:55:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 msgr2=0x7f333015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-21T16:55:46.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 0x7f333015c520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f332800cb50 tx=0x7f332800cf10 comp rx=0 tx=0).stop 2023-05-21T16:55:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 shutdown_connections 2023-05-21T16:55:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f33140662f0 0x7f33140687a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f333015e210 0x7f333015c520 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3330154de0 0x7f333014bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 --2- 172.21.15.46:0/4206326193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33300caea0 0x7f333014dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-21T16:55:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 >> 172.21.15.46:0/4206326193 conn(0x7f33300cf720 msgr2=0x7f33300b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-21T16:55:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 shutdown_connections 2023-05-21T16:55:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-21T16:55:46.471+0000 7f3336848700 1 -- 172.21.15.46:0/4206326193 wait complete. 2023-05-21T16:55:46.488 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-05-21T16:55:46.495 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.zCJWxzW6TN 2023-05-21T16:55:46.495 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:55:46.495 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/tmp/tmp.zCJWxzW6TN 2023-05-21T16:55:46.542 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:55:46.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/tmp/tmp.wfxug4os5zxfstests-dev/local.config 2023-05-21T16:55:46.557 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.g8r3hAr3OQtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.rbmUz4EauFscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.46:6789 -k /tmp/tmp.zCJWxzW6TN --client_mountpoint /test" 2023-05-21T16:55:46.557 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-21T16:55:46.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/tmp/tmp.wfxug4os5zxfstests-dev/ceph.exclude 2023-05-21T16:55:46.571 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo make) 2023-05-21T16:55:46.599 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize -cfi 2023-05-21T16:55:46.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:55:46.670 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:55:47.125 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-21T16:55:47.125 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './config.guess' 2023-05-21T16:55:47.135 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './config.sub' 2023-05-21T16:55:47.155 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './install-sh' 2023-05-21T16:55:47.166 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file './ltmain.sh' 2023-05-21T16:55:47.220 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-21T16:55:47.220 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-21T16:55:47.238 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-21T16:55:47.249 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-21T16:55:47.260 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-21T16:55:47.271 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-21T16:55:47.282 INFO:teuthology.orchestra.run.smithi046.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-21T16:55:47.284 INFO:teuthology.orchestra.run.smithi046.stdout:cp include/install-sh . 2023-05-21T16:55:47.286 INFO:teuthology.orchestra.run.smithi046.stdout:aclocal -I m4 2023-05-21T16:55:48.736 INFO:teuthology.orchestra.run.smithi046.stdout:autoheader 2023-05-21T16:55:49.104 INFO:teuthology.orchestra.run.smithi046.stdout:autoconf 2023-05-21T16:55:49.343 INFO:teuthology.orchestra.run.smithi046.stdout:./configure \ 2023-05-21T16:55:49.344 INFO:teuthology.orchestra.run.smithi046.stdout: --libexecdir=/usr/lib \ 2023-05-21T16:55:49.344 INFO:teuthology.orchestra.run.smithi046.stdout: --exec_prefix=/var/lib 2023-05-21T16:55:50.047 INFO:teuthology.orchestra.run.smithi046.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-21T16:55:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-21T16:55:50.086 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to print strings... printf 2023-05-21T16:55:50.087 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc... gcc 2023-05-21T16:55:50.308 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether the C compiler works... yes 2023-05-21T16:55:50.309 INFO:teuthology.orchestra.run.smithi046.stdout:checking for C compiler default output file name... a.out 2023-05-21T16:55:50.352 INFO:teuthology.orchestra.run.smithi046.stdout:checking for suffix of executables... 2023-05-21T16:55:50.447 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are cross compiling... no 2023-05-21T16:55:50.479 INFO:teuthology.orchestra.run.smithi046.stdout:checking for suffix of object files... o 2023-05-21T16:55:50.505 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are using the GNU C compiler... yes 2023-05-21T16:55:50.533 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc accepts -g... yes 2023-05-21T16:55:50.622 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to accept ISO C89... none needed 2023-05-21T16:55:50.628 INFO:teuthology.orchestra.run.smithi046.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-05-21T16:55:50.633 INFO:teuthology.orchestra.run.smithi046.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-21T16:55:50.636 INFO:teuthology.orchestra.run.smithi046.stdout:checking for egrep... /usr/bin/grep -E 2023-05-21T16:55:50.639 INFO:teuthology.orchestra.run.smithi046.stdout:checking for fgrep... /usr/bin/grep -F 2023-05-21T16:55:50.646 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ld used by gcc... /usr/bin/ld 2023-05-21T16:55:50.651 INFO:teuthology.orchestra.run.smithi046.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-05-21T16:55:50.663 INFO:teuthology.orchestra.run.smithi046.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-05-21T16:55:50.701 INFO:teuthology.orchestra.run.smithi046.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-05-21T16:55:50.702 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether ln -s works... yes 2023-05-21T16:55:50.732 INFO:teuthology.orchestra.run.smithi046.stdout:checking the maximum length of command line arguments... 1572864 2023-05-21T16:55:50.738 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-21T16:55:50.738 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-21T16:55:50.739 INFO:teuthology.orchestra.run.smithi046.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-05-21T16:55:50.740 INFO:teuthology.orchestra.run.smithi046.stdout:checking for objdump... objdump 2023-05-21T16:55:50.741 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to recognize dependent libraries... pass_all 2023-05-21T16:55:50.742 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dlltool... no 2023-05-21T16:55:50.742 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-21T16:55:50.743 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ar... ar 2023-05-21T16:55:50.791 INFO:teuthology.orchestra.run.smithi046.stdout:checking for archiver @FILE support... @ 2023-05-21T16:55:50.793 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strip... strip 2023-05-21T16:55:50.794 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ranlib... ranlib 2023-05-21T16:55:50.795 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gawk... gawk 2023-05-21T16:55:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-05-21T16:55:50.923 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sysroot... no 2023-05-21T16:55:50.930 INFO:teuthology.orchestra.run.smithi046.stdout:checking for a working dd... /usr/bin/dd 2023-05-21T16:55:50.935 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-05-21T16:55:50.964 INFO:teuthology.orchestra.run.smithi046.stdout:checking for mt... mt 2023-05-21T16:55:50.982 INFO:teuthology.orchestra.run.smithi046.stdout:checking if mt is a manifest tool... no 2023-05-21T16:55:51.046 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to run the C preprocessor... gcc -E 2023-05-21T16:55:51.272 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ANSI C header files... yes 2023-05-21T16:55:51.315 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/types.h... yes 2023-05-21T16:55:51.375 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/stat.h... yes 2023-05-21T16:55:51.426 INFO:teuthology.orchestra.run.smithi046.stdout:checking for stdlib.h... yes 2023-05-21T16:55:51.474 INFO:teuthology.orchestra.run.smithi046.stdout:checking for string.h... yes 2023-05-21T16:55:51.528 INFO:teuthology.orchestra.run.smithi046.stdout:checking for memory.h... yes 2023-05-21T16:55:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strings.h... yes 2023-05-21T16:55:51.637 INFO:teuthology.orchestra.run.smithi046.stdout:checking for inttypes.h... yes 2023-05-21T16:55:51.686 INFO:teuthology.orchestra.run.smithi046.stdout:checking for stdint.h... yes 2023-05-21T16:55:51.745 INFO:teuthology.orchestra.run.smithi046.stdout:checking for unistd.h... yes 2023-05-21T16:55:51.799 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dlfcn.h... yes 2023-05-21T16:55:51.805 INFO:teuthology.orchestra.run.smithi046.stdout:checking for objdir... .libs 2023-05-21T16:55:51.948 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-21T16:55:51.948 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-21T16:55:51.983 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-21T16:55:52.170 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc static flag -static works... yes 2023-05-21T16:55:52.210 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -c -o file.o... yes 2023-05-21T16:55:52.210 INFO:teuthology.orchestra.run.smithi046.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-21T16:55:52.247 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-21T16:55:52.295 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether -lc should be explicitly linked in... no 2023-05-21T16:55:52.386 INFO:teuthology.orchestra.run.smithi046.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-21T16:55:52.386 INFO:teuthology.orchestra.run.smithi046.stdout:checking how to hardcode library paths into programs... immediate 2023-05-21T16:55:52.398 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether stripping libraries is possible... yes 2023-05-21T16:55:52.399 INFO:teuthology.orchestra.run.smithi046.stdout:checking if libtool supports shared libraries... yes 2023-05-21T16:55:52.400 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether to build shared libraries... yes 2023-05-21T16:55:52.400 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether to build static libraries... yes 2023-05-21T16:55:52.417 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc... (cached) gcc 2023-05-21T16:55:52.453 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-05-21T16:55:52.454 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-21T16:55:52.455 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-05-21T16:55:52.455 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gmake... no 2023-05-21T16:55:52.456 INFO:teuthology.orchestra.run.smithi046.stdout:checking for make... /usr/bin/make 2023-05-21T16:55:52.457 INFO:teuthology.orchestra.run.smithi046.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-05-21T16:55:52.457 INFO:teuthology.orchestra.run.smithi046.stdout:checking for tar... /bin/tar 2023-05-21T16:55:52.458 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gzip... /bin/gzip 2023-05-21T16:55:52.475 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether gcc -MM is supported... yes 2023-05-21T16:55:52.476 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sort... /bin/sort 2023-05-21T16:55:52.476 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether ln -s works... yes 2023-05-21T16:55:52.477 INFO:teuthology.orchestra.run.smithi046.stdout:checking for rpm... no 2023-05-21T16:55:52.530 INFO:teuthology.orchestra.run.smithi046.stdout:checking assert.h usability... yes 2023-05-21T16:55:52.542 INFO:teuthology.orchestra.run.smithi046.stdout:checking assert.h presence... yes 2023-05-21T16:55:52.542 INFO:teuthology.orchestra.run.smithi046.stdout:checking for assert.h... yes 2023-05-21T16:55:52.599 INFO:teuthology.orchestra.run.smithi046.stdout:checking bstring.h usability... no 2023-05-21T16:55:52.620 INFO:teuthology.orchestra.run.smithi046.stdout:checking bstring.h presence... no 2023-05-21T16:55:52.620 INFO:teuthology.orchestra.run.smithi046.stdout:checking for bstring.h... no 2023-05-21T16:55:52.675 INFO:teuthology.orchestra.run.smithi046.stdout:checking libgen.h usability... yes 2023-05-21T16:55:52.691 INFO:teuthology.orchestra.run.smithi046.stdout:checking libgen.h presence... yes 2023-05-21T16:55:52.691 INFO:teuthology.orchestra.run.smithi046.stdout:checking for libgen.h... yes 2023-05-21T16:55:52.756 INFO:teuthology.orchestra.run.smithi046.stdout:checking dirent.h usability... yes 2023-05-21T16:55:52.768 INFO:teuthology.orchestra.run.smithi046.stdout:checking dirent.h presence... yes 2023-05-21T16:55:52.769 INFO:teuthology.orchestra.run.smithi046.stdout:checking for dirent.h... yes 2023-05-21T16:55:52.863 INFO:teuthology.orchestra.run.smithi046.stdout:checking errno.h usability... yes 2023-05-21T16:55:52.877 INFO:teuthology.orchestra.run.smithi046.stdout:checking errno.h presence... yes 2023-05-21T16:55:52.878 INFO:teuthology.orchestra.run.smithi046.stdout:checking for errno.h... yes 2023-05-21T16:55:52.934 INFO:teuthology.orchestra.run.smithi046.stdout:checking malloc.h usability... yes 2023-05-21T16:55:52.946 INFO:teuthology.orchestra.run.smithi046.stdout:checking malloc.h presence... yes 2023-05-21T16:55:52.947 INFO:teuthology.orchestra.run.smithi046.stdout:checking for malloc.h... yes 2023-05-21T16:55:53.004 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid.h usability... no 2023-05-21T16:55:53.025 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid.h presence... no 2023-05-21T16:55:53.026 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid.h... no 2023-05-21T16:55:53.104 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid/uuid.h usability... yes 2023-05-21T16:55:53.118 INFO:teuthology.orchestra.run.smithi046.stdout:checking uuid/uuid.h presence... yes 2023-05-21T16:55:53.119 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid/uuid.h... yes 2023-05-21T16:55:53.184 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/uuid.h usability... no 2023-05-21T16:55:53.206 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/uuid.h presence... no 2023-05-21T16:55:53.207 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/uuid.h... no 2023-05-21T16:55:53.264 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/file.h usability... yes 2023-05-21T16:55:53.278 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/file.h presence... yes 2023-05-21T16:55:53.279 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/file.h... yes 2023-05-21T16:55:53.339 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fcntl.h usability... yes 2023-05-21T16:55:53.353 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fcntl.h presence... yes 2023-05-21T16:55:53.353 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fcntl.h... yes 2023-05-21T16:55:53.409 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/syssgi.h usability... no 2023-05-21T16:55:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/syssgi.h presence... no 2023-05-21T16:55:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/syssgi.h... no 2023-05-21T16:55:53.519 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/param.h usability... yes 2023-05-21T16:55:53.541 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/param.h presence... yes 2023-05-21T16:55:53.542 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/param.h... yes 2023-05-21T16:55:53.552 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/stat.h... (cached) yes 2023-05-21T16:55:53.614 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/statvfs.h usability... yes 2023-05-21T16:55:53.627 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/statvfs.h presence... yes 2023-05-21T16:55:53.627 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/statvfs.h... yes 2023-05-21T16:55:53.687 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/time.h usability... yes 2023-05-21T16:55:53.702 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/time.h presence... yes 2023-05-21T16:55:53.703 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/time.h... yes 2023-05-21T16:55:53.760 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/ioctl.h usability... yes 2023-05-21T16:55:53.775 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/ioctl.h presence... yes 2023-05-21T16:55:53.776 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/ioctl.h... yes 2023-05-21T16:55:53.839 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/wait.h usability... yes 2023-05-21T16:55:53.860 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/wait.h presence... yes 2023-05-21T16:55:53.860 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/wait.h... yes 2023-05-21T16:55:53.871 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/types.h... (cached) yes 2023-05-21T16:55:53.882 INFO:teuthology.orchestra.run.smithi046.stdout:checking for strings.h... (cached) yes 2023-05-21T16:55:53.944 INFO:teuthology.orchestra.run.smithi046.stdout:checking err.h usability... yes 2023-05-21T16:55:53.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking err.h presence... yes 2023-05-21T16:55:53.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking for err.h... yes 2023-05-21T16:55:54.016 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/falloc.h usability... yes 2023-05-21T16:55:54.030 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/falloc.h presence... yes 2023-05-21T16:55:54.030 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/falloc.h... yes 2023-05-21T16:55:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-05-21T16:55:54.106 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-05-21T16:55:54.106 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-21T16:55:54.158 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_itable.h usability... no 2023-05-21T16:55:54.179 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/fs/xfs_itable.h presence... no 2023-05-21T16:55:54.179 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-21T16:55:54.251 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/platform_defs.h usability... no 2023-05-21T16:55:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/platform_defs.h presence... no 2023-05-21T16:55:54.273 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/platform_defs.h... no 2023-05-21T16:55:54.326 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfs/ioctl.h usability... no 2023-05-21T16:55:54.346 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfs/ioctl.h presence... no 2023-05-21T16:55:54.347 INFO:teuthology.orchestra.run.smithi046.stdout:checking for btrfs/ioctl.h... no 2023-05-21T16:55:54.395 INFO:teuthology.orchestra.run.smithi046.stdout:checking cifs/ioctl.h usability... no 2023-05-21T16:55:54.416 INFO:teuthology.orchestra.run.smithi046.stdout:checking cifs/ioctl.h presence... no 2023-05-21T16:55:54.417 INFO:teuthology.orchestra.run.smithi046.stdout:checking for cifs/ioctl.h... no 2023-05-21T16:55:54.472 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/mman.h usability... yes 2023-05-21T16:55:54.483 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/mman.h presence... yes 2023-05-21T16:55:54.484 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/mman.h... yes 2023-05-21T16:55:54.516 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xfs_log_format.h... no 2023-05-21T16:55:54.582 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid_compare... no 2023-05-21T16:55:54.640 INFO:teuthology.orchestra.run.smithi046.stdout:checking for uuid_compare in -luuid... yes 2023-05-21T16:55:54.731 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xfs.h... yes 2023-05-21T16:55:54.756 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/libxfs.h... no 2023-05-21T16:55:54.791 INFO:teuthology.orchestra.run.smithi046.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-21T16:55:54.840 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/xqm.h... yes 2023-05-21T16:55:54.917 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-21T16:55:54.959 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/handle.h usability... yes 2023-05-21T16:55:54.971 INFO:teuthology.orchestra.run.smithi046.stdout:checking xfs/handle.h presence... yes 2023-05-21T16:55:54.971 INFO:teuthology.orchestra.run.smithi046.stdout:checking for xfs/handle.h... yes 2023-05-21T16:55:55.046 INFO:teuthology.orchestra.run.smithi046.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-21T16:55:55.101 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/acl.h usability... yes 2023-05-21T16:55:55.118 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/acl.h presence... yes 2023-05-21T16:55:55.118 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/acl.h... yes 2023-05-21T16:55:55.169 INFO:teuthology.orchestra.run.smithi046.stdout:checking acl/libacl.h usability... yes 2023-05-21T16:55:55.188 INFO:teuthology.orchestra.run.smithi046.stdout:checking acl/libacl.h presence... yes 2023-05-21T16:55:55.188 INFO:teuthology.orchestra.run.smithi046.stdout:checking for acl/libacl.h... yes 2023-05-21T16:55:55.251 INFO:teuthology.orchestra.run.smithi046.stdout:checking for acl_init in -lacl... yes 2023-05-21T16:55:55.296 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm-ndbm.h usability... no 2023-05-21T16:55:55.317 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm-ndbm.h presence... no 2023-05-21T16:55:55.317 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gdbm-ndbm.h... no 2023-05-21T16:55:55.362 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm/ndbm.h usability... no 2023-05-21T16:55:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:checking gdbm/ndbm.h presence... no 2023-05-21T16:55:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:checking for gdbm/ndbm.h... no 2023-05-21T16:55:55.428 INFO:teuthology.orchestra.run.smithi046.stdout:checking ndbm.h usability... no 2023-05-21T16:55:55.449 INFO:teuthology.orchestra.run.smithi046.stdout:checking ndbm.h presence... no 2023-05-21T16:55:55.449 INFO:teuthology.orchestra.run.smithi046.stdout:checking for ndbm.h... no 2023-05-21T16:55:55.501 INFO:teuthology.orchestra.run.smithi046.stdout:checking libaio.h usability... yes 2023-05-21T16:55:55.525 INFO:teuthology.orchestra.run.smithi046.stdout:checking libaio.h presence... yes 2023-05-21T16:55:55.525 INFO:teuthology.orchestra.run.smithi046.stdout:checking for libaio.h... yes 2023-05-21T16:55:55.573 INFO:teuthology.orchestra.run.smithi046.stdout:checking liburing.h usability... no 2023-05-21T16:55:55.592 INFO:teuthology.orchestra.run.smithi046.stdout:checking liburing.h presence... no 2023-05-21T16:55:55.593 INFO:teuthology.orchestra.run.smithi046.stdout:checking for liburing.h... no 2023-05-21T16:55:55.637 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/capability.h usability... no 2023-05-21T16:55:55.655 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/capability.h presence... no 2023-05-21T16:55:55.656 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/capability.h... no 2023-05-21T16:55:55.704 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fiemap.h usability... yes 2023-05-21T16:55:55.716 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fiemap.h presence... yes 2023-05-21T16:55:55.717 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/fiemap.h... yes 2023-05-21T16:55:55.778 INFO:teuthology.orchestra.run.smithi046.stdout:checking for fallocate... yes 2023-05-21T16:55:55.840 INFO:teuthology.orchestra.run.smithi046.stdout:checking for open_by_handle_at... yes 2023-05-21T16:55:55.890 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/prctl.h usability... yes 2023-05-21T16:55:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:checking sys/prctl.h presence... yes 2023-05-21T16:55:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:checking for sys/prctl.h... yes 2023-05-21T16:55:55.957 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fs.h usability... yes 2023-05-21T16:55:55.968 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/fs.h presence... yes 2023-05-21T16:55:55.968 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/fs.h... yes 2023-05-21T16:55:56.010 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfsutil.h usability... no 2023-05-21T16:55:56.030 INFO:teuthology.orchestra.run.smithi046.stdout:checking btrfsutil.h presence... no 2023-05-21T16:55:56.030 INFO:teuthology.orchestra.run.smithi046.stdout:checking for btrfsutil.h... no 2023-05-21T16:55:56.094 INFO:teuthology.orchestra.run.smithi046.stdout:checking for copy_file_range... yes 2023-05-21T16:55:56.162 INFO:teuthology.orchestra.run.smithi046.stdout:checking for SEEK_DATA... yes 2023-05-21T16:55:56.248 INFO:teuthology.orchestra.run.smithi046.stdout:checking for BMV_OF_SHARED... yes 2023-05-21T16:55:56.314 INFO:teuthology.orchestra.run.smithi046.stdout:checking for nftw... yes 2023-05-21T16:55:56.373 INFO:teuthology.orchestra.run.smithi046.stdout:checking for RLIMIT_NOFILE... yes 2023-05-21T16:55:56.410 INFO:teuthology.orchestra.run.smithi046.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-21T16:55:56.470 INFO:teuthology.orchestra.run.smithi046.stdout:checking for renameat2... yes 2023-05-21T16:55:56.526 INFO:teuthology.orchestra.run.smithi046.stdout:checking for reallocarray... yes 2023-05-21T16:55:56.555 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct mount_attr... no 2023-05-21T16:55:56.630 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-21T16:55:56.696 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-21T16:55:56.759 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-21T16:55:56.825 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-21T16:55:56.885 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-21T16:55:56.947 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-21T16:55:57.020 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-21T16:55:57.076 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs.h usability... yes 2023-05-21T16:55:57.108 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs.h presence... yes 2023-05-21T16:55:57.108 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/btrfs.h... yes 2023-05-21T16:55:57.154 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs_tree.h usability... yes 2023-05-21T16:55:57.171 INFO:teuthology.orchestra.run.smithi046.stdout:checking linux/btrfs_tree.h presence... yes 2023-05-21T16:55:57.171 INFO:teuthology.orchestra.run.smithi046.stdout:checking for linux/btrfs_tree.h... yes 2023-05-21T16:55:57.235 INFO:teuthology.orchestra.run.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-05-21T16:55:57.272 INFO:teuthology.orchestra.run.smithi046.stdout:configure: creating ./config.status 2023-05-21T16:55:58.102 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: creating include/builddefs 2023-05-21T16:55:58.131 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: creating include/config.h 2023-05-21T16:55:58.152 INFO:teuthology.orchestra.run.smithi046.stdout:config.status: executing libtool commands 2023-05-21T16:55:58.236 INFO:teuthology.orchestra.run.smithi046.stdout:Building include 2023-05-21T16:55:58.243 INFO:teuthology.orchestra.run.smithi046.stdout:Building lib 2023-05-21T16:55:58.250 INFO:teuthology.orchestra.run.smithi046.stdout: [LTDEP] 2023-05-21T16:55:58.434 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dataascii.lo 2023-05-21T16:55:58.608 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] databin.lo 2023-05-21T16:55:58.826 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] datapid.lo 2023-05-21T16:55:58.979 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] file_lock.lo 2023-05-21T16:55:59.205 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] forker.lo 2023-05-21T16:55:59.406 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] pattern.lo 2023-05-21T16:55:59.585 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] open_flags.lo 2023-05-21T16:55:59.794 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] random_range.lo 2023-05-21T16:56:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] string_to_tokens.lo 2023-05-21T16:56:00.255 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] str_to_bytes.lo 2023-05-21T16:56:00.449 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] tlibio.lo 2023-05-21T16:56:00.774 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] write_log.lo 2023-05-21T16:56:00.868 INFO:teuthology.orchestra.run.smithi046.stderr:write_log.c: In function 'wlog_record_write': 2023-05-21T16:56:00.868 INFO:teuthology.orchestra.run.smithi046.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:00.868 INFO:teuthology.orchestra.run.smithi046.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-05-21T16:56:00.868 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:00.868 INFO:teuthology.orchestra.run.smithi046.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:00.869 INFO:teuthology.orchestra.run.smithi046.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-05-21T16:56:00.869 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:01.076 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] random.lo 2023-05-21T16:56:01.231 INFO:teuthology.orchestra.run.smithi046.stdout: [LD] 2023-05-21T16:56:01.354 INFO:teuthology.orchestra.run.smithi046.stdout:Building ltp 2023-05-21T16:56:01.359 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-05-21T16:56:01.585 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] doio 2023-05-21T16:56:02.407 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsstress 2023-05-21T16:56:03.959 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsx 2023-05-21T16:56:04.970 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] growfiles 2023-05-21T16:56:05.588 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] iogen 2023-05-21T16:56:05.765 INFO:teuthology.orchestra.run.smithi046.stderr:iogen.c: In function 'main': 2023-05-21T16:56:05.766 INFO:teuthology.orchestra.run.smithi046.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:05.766 INFO:teuthology.orchestra.run.smithi046.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-05-21T16:56:05.766 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:iogen.c: In function 'parse_cmdline': 2023-05-21T16:56:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:05.769 INFO:teuthology.orchestra.run.smithi046.stderr: 1535 | getcwd(fptr->f_path, 2023-05-21T16:56:05.769 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:05.770 INFO:teuthology.orchestra.run.smithi046.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-05-21T16:56:05.770 INFO:teuthology.orchestra.run.smithi046.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:06.045 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-stress 2023-05-21T16:56:06.219 INFO:teuthology.orchestra.run.smithi046.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-05-21T16:56:06.219 INFO:teuthology.orchestra.run.smithi046.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:06.219 INFO:teuthology.orchestra.run.smithi046.stderr: 1013 | ftruncate(fd, total_ram); 2023-05-21T16:56:06.219 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:06.570 INFO:teuthology.orchestra.run.smithi046.stdout:Building src 2023-05-21T16:56:06.583 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-05-21T16:56:09.011 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-05-21T16:56:09.060 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-05-21T16:56:09.076 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-05-21T16:56:09.407 INFO:teuthology.orchestra.run.smithi046.stdout: [DEP] 2023-05-21T16:56:09.452 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirstress 2023-05-21T16:56:09.794 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fill 2023-05-21T16:56:10.014 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fill2 2023-05-21T16:56:10.320 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] getpagesize 2023-05-21T16:56:10.519 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] holes 2023-05-21T16:56:10.792 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] lstat64 2023-05-21T16:56:11.057 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] nametest 2023-05-21T16:56:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:nametest.c: In function 'main': 2023-05-21T16:56:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:11.239 INFO:teuthology.orchestra.run.smithi046.stderr: 236 | write(1, "\n", 1); 2023-05-21T16:56:11.239 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:11.239 INFO:teuthology.orchestra.run.smithi046.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:11.240 INFO:teuthology.orchestra.run.smithi046.stderr: 238 | write(1, ".", 1); 2023-05-21T16:56:11.240 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:11.240 INFO:teuthology.orchestra.run.smithi046.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:11.240 INFO:teuthology.orchestra.run.smithi046.stderr: 288 | write(1, ".", 1); 2023-05-21T16:56:11.240 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:11.384 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] permname 2023-05-21T16:56:11.662 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] randholes 2023-05-21T16:56:12.001 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] runas 2023-05-21T16:56:12.250 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] truncfile 2023-05-21T16:56:12.503 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] usemem 2023-05-21T16:56:12.722 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmapcat 2023-05-21T16:56:12.890 INFO:teuthology.orchestra.run.smithi046.stderr:mmapcat.c: In function 'main': 2023-05-21T16:56:12.890 INFO:teuthology.orchestra.run.smithi046.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:12.890 INFO:teuthology.orchestra.run.smithi046.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-05-21T16:56:12.890 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:12.943 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] append_reader 2023-05-21T16:56:13.167 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] append_writer 2023-05-21T16:56:13.389 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirperf 2023-05-21T16:56:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] metaperf 2023-05-21T16:56:13.863 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c: In function 'crfiles': 2023-05-21T16:56:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:13.864 INFO:teuthology.orchestra.run.smithi046.stderr: 166 | write(fd, buf, fsize); 2023-05-21T16:56:13.864 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c: In function 't_linkun': 2023-05-21T16:56:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:13.865 INFO:teuthology.orchestra.run.smithi046.stderr: 454 | link("a", *fnp); 2023-05-21T16:56:13.865 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~ 2023-05-21T16:56:13.866 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c: In function 't_chown': 2023-05-21T16:56:13.866 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:13.866 INFO:teuthology.orchestra.run.smithi046.stderr: 404 | chown(*fnp, 2, -1); 2023-05-21T16:56:13.867 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:13.867 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:13.868 INFO:teuthology.orchestra.run.smithi046.stderr: 406 | chown(*fnp, 1, -1); 2023-05-21T16:56:13.868 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:13.868 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c: In function 'i_chown': 2023-05-21T16:56:13.869 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:13.869 INFO:teuthology.orchestra.run.smithi046.stderr: 291 | chown(*fnp, 1, -1); 2023-05-21T16:56:13.869 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:13.870 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c: In function 'main': 2023-05-21T16:56:13.870 INFO:teuthology.orchestra.run.smithi046.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:13.870 INFO:teuthology.orchestra.run.smithi046.stderr: 152 | chdir(".."); 2023-05-21T16:56:13.870 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~ 2023-05-21T16:56:14.030 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] devzero 2023-05-21T16:56:14.281 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] feature 2023-05-21T16:56:14.585 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] alloc 2023-05-21T16:56:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:alloc.c: In function 'main': 2023-05-21T16:56:14.768 INFO:teuthology.orchestra.run.smithi046.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:14.768 INFO:teuthology.orchestra.run.smithi046.stderr: 247 | mkstemp(tmpfile); 2023-05-21T16:56:14.768 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:14.866 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fault 2023-05-21T16:56:15.100 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fstest 2023-05-21T16:56:15.428 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_access_root 2023-05-21T16:56:15.594 INFO:teuthology.orchestra.run.smithi046.stderr:t_access_root.c: In function 'main': 2023-05-21T16:56:15.595 INFO:teuthology.orchestra.run.smithi046.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:15.595 INFO:teuthology.orchestra.run.smithi046.stderr: 55 | system(cmd); 2023-05-21T16:56:15.595 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~ 2023-05-21T16:56:15.655 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] godown 2023-05-21T16:56:15.902 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] resvtest 2023-05-21T16:56:16.167 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] writemod 2023-05-21T16:56:16.380 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] writev_on_pagefault 2023-05-21T16:56:16.605 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] makeextents 2023-05-21T16:56:16.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:56:16.738 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:56:16.860 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] itrash 2023-05-21T16:56:17.087 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] rename 2023-05-21T16:56:17.291 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] multi_open_unlink 2023-05-21T16:56:17.537 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] unwritten_sync 2023-05-21T16:56:17.849 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] genhashnames 2023-05-21T16:56:18.119 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_holes 2023-05-21T16:56:18.334 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_writev 2023-05-21T16:56:18.561 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_truncate_cmtime 2023-05-21T16:56:18.798 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dirhash_collide 2023-05-21T16:56:19.061 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_rename_overwrite 2023-05-21T16:56:19.269 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] holetest 2023-05-21T16:56:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:holetest.c: In function 'pt_write_marker': 2023-05-21T16:56:19.444 INFO:teuthology.orchestra.run.smithi046.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:19.444 INFO:teuthology.orchestra.run.smithi046.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-05-21T16:56:19.444 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:19.572 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_truncate_self 2023-05-21T16:56:19.777 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] af_unix 2023-05-21T16:56:20.009 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_stale_pmd 2023-05-21T16:56:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-05-21T16:56:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr: 42 | ftruncate(fd, 0); 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr: 43 | ftruncate(fd, MiB(4)); 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-05-21T16:56:20.178 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:20.234 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_cow_race 2023-05-21T16:56:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_cow_race.c: In function 'main': 2023-05-21T16:56:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:20.411 INFO:teuthology.orchestra.run.smithi046.stderr: 61 | ftruncate(fd, 0); 2023-05-21T16:56:20.411 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:20.411 INFO:teuthology.orchestra.run.smithi046.stderr: 62 | ftruncate(fd, MiB(2)); 2023-05-21T16:56:20.411 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:20.479 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_fallocate 2023-05-21T16:56:20.705 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsync-err 2023-05-21T16:56:20.982 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_write_ro 2023-05-21T16:56:21.210 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-21T16:56:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-05-21T16:56:21.386 INFO:teuthology.orchestra.run.smithi046.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:21.386 INFO:teuthology.orchestra.run.smithi046.stderr: 61 | ftruncate(fd, 0); 2023-05-21T16:56:21.386 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:21.452 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-21T16:56:21.687 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_ofd_locks 2023-05-21T16:56:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_collision 2023-05-21T16:56:22.262 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmap-write-concurrent 2023-05-21T16:56:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_get_file_time 2023-05-21T16:56:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_create_short_dirs 2023-05-21T16:56:22.971 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_create_long_dirs 2023-05-21T16:56:23.210 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_enospc 2023-05-21T16:56:23.479 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_writev_overlap 2023-05-21T16:56:23.726 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] checkpoint_journal 2023-05-21T16:56:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mmap-rw-fault 2023-05-21T16:56:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] allocstale 2023-05-21T16:56:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_cow_memory_failure 2023-05-21T16:56:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fake-dump-rootino 2023-05-21T16:56:24.921 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-buf-fault 2023-05-21T16:56:25.143 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] xfsctl 2023-05-21T16:56:25.418 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bstat 2023-05-21T16:56:25.708 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mtab 2023-05-21T16:56:25.884 INFO:teuthology.orchestra.run.smithi046.stderr:t_mtab.c: In function 'update_mtab': 2023-05-21T16:56:25.885 INFO:teuthology.orchestra.run.smithi046.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:25.885 INFO:teuthology.orchestra.run.smithi046.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-05-21T16:56:25.885 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:25.977 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] getdevicesize 2023-05-21T16:56:26.195 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] preallo_rw_pattern_reader 2023-05-21T16:56:26.371 INFO:teuthology.orchestra.run.smithi046.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-05-21T16:56:26.371 INFO:teuthology.orchestra.run.smithi046.stderr:iopat.c: In function 'main': 2023-05-21T16:56:26.371 INFO:teuthology.orchestra.run.smithi046.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:26.371 INFO:teuthology.orchestra.run.smithi046.stderr: 38 | read(fd, &x, 1048576); 2023-05-21T16:56:26.371 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] preallo_rw_pattern_writer 2023-05-21T16:56:26.604 INFO:teuthology.orchestra.run.smithi046.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-05-21T16:56:26.605 INFO:teuthology.orchestra.run.smithi046.stderr:iopat.c: In function 'main': 2023-05-21T16:56:26.605 INFO:teuthology.orchestra.run.smithi046.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:26.605 INFO:teuthology.orchestra.run.smithi046.stderr: 34 | write(fd, &x, 1048576); 2023-05-21T16:56:26.605 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] ftrunc 2023-05-21T16:56:26.886 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] trunc 2023-05-21T16:56:27.130 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fs_perms 2023-05-21T16:56:27.304 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c: In function 'main': 2023-05-21T16:56:27.304 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:27.304 INFO:teuthology.orchestra.run.smithi046.stderr: 54 | system("rm -f test.file"); 2023-05-21T16:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c: In function 'testsetup': 2023-05-21T16:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr: 67 | system("cp testx.file test.file"); 2023-05-21T16:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c: In function 'testfperm': 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr: 123 | seteuid(0); 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~ 2023-05-21T16:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr: 124 | setegid(0); 2023-05-21T16:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~ 2023-05-21T16:56:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] testx 2023-05-21T16:56:27.566 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] looptest 2023-05-21T16:56:27.842 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] locktest 2023-05-21T16:56:28.246 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] unwritten_mmap 2023-05-21T16:56:28.477 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_unlink_test 2023-05-21T16:56:28.658 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test.c: In function 'main': 2023-05-21T16:56:28.658 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:28.659 INFO:teuthology.orchestra.run.smithi046.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-05-21T16:56:28.659 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:28.659 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:28.659 INFO:teuthology.orchestra.run.smithi046.stderr: 178 | system(fname); 2023-05-21T16:56:28.659 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~ 2023-05-21T16:56:28.760 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] deduperace 2023-05-21T16:56:29.042 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_unlink_test_modified 2023-05-21T16:56:29.221 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-05-21T16:56:29.221 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.221 INFO:teuthology.orchestra.run.smithi046.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-05-21T16:56:29.221 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.221 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.222 INFO:teuthology.orchestra.run.smithi046.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-05-21T16:56:29.222 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.222 INFO:teuthology.orchestra.run.smithi046.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.222 INFO:teuthology.orchestra.run.smithi046.stderr: 185 | system(fname); 2023-05-21T16:56:29.222 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~ 2023-05-21T16:56:29.319 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_offset 2023-05-21T16:56:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_futimens 2023-05-21T16:56:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_immutable 2023-05-21T16:56:29.956 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c: In function 'create_test_area': 2023-05-21T16:56:29.957 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.957 INFO:teuthology.orchestra.run.smithi046.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-05-21T16:56:29.957 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.957 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.958 INFO:teuthology.orchestra.run.smithi046.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-05-21T16:56:29.958 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.959 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c: In function 'remove_test_area': 2023-05-21T16:56:29.959 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.960 INFO:teuthology.orchestra.run.smithi046.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.961 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c: In function 'check_test_area': 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.962 INFO:teuthology.orchestra.run.smithi046.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.963 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.964 INFO:teuthology.orchestra.run.smithi046.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-21T16:56:29.965 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.967 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c: In function 'test_immutable': 2023-05-21T16:56:29.967 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.968 INFO:teuthology.orchestra.run.smithi046.stderr: 408 | chown(path, 0, 0); 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-21T16:56:29.969 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr: 553 | chown(path, 0, 0); 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.970 INFO:teuthology.orchestra.run.smithi046.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.971 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr: 653 | chown(path, 0, 0); 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.972 INFO:teuthology.orchestra.run.smithi046.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr: 705 | chown(path, 0, 0); 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.973 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c: In function 'test_append': 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.974 INFO:teuthology.orchestra.run.smithi046.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr: 1051 | chown(path, 0, 0); 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-05-21T16:56:29.975 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr: 1516 | chown(path, 0, 0); 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.976 INFO:teuthology.orchestra.run.smithi046.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-05-21T16:56:29.977 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.978 INFO:teuthology.orchestra.run.smithi046.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr: 1618 | chown(path, 0, 0); 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.979 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr: 1644 | chown(path, 0, 0); 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.980 INFO:teuthology.orchestra.run.smithi046.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr: 1692 | chown(path, 0, 0); 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-21T16:56:29.981 INFO:teuthology.orchestra.run.smithi046.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:29.982 INFO:teuthology.orchestra.run.smithi046.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-21T16:56:29.982 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] stale_handle 2023-05-21T16:56:30.735 INFO:teuthology.orchestra.run.smithi046.stderr:stale_handle.c: In function 'main': 2023-05-21T16:56:30.735 INFO:teuthology.orchestra.run.smithi046.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:30.735 INFO:teuthology.orchestra.run.smithi046.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-05-21T16:56:30.736 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] pwrite_mmap_blocked 2023-05-21T16:56:31.023 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_offset2 2023-05-21T16:56:31.302 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] seek_sanity_test 2023-05-21T16:56:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c: In function 'test18': 2023-05-21T16:56:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.493 INFO:teuthology.orchestra.run.smithi046.stderr: 460 | ftruncate(fd, 0); 2023-05-21T16:56:31.493 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-05-21T16:56:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.495 INFO:teuthology.orchestra.run.smithi046.stderr: 1207 | ftruncate(fd, 0); 2023-05-21T16:56:31.495 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.496 INFO:teuthology.orchestra.run.smithi046.stderr: 1256 | ftruncate(fd, 0); 2023-05-21T16:56:31.496 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-05-21T16:56:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.496 INFO:teuthology.orchestra.run.smithi046.stderr: 88 | ftruncate(fd, 0); 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr: 98 | ftruncate(fd, 0); 2023-05-21T16:56:31.497 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:31.498 INFO:teuthology.orchestra.run.smithi046.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-05-21T16:56:31.498 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:31.831 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] seek_copy_test 2023-05-21T16:56:32.086 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_1 2023-05-21T16:56:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:t_readdir_1.c: In function 'main': 2023-05-21T16:56:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:32.256 INFO:teuthology.orchestra.run.smithi046.stderr: 30 | read(fd, buf, 100); 2023-05-21T16:56:32.257 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:32.304 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_2 2023-05-21T16:56:32.528 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fsync-tester 2023-05-21T16:56:32.700 INFO:teuthology.orchestra.run.smithi046.stderr:fsync-tester.c: In function 'main': 2023-05-21T16:56:32.700 INFO:teuthology.orchestra.run.smithi046.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:32.700 INFO:teuthology.orchestra.run.smithi046.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-05-21T16:56:32.701 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:32.701 INFO:teuthology.orchestra.run.smithi046.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:32.701 INFO:teuthology.orchestra.run.smithi046.stderr: 541 | system("reboot -fn"); 2023-05-21T16:56:32.701 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:32.701 INFO:teuthology.orchestra.run.smithi046.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-05-21T16:56:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:32.702 INFO:teuthology.orchestra.run.smithi046.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-05-21T16:56:32.702 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:32.871 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] nsexec 2023-05-21T16:56:33.125 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] cloner 2023-05-21T16:56:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] renameat2 2023-05-21T16:56:33.621 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_getcwd 2023-05-21T16:56:33.798 INFO:teuthology.orchestra.run.smithi046.stderr:t_getcwd.c: In function 'test_getcwd': 2023-05-21T16:56:33.798 INFO:teuthology.orchestra.run.smithi046.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:33.798 INFO:teuthology.orchestra.run.smithi046.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-05-21T16:56:33.798 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:33.860 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] e4compact 2023-05-21T16:56:34.149 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] test-nextquota 2023-05-21T16:56:34.387 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] punch-alternating 2023-05-21T16:56:34.625 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-21T16:56:34.875 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] listxattr 2023-05-21T16:56:35.091 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-interleaved 2023-05-21T16:56:35.323 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_dir_type 2023-05-21T16:56:35.550 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] dio-invalidate-cache 2023-05-21T16:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:dio-invalidate-cache.c: In function 'main': 2023-05-21T16:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:35.726 INFO:teuthology.orchestra.run.smithi046.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-05-21T16:56:35.727 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:35.843 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] stat_test 2023-05-21T16:56:36.231 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_encrypted_d_revalidate 2023-05-21T16:56:36.475 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] attr_replace_test 2023-05-21T16:56:36.720 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] swapon 2023-05-21T16:56:36.959 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mkswap 2023-05-21T16:56:37.180 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_attr_corruption 2023-05-21T16:56:37.400 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_open_tmpfiles 2023-05-21T16:56:37.661 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fscrypt-crypt-util 2023-05-21T16:56:38.470 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] bulkstat_null_ocount 2023-05-21T16:56:38.698 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] splice-test 2023-05-21T16:56:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] chprojid_fail 2023-05-21T16:56:39.180 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] detached_mounts_propagation 2023-05-21T16:56:39.448 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] ext4_resize 2023-05-21T16:56:39.667 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_readdir_3 2023-05-21T16:56:39.945 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] splice2pipe 2023-05-21T16:56:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-05-21T16:56:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:splice2pipe.c:56:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:40.117 INFO:teuthology.orchestra.run.smithi046.stderr: 56 | write(p[1], buffer, n); 2023-05-21T16:56:40.117 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:40.117 INFO:teuthology.orchestra.run.smithi046.stderr:splice2pipe.c:64:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:40.117 INFO:teuthology.orchestra.run.smithi046.stderr: 64 | read(p[0], buffer, n); 2023-05-21T16:56:40.117 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:40.180 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] uuid_ioctl 2023-05-21T16:56:40.407 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fiemap-tester 2023-05-21T16:56:40.775 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_stripealign 2023-05-21T16:56:41.008 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] open_by_handle 2023-05-21T16:56:41.336 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] t_mmap_dio 2023-05-21T16:56:41.571 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] xfsfind 2023-05-21T16:56:41.842 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] fssum 2023-05-21T16:56:42.399 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2023-05-21T16:56:42.410 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] replay-log 2023-05-21T16:56:42.840 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-05-21T16:56:42.847 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2023-05-21T16:56:42.858 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-21T16:56:43.120 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-fcntl-race 2023-05-21T16:56:43.366 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-subblock-eof-read 2023-05-21T16:56:43.584 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-append-write-read-race 2023-05-21T16:56:43.849 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-invalidate-readahead 2023-05-21T16:56:44.097 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-hole-filling-race 2023-05-21T16:56:44.322 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-21T16:56:44.535 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-last-ref-held-by-io 2023-05-21T16:56:44.802 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-cycle-write 2023-05-21T16:56:44.971 INFO:teuthology.orchestra.run.smithi046.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-05-21T16:56:44.971 INFO:teuthology.orchestra.run.smithi046.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:44.971 INFO:teuthology.orchestra.run.smithi046.stderr: 83 | ftruncate(fd, buf_size); 2023-05-21T16:56:44.972 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:45.078 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-extend-stat 2023-05-21T16:56:45.329 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-21T16:56:45.534 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aiocp 2023-05-21T16:56:45.861 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-invalidate-failure 2023-05-21T16:56:46.105 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aiodio_sparse2 2023-05-21T16:56:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-05-21T16:56:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:46.271 INFO:teuthology.orchestra.run.smithi046.stderr: 111 | ftruncate(fd, filesize); 2023-05-21T16:56:46.271 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-05-21T16:56:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-05-21T16:56:46.272 INFO:teuthology.orchestra.run.smithi046.stderr: 274 | ftruncate(fd, size); 2023-05-21T16:56:46.272 INFO:teuthology.orchestra.run.smithi046.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-05-21T16:56:46.413 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-cow-race 2023-05-21T16:56:46.655 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-write-verify 2023-05-21T16:56:46.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:56:46.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:56:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] aio-dio-eof-race 2023-05-21T16:56:47.214 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2023-05-21T16:56:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] vfstest 2023-05-21T16:56:49.588 INFO:teuthology.orchestra.run.smithi046.stdout: [CC] mount-idmapped 2023-05-21T16:56:50.074 INFO:teuthology.orchestra.run.smithi046.stdout:Building m4 2023-05-21T16:56:50.082 INFO:teuthology.orchestra.run.smithi046.stdout:Building common 2023-05-21T16:56:50.087 INFO:teuthology.orchestra.run.smithi046.stdout:Building tests 2023-05-21T16:56:50.094 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-05-21T16:56:50.105 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/perf/group.list 2023-05-21T16:56:50.124 INFO:teuthology.orchestra.run.smithi046.stdout:Building ext4 2023-05-21T16:56:50.130 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/ext4/group.list 2023-05-21T16:56:50.202 INFO:teuthology.orchestra.run.smithi046.stdout:Building ocfs2 2023-05-21T16:56:50.214 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/ocfs2/group.list 2023-05-21T16:56:50.238 INFO:teuthology.orchestra.run.smithi046.stdout:Building overlay 2023-05-21T16:56:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/overlay/group.list 2023-05-21T16:56:50.319 INFO:teuthology.orchestra.run.smithi046.stdout:Building cifs 2023-05-21T16:56:50.328 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/cifs/group.list 2023-05-21T16:56:50.352 INFO:teuthology.orchestra.run.smithi046.stdout:Building generic 2023-05-21T16:56:50.365 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/generic/group.list 2023-05-21T16:56:50.529 INFO:teuthology.orchestra.run.smithi046.stdout:Building shared 2023-05-21T16:56:50.540 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/shared/group.list 2023-05-21T16:56:50.577 INFO:teuthology.orchestra.run.smithi046.stdout:Building xfs 2023-05-21T16:56:50.592 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/xfs/group.list 2023-05-21T16:56:50.789 INFO:teuthology.orchestra.run.smithi046.stdout:Building f2fs 2023-05-21T16:56:50.800 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/f2fs/group.list 2023-05-21T16:56:50.839 INFO:teuthology.orchestra.run.smithi046.stdout:Building udf 2023-05-21T16:56:50.849 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/udf/group.list 2023-05-21T16:56:50.874 INFO:teuthology.orchestra.run.smithi046.stdout:Building ceph 2023-05-21T16:56:50.884 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/ceph/group.list 2023-05-21T16:56:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:Building nfs 2023-05-21T16:56:50.927 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/nfs/group.list 2023-05-21T16:56:50.958 INFO:teuthology.orchestra.run.smithi046.stdout:Building btrfs 2023-05-21T16:56:50.971 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/btrfs/group.list 2023-05-21T16:56:51.085 INFO:teuthology.orchestra.run.smithi046.stdout:Building tmpfs 2023-05-21T16:56:51.097 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/tmpfs/group.list 2023-05-21T16:56:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:Building selftest 2023-05-21T16:56:51.136 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/selftest/group.list 2023-05-21T16:56:51.165 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo make install) 2023-05-21T16:56:51.208 INFO:teuthology.orchestra.run.smithi046.stdout:Building include 2023-05-21T16:56:51.216 INFO:teuthology.orchestra.run.smithi046.stdout:Building lib 2023-05-21T16:56:51.225 INFO:teuthology.orchestra.run.smithi046.stdout:Building ltp 2023-05-21T16:56:51.233 INFO:teuthology.orchestra.run.smithi046.stdout:Building src 2023-05-21T16:56:51.298 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2023-05-21T16:56:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-05-21T16:56:51.316 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2023-05-21T16:56:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2023-05-21T16:56:51.328 INFO:teuthology.orchestra.run.smithi046.stdout:Building m4 2023-05-21T16:56:51.336 INFO:teuthology.orchestra.run.smithi046.stdout:Building common 2023-05-21T16:56:51.342 INFO:teuthology.orchestra.run.smithi046.stdout:Building tests 2023-05-21T16:56:51.353 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-05-21T16:56:51.364 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/perf/group.list 2023-05-21T16:56:51.390 INFO:teuthology.orchestra.run.smithi046.stdout:Building ext4 2023-05-21T16:56:51.400 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/ext4/group.list 2023-05-21T16:56:51.481 INFO:teuthology.orchestra.run.smithi046.stdout:Building ocfs2 2023-05-21T16:56:51.493 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/ocfs2/group.list 2023-05-21T16:56:51.521 INFO:teuthology.orchestra.run.smithi046.stdout:Building overlay 2023-05-21T16:56:51.533 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/overlay/group.list 2023-05-21T16:56:51.612 INFO:teuthology.orchestra.run.smithi046.stdout:Building cifs 2023-05-21T16:56:51.624 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/cifs/group.list 2023-05-21T16:56:51.651 INFO:teuthology.orchestra.run.smithi046.stdout:Building generic 2023-05-21T16:56:51.665 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/generic/group.list 2023-05-21T16:56:51.859 INFO:teuthology.orchestra.run.smithi046.stdout:Building shared 2023-05-21T16:56:51.870 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/shared/group.list 2023-05-21T16:56:51.907 INFO:teuthology.orchestra.run.smithi046.stdout:Building xfs 2023-05-21T16:56:51.920 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/xfs/group.list 2023-05-21T16:56:52.122 INFO:teuthology.orchestra.run.smithi046.stdout:Building f2fs 2023-05-21T16:56:52.133 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/f2fs/group.list 2023-05-21T16:56:52.170 INFO:teuthology.orchestra.run.smithi046.stdout:Building udf 2023-05-21T16:56:52.181 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/udf/group.list 2023-05-21T16:56:52.206 INFO:teuthology.orchestra.run.smithi046.stdout:Building ceph 2023-05-21T16:56:52.217 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/ceph/group.list 2023-05-21T16:56:52.249 INFO:teuthology.orchestra.run.smithi046.stdout:Building nfs 2023-05-21T16:56:52.262 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/nfs/group.list 2023-05-21T16:56:52.292 INFO:teuthology.orchestra.run.smithi046.stdout:Building btrfs 2023-05-21T16:56:52.305 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/btrfs/group.list 2023-05-21T16:56:52.425 INFO:teuthology.orchestra.run.smithi046.stdout:Building tmpfs 2023-05-21T16:56:52.437 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/tmpfs/group.list 2023-05-21T16:56:52.465 INFO:teuthology.orchestra.run.smithi046.stdout:Building selftest 2023-05-21T16:56:52.476 INFO:teuthology.orchestra.run.smithi046.stdout: [GROUP] /tmp/tmp.wfxug4os5zxfstests-dev/tests/selftest/group.list 2023-05-21T16:56:52.504 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-05-21T16:56:52.507 INFO:teuthology.orchestra.run.smithi046.stdout:make[1]: Nothing to be done for 'install'. 2023-05-21T16:56:52.508 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-05-21T16:56:52.515 INFO:teuthology.orchestra.run.smithi046.stdout:make[1]: Nothing to be done for 'install'. 2023-05-21T16:56:52.515 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-05-21T16:56:52.522 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-21T16:56:52.541 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-21T16:56:52.715 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-21T16:56:52.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-05-21T16:56:52.771 INFO:teuthology.orchestra.run.smithi046.stdout:Building log-writes 2023-05-21T16:56:52.778 INFO:teuthology.orchestra.run.smithi046.stdout:Building perf 2023-05-21T16:56:52.785 INFO:teuthology.orchestra.run.smithi046.stdout:Building aio-dio-regress 2023-05-21T16:56:52.793 INFO:teuthology.orchestra.run.smithi046.stdout:Building vfs 2023-05-21T16:56:52.798 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make -C log-writes install 2023-05-21T16:56:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-21T16:56:52.821 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-21T16:56:52.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make -C perf install 2023-05-21T16:56:52.847 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-21T16:56:52.864 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-21T16:56:52.912 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make -C aio-dio-regress install 2023-05-21T16:56:52.919 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-21T16:56:52.939 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-05-21T16:56:53.048 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make -C vfs install 2023-05-21T16:56:53.054 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-21T16:56:53.072 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-21T16:56:53.100 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-21T16:56:53.120 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-21T16:56:55.941 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-21T16:56:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-21T16:56:56.207 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-05-21T16:56:56.213 INFO:teuthology.orchestra.run.smithi046.stdout:make[1]: Nothing to be done for 'install'. 2023-05-21T16:56:56.213 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-05-21T16:56:56.219 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-21T16:56:56.237 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-21T16:56:56.498 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-05-21T16:56:56.503 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/btrfs/ install 2023-05-21T16:56:56.511 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-21T16:56:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-21T16:56:58.120 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-21T16:56:58.140 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 016.out 064.out 186.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 082.out 252.out 270.out 148.out 088.out 137.out 002.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 221.out 087.out 212.out 112.out 012.out 107.out 162.out 147.out 196.out 145.out 004.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 171.out 261.out 156.out 092.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 099.out 010.out 001.out 138.out 237.out 097.out 153.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 242.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 096.out 193.out 283.out 083.out 247.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 041.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 038.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 130.out 023.out 044.out 073.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 174.out 045.out 281.out 090.out 224.out 181.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out /var/lib/xfstests/tests/btrfs 2023-05-21T16:56:59.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/ceph/ install 2023-05-21T16:56:59.742 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-21T16:56:59.762 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-21T16:56:59.802 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-21T16:56:59.823 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-05-21T16:56:59.865 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/cifs/ install 2023-05-21T16:56:59.870 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-21T16:56:59.891 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-21T16:56:59.910 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-21T16:56:59.930 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-21T16:56:59.951 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/ext4/ install 2023-05-21T16:56:59.956 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-21T16:56:59.976 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-21T16:57:00.357 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-21T16:57:00.378 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-05-21T16:57:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/f2fs/ install 2023-05-21T16:57:00.781 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-21T16:57:00.800 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-21T16:57:00.824 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-21T16:57:00.843 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-21T16:57:00.869 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/generic/ install 2023-05-21T16:57:00.878 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-21T16:57:00.897 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-21T16:57:04.912 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-21T16:57:04.934 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 047.out 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 472.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 645.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 555.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 167.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 377.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 663.out 599.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 703.out 619.out 727.out 685.out 562.out 419.out 570.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 447.out 460.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 375.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 181.out 676.out 271.out 149.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 444.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 640.out 483.out 096.out 393.out /var/lib/xfstests/tests/generic 2023-05-21T16:57:08.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/nfs/ install 2023-05-21T16:57:08.975 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-21T16:57:08.995 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-21T16:57:09.016 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-21T16:57:09.036 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-21T16:57:09.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/ocfs2/ install 2023-05-21T16:57:09.062 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-21T16:57:09.082 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-21T16:57:09.100 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-21T16:57:09.120 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-21T16:57:09.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/overlay/ install 2023-05-21T16:57:09.147 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-21T16:57:09.168 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-21T16:57:09.713 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-21T16:57:09.735 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-05-21T16:57:10.273 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/perf/ install 2023-05-21T16:57:10.277 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-21T16:57:10.297 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-21T16:57:10.315 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-21T16:57:10.334 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-21T16:57:10.354 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/selftest/ install 2023-05-21T16:57:10.359 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-21T16:57:10.380 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-21T16:57:10.427 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-21T16:57:10.448 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-05-21T16:57:10.494 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/shared/ install 2023-05-21T16:57:10.500 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-21T16:57:10.520 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-21T16:57:10.550 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-21T16:57:10.570 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-05-21T16:57:10.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/tmpfs/ install 2023-05-21T16:57:10.607 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-21T16:57:10.627 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-21T16:57:10.647 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-21T16:57:10.666 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-21T16:57:10.687 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/udf/ install 2023-05-21T16:57:10.693 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-21T16:57:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-21T16:57:10.732 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-21T16:57:10.752 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-21T16:57:10.773 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.wfxug4os5zxfstests-dev/tests/xfs/ install 2023-05-21T16:57:10.782 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-21T16:57:10.800 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-21T16:57:14.574 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-21T16:57:14.595 INFO:teuthology.orchestra.run.smithi046.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 216.out.64mblog 071.out.32 216.cfg 033.cfg 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 021.out 455.out 233.out 194.out 443.out 295.out 337.out 237.out 759.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 595.out 789.out 195.out 346.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 373.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 498.out 742.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 017.out 542.out 783.out 485.out 442.out 188.out 099.out 342.out 279.out 524.out 174.out 771.out 324.out 224.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 497.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 555.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 414.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 449.out 185.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 433.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 278.out 591.out 752.out 736.out 236.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 709.out 394.out 356.out 184.out 435.out 509.out 466.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 281.out 548.out 299.out 364.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 026.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 288.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 529.out 434.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 516.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 068.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 291.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 247.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 773.out 720.out 196.out 520.out 242.out 420.out 098.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 357.out 072.out 778.out 084.out 056.out 369.out 711.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 141.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 070.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out 146.out /var/lib/xfstests/tests/xfs 2023-05-21T16:57:16.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:57:16.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:57:18.427 INFO:teuthology.orchestra.run.smithi046.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-21T16:57:18.447 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-21T16:57:18.466 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-21T16:57:18.486 INFO:teuthology.orchestra.run.smithi046.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-21T16:57:18.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-21T16:57:18.512 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec ls tests/generic) 2023-05-21T16:57:18.528 INFO:teuthology.orchestra.run.smithi046.stdout:001 2023-05-21T16:57:18.528 INFO:teuthology.orchestra.run.smithi046.stdout:001.out 2023-05-21T16:57:18.528 INFO:teuthology.orchestra.run.smithi046.stdout:002 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:002.out 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:003 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:003.out 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:004 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:004.out 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:005 2023-05-21T16:57:18.529 INFO:teuthology.orchestra.run.smithi046.stdout:005.out 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:006 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:006.out 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:007 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:007.out 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:008 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:008.out 2023-05-21T16:57:18.530 INFO:teuthology.orchestra.run.smithi046.stdout:009 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:009.out 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:010 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:010.out 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:011 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:011.out 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:012 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:012.out 2023-05-21T16:57:18.531 INFO:teuthology.orchestra.run.smithi046.stdout:013 2023-05-21T16:57:18.532 INFO:teuthology.orchestra.run.smithi046.stdout:013.out 2023-05-21T16:57:18.532 INFO:teuthology.orchestra.run.smithi046.stdout:014 2023-05-21T16:57:18.532 INFO:teuthology.orchestra.run.smithi046.stdout:014.out 2023-05-21T16:57:18.532 INFO:teuthology.orchestra.run.smithi046.stdout:015 2023-05-21T16:57:18.532 INFO:teuthology.orchestra.run.smithi046.stdout:015.out 2023-05-21T16:57:18.532 INFO:teuthology.orchestra.run.smithi046.stdout:016 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:016.out 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:017 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:017.out 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:018 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:018.out 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:019 2023-05-21T16:57:18.533 INFO:teuthology.orchestra.run.smithi046.stdout:019.out 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:020 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:020.out 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:021 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:021.out 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:022 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:022.out 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:023 2023-05-21T16:57:18.534 INFO:teuthology.orchestra.run.smithi046.stdout:023.out 2023-05-21T16:57:18.535 INFO:teuthology.orchestra.run.smithi046.stdout:024 2023-05-21T16:57:18.535 INFO:teuthology.orchestra.run.smithi046.stdout:024.out 2023-05-21T16:57:18.535 INFO:teuthology.orchestra.run.smithi046.stdout:025 2023-05-21T16:57:18.535 INFO:teuthology.orchestra.run.smithi046.stdout:025.out 2023-05-21T16:57:18.535 INFO:teuthology.orchestra.run.smithi046.stdout:026 2023-05-21T16:57:18.535 INFO:teuthology.orchestra.run.smithi046.stdout:026.out 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:027 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:027.out 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:028 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:028.out 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:029 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:029.out 2023-05-21T16:57:18.536 INFO:teuthology.orchestra.run.smithi046.stdout:030 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:030.out 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:031 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:031.out 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:032 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:032.out 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:033 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:033.out 2023-05-21T16:57:18.537 INFO:teuthology.orchestra.run.smithi046.stdout:034 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:034.out 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:035 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:035.cfg 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:035.out.default 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:035.out.nfs 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:036 2023-05-21T16:57:18.538 INFO:teuthology.orchestra.run.smithi046.stdout:036.out 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:037 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:037.out 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:038 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:038.out 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:039 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:039.out 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:040 2023-05-21T16:57:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:040.out 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:041 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:041.out 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:042 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:042.out 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:043 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:043.out 2023-05-21T16:57:18.540 INFO:teuthology.orchestra.run.smithi046.stdout:044 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:044.out 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:045 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:045.out 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:046 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:046.out 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:047 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:047.out 2023-05-21T16:57:18.541 INFO:teuthology.orchestra.run.smithi046.stdout:048 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:048.out 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:049 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:049.out 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:050 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:050.cfg 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.default 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.nojournal 2023-05-21T16:57:18.542 INFO:teuthology.orchestra.run.smithi046.stdout:050.out.xfsquota 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:051 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:051.out 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:052 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:052.out 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:053 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:053.out 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:054 2023-05-21T16:57:18.543 INFO:teuthology.orchestra.run.smithi046.stdout:054.out 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:055 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:055.out 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:056 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:056.out 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:057 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:057.out 2023-05-21T16:57:18.544 INFO:teuthology.orchestra.run.smithi046.stdout:058 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:058.out 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:059 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:059.out 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:060 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:060.out 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:061 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:061.out 2023-05-21T16:57:18.545 INFO:teuthology.orchestra.run.smithi046.stdout:062 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:062.out 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:063 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:063.out 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:064 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:064.out 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:065 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:065.out 2023-05-21T16:57:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:066 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:066.out 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:067 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:067.out 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:068 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:068.out 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:069 2023-05-21T16:57:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:069.out 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:070 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:070.out 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:071 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:071.out 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:072 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:072.out 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:073 2023-05-21T16:57:18.548 INFO:teuthology.orchestra.run.smithi046.stdout:073.out 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:074 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:074.out 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:075 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:075.out 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:076 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:076.out 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:077 2023-05-21T16:57:18.549 INFO:teuthology.orchestra.run.smithi046.stdout:077.out 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:078 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:078.out 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:079 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:079.out 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:080 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:080.out 2023-05-21T16:57:18.550 INFO:teuthology.orchestra.run.smithi046.stdout:081 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:081.out 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:082 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:082.out 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:083 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:083.out 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:084 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:084.out 2023-05-21T16:57:18.551 INFO:teuthology.orchestra.run.smithi046.stdout:085 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:085.out 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:086 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:086.out 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:087 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:087.out 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:088 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:088.out 2023-05-21T16:57:18.552 INFO:teuthology.orchestra.run.smithi046.stdout:089 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:089.out 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:090 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:090.out 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:091 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:091.out 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:092 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:092.out 2023-05-21T16:57:18.553 INFO:teuthology.orchestra.run.smithi046.stdout:093 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:093.out 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:094 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:094.out 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:095 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:095.out 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:096 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:096.out 2023-05-21T16:57:18.554 INFO:teuthology.orchestra.run.smithi046.stdout:097 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:097.out 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:098 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:098.out 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:099 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:099.out 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:100 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:100.out 2023-05-21T16:57:18.555 INFO:teuthology.orchestra.run.smithi046.stdout:101 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:101.out 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:102 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:102.out 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:103 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:103.out 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:104 2023-05-21T16:57:18.556 INFO:teuthology.orchestra.run.smithi046.stdout:104.out 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:105 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:105.out 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:106 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:106.out 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:107 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:107.out 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:108 2023-05-21T16:57:18.557 INFO:teuthology.orchestra.run.smithi046.stdout:108.out 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:109 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:109.out 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:110 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:110.out 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:111 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:111.out 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:112 2023-05-21T16:57:18.558 INFO:teuthology.orchestra.run.smithi046.stdout:112.out 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:113 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:113.out 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:114 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:114.out 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:115 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:115.out 2023-05-21T16:57:18.559 INFO:teuthology.orchestra.run.smithi046.stdout:116 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:116.out 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:117 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:117.out 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:118 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:118.out 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:119 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:119.out 2023-05-21T16:57:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:120 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:120.out 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:121 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:121.out 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:122 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:122.out 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:123 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:123.out 2023-05-21T16:57:18.561 INFO:teuthology.orchestra.run.smithi046.stdout:124 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:124.out 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:125 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:125.out 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:126 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:126.out 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:127 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:127.out 2023-05-21T16:57:18.562 INFO:teuthology.orchestra.run.smithi046.stdout:128 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:128.out 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:129 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:129.out 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:130 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:130.out 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:131 2023-05-21T16:57:18.563 INFO:teuthology.orchestra.run.smithi046.stdout:131.out 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:132 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:132.out 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:133 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:133.out 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:134 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:134.out 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:135 2023-05-21T16:57:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:135.out 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:136 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:136.out 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:137 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:137.out 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:138 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:138.out 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:139 2023-05-21T16:57:18.565 INFO:teuthology.orchestra.run.smithi046.stdout:139.out 2023-05-21T16:57:18.566 INFO:teuthology.orchestra.run.smithi046.stdout:140 2023-05-21T16:57:18.566 INFO:teuthology.orchestra.run.smithi046.stdout:140.out 2023-05-21T16:57:18.566 INFO:teuthology.orchestra.run.smithi046.stdout:141 2023-05-21T16:57:18.566 INFO:teuthology.orchestra.run.smithi046.stdout:141.out 2023-05-21T16:57:18.566 INFO:teuthology.orchestra.run.smithi046.stdout:142 2023-05-21T16:57:18.566 INFO:teuthology.orchestra.run.smithi046.stdout:142.out 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:143 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:143.out 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:144 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:144.out 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:145 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:145.out 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:146 2023-05-21T16:57:18.567 INFO:teuthology.orchestra.run.smithi046.stdout:146.out 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:147 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:147.out 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:148 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:148.out 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:149 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:149.out 2023-05-21T16:57:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:150 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:150.out 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:151 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:151.out 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:152 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:152.out 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:153 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:153.out 2023-05-21T16:57:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:154 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:154.out 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:155 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:155.out 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:156 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:156.out 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:157 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:157.out 2023-05-21T16:57:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:158 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:158.out 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:159 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:159.out 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:160 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:160.out 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:161 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:161.out 2023-05-21T16:57:18.571 INFO:teuthology.orchestra.run.smithi046.stdout:162 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:162.out 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:163 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:163.out 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:164 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:164.out 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:165 2023-05-21T16:57:18.572 INFO:teuthology.orchestra.run.smithi046.stdout:165.out 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:166 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:166.out 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:167 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:167.out 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:168 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:168.out 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:169 2023-05-21T16:57:18.573 INFO:teuthology.orchestra.run.smithi046.stdout:169.out 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:170 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:170.out 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:171 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:171.out 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:172 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:172.out 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:173 2023-05-21T16:57:18.574 INFO:teuthology.orchestra.run.smithi046.stdout:173.out 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:174 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:174.out 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:175 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:175.out 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:176 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:176.out 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:177 2023-05-21T16:57:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:177.out 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:178 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:178.out 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:179 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:179.out 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:180 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:180.out 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:181 2023-05-21T16:57:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:181.out 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:182 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:182.out 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:183 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:183.out 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:184 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:184.out 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:185 2023-05-21T16:57:18.577 INFO:teuthology.orchestra.run.smithi046.stdout:185.out 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:186 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:186.out 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:187 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:187.out 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:188 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:188.out 2023-05-21T16:57:18.578 INFO:teuthology.orchestra.run.smithi046.stdout:189 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:189.out 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:190 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:190.out 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:191 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:191.out 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:192 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:192.out 2023-05-21T16:57:18.579 INFO:teuthology.orchestra.run.smithi046.stdout:193 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:193.out 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:194 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:194.out 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:195 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:195.out 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:196 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:196.out 2023-05-21T16:57:18.580 INFO:teuthology.orchestra.run.smithi046.stdout:197 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:197.out 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:198 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:198.out 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:199 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:199.out 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:200 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:200.out 2023-05-21T16:57:18.581 INFO:teuthology.orchestra.run.smithi046.stdout:201 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:201.out 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:202 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:202.out 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:203 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:203.out 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:204 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:204.out 2023-05-21T16:57:18.582 INFO:teuthology.orchestra.run.smithi046.stdout:205 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:205.out 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:206 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:206.out 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:207 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:207.out 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:208 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:208.out 2023-05-21T16:57:18.583 INFO:teuthology.orchestra.run.smithi046.stdout:209 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:209.out 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:210 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:210.out 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:211 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:211.out 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:212 2023-05-21T16:57:18.584 INFO:teuthology.orchestra.run.smithi046.stdout:212.out 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:213 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:213.out 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:214 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:214.out 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:215 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:215.out 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:216 2023-05-21T16:57:18.585 INFO:teuthology.orchestra.run.smithi046.stdout:216.out 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:217 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:217.out 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:218 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:218.out 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:219 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:219.out 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:220 2023-05-21T16:57:18.586 INFO:teuthology.orchestra.run.smithi046.stdout:220.out 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:221 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:221.out 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:222 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:222.out 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:223 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:223.out 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:224 2023-05-21T16:57:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:224.out 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:225 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:225.out 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:226 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:226.out 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:227 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:227.out 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:228 2023-05-21T16:57:18.588 INFO:teuthology.orchestra.run.smithi046.stdout:228.out 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:229 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:229.out 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:230 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:230.out 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:231 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:231.out 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:232 2023-05-21T16:57:18.589 INFO:teuthology.orchestra.run.smithi046.stdout:232.out 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:233 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:233.out 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:234 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:234.out 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:235 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:235.out 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:236 2023-05-21T16:57:18.590 INFO:teuthology.orchestra.run.smithi046.stdout:236.out 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:237 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:237.out 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:238 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:238.out 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:239 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:239.out 2023-05-21T16:57:18.591 INFO:teuthology.orchestra.run.smithi046.stdout:240 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:240.out 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:241 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:241.out 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:242 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:242.out 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:243 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:243.out 2023-05-21T16:57:18.592 INFO:teuthology.orchestra.run.smithi046.stdout:244 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:244.out 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:245 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:245.out 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:246 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:246.out 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:247 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:247.out 2023-05-21T16:57:18.593 INFO:teuthology.orchestra.run.smithi046.stdout:248 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:248.out 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:249 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:249.out 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:250 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:250.out 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:251 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:251.out 2023-05-21T16:57:18.594 INFO:teuthology.orchestra.run.smithi046.stdout:252 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:252.out 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:253 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:253.out 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:254 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:254.out 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:255 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:255.out 2023-05-21T16:57:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:256 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:256.out 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:257 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:257.out 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:258 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:258.out 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:259 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:259.out 2023-05-21T16:57:18.596 INFO:teuthology.orchestra.run.smithi046.stdout:260 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:260.out 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:261 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:261.out 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:262 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:262.out 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:263 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:263.out 2023-05-21T16:57:18.597 INFO:teuthology.orchestra.run.smithi046.stdout:264 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:264.out 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:265 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:265.out 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:266 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:266.out 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:267 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:267.out 2023-05-21T16:57:18.598 INFO:teuthology.orchestra.run.smithi046.stdout:268 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:268.out 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:269 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:269.out 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:270 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:270.out 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:271 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:271.out 2023-05-21T16:57:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:272 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:272.out 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:273 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:273.out 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:274 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:274.out 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:275 2023-05-21T16:57:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:275.out 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:276 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:276.out 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:277 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:277.out 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:278 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:278.out 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:279 2023-05-21T16:57:18.601 INFO:teuthology.orchestra.run.smithi046.stdout:279.out 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:280 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:280.out 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:281 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:281.out 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:282 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:282.out 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:283 2023-05-21T16:57:18.602 INFO:teuthology.orchestra.run.smithi046.stdout:283.out 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:284 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:284.out 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:285 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:285.out 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:286 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:286.out 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:287 2023-05-21T16:57:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:287.out 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:288 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:288.out 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:289 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:289.out 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:290 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:290.out 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:291 2023-05-21T16:57:18.604 INFO:teuthology.orchestra.run.smithi046.stdout:291.out 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:292 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:292.out 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:293 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:293.out 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:294 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:294.out 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:295 2023-05-21T16:57:18.605 INFO:teuthology.orchestra.run.smithi046.stdout:295.out 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:296 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:296.out 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:297 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:297.out 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:298 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:298.out 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:299 2023-05-21T16:57:18.606 INFO:teuthology.orchestra.run.smithi046.stdout:299.out 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:300 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:300.out 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:301 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:301.out 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:302 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:302.out 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:303 2023-05-21T16:57:18.607 INFO:teuthology.orchestra.run.smithi046.stdout:303.out 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:304 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:304.out 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:305 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:305.out 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:306 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:306.out 2023-05-21T16:57:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:307 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:307.out 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:308 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:308.out 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:309 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:309.out 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:310 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:310.out 2023-05-21T16:57:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:311 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:311.out 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:312 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:312.out 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:313 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:313.out 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:314 2023-05-21T16:57:18.610 INFO:teuthology.orchestra.run.smithi046.stdout:314.out 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:315 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:315.out 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:316 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:316.out 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:317 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:317.out 2023-05-21T16:57:18.611 INFO:teuthology.orchestra.run.smithi046.stdout:318 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:318.out 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:319 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:319.out 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:320 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:320.out 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:321 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:321.out 2023-05-21T16:57:18.612 INFO:teuthology.orchestra.run.smithi046.stdout:322 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:322.out 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:323 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:323.out 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:324 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:324.out 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:325 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:325.out 2023-05-21T16:57:18.613 INFO:teuthology.orchestra.run.smithi046.stdout:326 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:326.out 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:327 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:327.out 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:328 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:328.out 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:329 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:329.out 2023-05-21T16:57:18.614 INFO:teuthology.orchestra.run.smithi046.stdout:330 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:330.out 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:331 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:331.out 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:332 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:332.out 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:333 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:333.out 2023-05-21T16:57:18.615 INFO:teuthology.orchestra.run.smithi046.stdout:334 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:334.out 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:335 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:335.out 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:336 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:336.out 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:337 2023-05-21T16:57:18.616 INFO:teuthology.orchestra.run.smithi046.stdout:337.out 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:338 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:338.out 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:339 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:339.out 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:340 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:340.out 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:341 2023-05-21T16:57:18.617 INFO:teuthology.orchestra.run.smithi046.stdout:341.out 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:342 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:342.out 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:343 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:343.out 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:344 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:344.out 2023-05-21T16:57:18.618 INFO:teuthology.orchestra.run.smithi046.stdout:345 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:345.out 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:346 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:346.out 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:347 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:347.out 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:348 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:348.out 2023-05-21T16:57:18.619 INFO:teuthology.orchestra.run.smithi046.stdout:349 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:349.out 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:350 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:350.out 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:351 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:351.out 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:352 2023-05-21T16:57:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:352.out 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:353 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:353.out 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:354 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:354.out 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:355 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:355.out 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:356 2023-05-21T16:57:18.621 INFO:teuthology.orchestra.run.smithi046.stdout:356.out 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:357 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:357.out 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:358 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:358.out 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:359 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:359.out 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:360 2023-05-21T16:57:18.622 INFO:teuthology.orchestra.run.smithi046.stdout:360.out 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:361 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:361.out 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:362 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:362.out 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:363 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:363.out 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:364 2023-05-21T16:57:18.623 INFO:teuthology.orchestra.run.smithi046.stdout:364.out 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:365 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:365.out 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:366 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:366.out 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:367 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:367.out 2023-05-21T16:57:18.624 INFO:teuthology.orchestra.run.smithi046.stdout:368 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:368.out 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:369 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:369.out 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:370 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:370.out 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:371 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:371.out 2023-05-21T16:57:18.625 INFO:teuthology.orchestra.run.smithi046.stdout:372 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:372.out 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:373 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:373.out 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:374 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:374.out 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:375 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:375.out 2023-05-21T16:57:18.626 INFO:teuthology.orchestra.run.smithi046.stdout:376 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:376.out 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:377 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:377.out 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:378 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:378.out 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:379 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:379.out 2023-05-21T16:57:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:380 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:380.out 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:381 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:381.out 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:382 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:382.out 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:383 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:383.out 2023-05-21T16:57:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:384 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:384.out 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:385 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:385.out 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:386 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:386.out 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:387 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:387.out 2023-05-21T16:57:18.629 INFO:teuthology.orchestra.run.smithi046.stdout:388 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:388.out 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:389 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:389.out 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:390 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:390.out 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:391 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:391.out 2023-05-21T16:57:18.630 INFO:teuthology.orchestra.run.smithi046.stdout:392 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:392.out 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:393 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:393.out 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:394 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:394.out 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:395 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:395.out 2023-05-21T16:57:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:396 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:396.out 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:397 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:397.out 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:398 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:398.out 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:399 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:399.out 2023-05-21T16:57:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:400 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:400.out 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:401 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:401.out 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:402 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:402.out 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:403 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:403.out 2023-05-21T16:57:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:404 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:404.out 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:405 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:405.out 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:406 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:406.out 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:407 2023-05-21T16:57:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:407.out 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:408 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:408.out 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:409 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:409.out 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:410 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:410.out 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:411 2023-05-21T16:57:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:411.out 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:412 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:412.out 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:413 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:413.out 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:414 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:414.out 2023-05-21T16:57:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:415 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:415.out 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:416 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:416.out 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:417 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:417.out 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:418 2023-05-21T16:57:18.637 INFO:teuthology.orchestra.run.smithi046.stdout:418.out 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:419 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:419.out 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:420 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:420.out 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:421 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:421.out 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:422 2023-05-21T16:57:18.638 INFO:teuthology.orchestra.run.smithi046.stdout:422.out 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:423 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:423.out 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:424 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:424.out 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:425 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:425.out 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:426 2023-05-21T16:57:18.639 INFO:teuthology.orchestra.run.smithi046.stdout:426.out 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:427 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:427.out 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:428 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:428.out 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:429 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:429.out 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:430 2023-05-21T16:57:18.640 INFO:teuthology.orchestra.run.smithi046.stdout:430.out 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:431 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:431.out 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:432 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:432.out 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:433 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:433.out 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:434 2023-05-21T16:57:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:434.out 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:435 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:435.out 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:436 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:436.out 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:437 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:437.out 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:438 2023-05-21T16:57:18.642 INFO:teuthology.orchestra.run.smithi046.stdout:438.out 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:439 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:439.out 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:440 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:440.out 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:441 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:441.out 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:442 2023-05-21T16:57:18.643 INFO:teuthology.orchestra.run.smithi046.stdout:442.out 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:443 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:443.out 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:444 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:444.out 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:445 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:445.out 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:446 2023-05-21T16:57:18.644 INFO:teuthology.orchestra.run.smithi046.stdout:446.out 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:447 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:447.out 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:448 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:448.out 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:449 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:449.out 2023-05-21T16:57:18.645 INFO:teuthology.orchestra.run.smithi046.stdout:450 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:450.out 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:451 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:451.out 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:452 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:452.out 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:453 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:453.out 2023-05-21T16:57:18.646 INFO:teuthology.orchestra.run.smithi046.stdout:454 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:454.out 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:455 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:455.out 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:456 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:456.out 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:457 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:457.out 2023-05-21T16:57:18.647 INFO:teuthology.orchestra.run.smithi046.stdout:458 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:458.out 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:459 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:459.out 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:460 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:460.out 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:461 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:461.out 2023-05-21T16:57:18.648 INFO:teuthology.orchestra.run.smithi046.stdout:462 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:462.out 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:463 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:463.out 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:464 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:464.out 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:465 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:465.out 2023-05-21T16:57:18.649 INFO:teuthology.orchestra.run.smithi046.stdout:466 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:466.out 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:467 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:467.out 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:468 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:468.out 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:469 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:469.out 2023-05-21T16:57:18.650 INFO:teuthology.orchestra.run.smithi046.stdout:470 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:470.out 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:471 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:471.out 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:472 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:472.out 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:473 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:473.out 2023-05-21T16:57:18.651 INFO:teuthology.orchestra.run.smithi046.stdout:474 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:474.out 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:475 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:475.out 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:476 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:476.out 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:477 2023-05-21T16:57:18.652 INFO:teuthology.orchestra.run.smithi046.stdout:477.out 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:478 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:478.out 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:479 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:479.out 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:480 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:480.out 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:481 2023-05-21T16:57:18.653 INFO:teuthology.orchestra.run.smithi046.stdout:481.out 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:482 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:482.out 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:483 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:483.out 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:484 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:484.out 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:485 2023-05-21T16:57:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:485.out 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:486 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:486.out 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:487 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:487.out 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:488 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:488.out 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:489 2023-05-21T16:57:18.655 INFO:teuthology.orchestra.run.smithi046.stdout:489.out 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:490 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:490.out 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:491 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:491.out 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:492 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:492.out 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:493 2023-05-21T16:57:18.656 INFO:teuthology.orchestra.run.smithi046.stdout:493.out 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:494 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:494.out 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:495 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:495.out 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:496 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:496.out 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:497 2023-05-21T16:57:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:497.out 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:498 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:498.out 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:499 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:499.out 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:500 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:500.out 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:501 2023-05-21T16:57:18.658 INFO:teuthology.orchestra.run.smithi046.stdout:501.out 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:502 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:502.out 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:503 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:503.out 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:504 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:504.out 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:505 2023-05-21T16:57:18.659 INFO:teuthology.orchestra.run.smithi046.stdout:505.out 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:506 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:506.out 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:507 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:507.out 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:508 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:508.out 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:509 2023-05-21T16:57:18.660 INFO:teuthology.orchestra.run.smithi046.stdout:509.out 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:510 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:510.out 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:511 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:511.out 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:512 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:512.out 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:513 2023-05-21T16:57:18.661 INFO:teuthology.orchestra.run.smithi046.stdout:513.out 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:514 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:514.out 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:515 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:515.out 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:516 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:516.out 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:517 2023-05-21T16:57:18.662 INFO:teuthology.orchestra.run.smithi046.stdout:517.out 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:518 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:518.out 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:519 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:519.out 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:520 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:520.out 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:521 2023-05-21T16:57:18.663 INFO:teuthology.orchestra.run.smithi046.stdout:521.out 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:522 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:522.out 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:523 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:523.out 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:524 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:524.out 2023-05-21T16:57:18.664 INFO:teuthology.orchestra.run.smithi046.stdout:525 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:525.out 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:526 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:526.out 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:527 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:527.out 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:528 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:528.out 2023-05-21T16:57:18.665 INFO:teuthology.orchestra.run.smithi046.stdout:529 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:529.out 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:530 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:530.out 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:531 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:531.out 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:532 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:532.out 2023-05-21T16:57:18.666 INFO:teuthology.orchestra.run.smithi046.stdout:533 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:533.out 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:534 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:534.out 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:535 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:535.out 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:536 2023-05-21T16:57:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:536.out 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:537 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:537.out 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:538 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:538.out 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:539 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:539.out 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:540 2023-05-21T16:57:18.668 INFO:teuthology.orchestra.run.smithi046.stdout:540.out 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:541 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:541.out 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:542 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:542.out 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:543 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:543.out 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:544 2023-05-21T16:57:18.669 INFO:teuthology.orchestra.run.smithi046.stdout:544.out 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:545 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:545.out 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:546 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:546.out 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:547 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:547.out 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:548 2023-05-21T16:57:18.670 INFO:teuthology.orchestra.run.smithi046.stdout:548.out 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:549 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:549.out 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:550 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:550.out 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:551 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:551.out 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:552 2023-05-21T16:57:18.671 INFO:teuthology.orchestra.run.smithi046.stdout:552.out 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:553 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:553.out 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:554 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:554.out 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:555 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:555.out 2023-05-21T16:57:18.672 INFO:teuthology.orchestra.run.smithi046.stdout:556 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:556.out 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:557 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:557.out 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:558 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:558.out 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:559 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:559.out 2023-05-21T16:57:18.673 INFO:teuthology.orchestra.run.smithi046.stdout:560 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:560.out 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:561 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:561.out 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:562 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:562.out 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:563 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:563.out 2023-05-21T16:57:18.674 INFO:teuthology.orchestra.run.smithi046.stdout:564 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:564.out 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:565 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:565.out 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:566 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:566.out 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:567 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:567.out 2023-05-21T16:57:18.675 INFO:teuthology.orchestra.run.smithi046.stdout:568 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:568.out 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:569 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:569.out 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:570 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:570.out 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:571 2023-05-21T16:57:18.676 INFO:teuthology.orchestra.run.smithi046.stdout:571.out 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:572 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:572.out 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:573 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:573.out 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:574 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:574.out 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:575 2023-05-21T16:57:18.677 INFO:teuthology.orchestra.run.smithi046.stdout:575.out 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:576 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:576.out 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:577 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:577.out 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:578 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:578.out 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:579 2023-05-21T16:57:18.678 INFO:teuthology.orchestra.run.smithi046.stdout:579.out 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:580 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:580.out 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:581 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:581.out 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:582 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:582.out 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:583 2023-05-21T16:57:18.679 INFO:teuthology.orchestra.run.smithi046.stdout:583.out 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:584 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:584.out 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:585 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:585.out 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:586 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:586.out 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:587 2023-05-21T16:57:18.680 INFO:teuthology.orchestra.run.smithi046.stdout:587.out 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:588 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:588.out 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:589 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:589.out 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:590 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:590.out 2023-05-21T16:57:18.681 INFO:teuthology.orchestra.run.smithi046.stdout:591 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:591.out 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:592 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:592.out 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:593 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:593.out 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:594 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:594.out 2023-05-21T16:57:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:595 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:595.out 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:596 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:596.out 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:597 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:597.out 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:598 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:598.out 2023-05-21T16:57:18.683 INFO:teuthology.orchestra.run.smithi046.stdout:599 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:599.out 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:600 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:600.out 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:601 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:601.out 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:602 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:602.out 2023-05-21T16:57:18.684 INFO:teuthology.orchestra.run.smithi046.stdout:603 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:603.out 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:604 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:604.out 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:605 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:605.out 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:606 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:606.out 2023-05-21T16:57:18.685 INFO:teuthology.orchestra.run.smithi046.stdout:607 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:607.out 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:608 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:608.out 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:609 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:609.out 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:610 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:610.out 2023-05-21T16:57:18.686 INFO:teuthology.orchestra.run.smithi046.stdout:611 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:611.out 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:612 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:612.out 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:613 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:613.out 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:614 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:614.out 2023-05-21T16:57:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:615 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:615.out 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:616 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:616.out 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:617 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:617.out 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:618 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:618.out 2023-05-21T16:57:18.688 INFO:teuthology.orchestra.run.smithi046.stdout:619 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:619.out 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:620 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:620.out 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:621 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:621.out 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:622 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:622.out 2023-05-21T16:57:18.689 INFO:teuthology.orchestra.run.smithi046.stdout:623 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:623.out 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:624 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:624.out 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:625 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:625.out 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:626 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:626.out 2023-05-21T16:57:18.690 INFO:teuthology.orchestra.run.smithi046.stdout:627 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:627.out 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:628 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:628.out 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:629 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:629.out 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:630 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:630.out 2023-05-21T16:57:18.691 INFO:teuthology.orchestra.run.smithi046.stdout:631 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:631.out 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:632 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:632.out 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:633 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:633.out 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:634 2023-05-21T16:57:18.692 INFO:teuthology.orchestra.run.smithi046.stdout:634.out 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:635 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:635.out 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:636 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:636.out 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:637 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:637.out 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:638 2023-05-21T16:57:18.693 INFO:teuthology.orchestra.run.smithi046.stdout:638.out 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:639 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:639.out 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:640 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:640.out 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:641 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:641.out 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:642 2023-05-21T16:57:18.694 INFO:teuthology.orchestra.run.smithi046.stdout:642.out 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:643 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:643.out 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:644 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:644.out 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:645 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:645.out 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:646 2023-05-21T16:57:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:646.out 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:647 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:647.out 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:648 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:648.out 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:649 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:649.out 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:650 2023-05-21T16:57:18.696 INFO:teuthology.orchestra.run.smithi046.stdout:650.out 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:651 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:651.out 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:652 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:652.out 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:653 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:653.out 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:654 2023-05-21T16:57:18.697 INFO:teuthology.orchestra.run.smithi046.stdout:654.out 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:655 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:655.out 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:656 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:656.out 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:657 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:657.out 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:658 2023-05-21T16:57:18.698 INFO:teuthology.orchestra.run.smithi046.stdout:658.out 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:659 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:659.out 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:660 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:660.out 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:661 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:661.out 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:662 2023-05-21T16:57:18.699 INFO:teuthology.orchestra.run.smithi046.stdout:662.out 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:663 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:663.out 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:664 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:664.out 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:665 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:665.out 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:666 2023-05-21T16:57:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:666.out 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:667 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:667.out 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:668 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:668.out 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:669 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:669.out 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:670 2023-05-21T16:57:18.701 INFO:teuthology.orchestra.run.smithi046.stdout:670.out 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:671 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:671.out 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:672 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:672.out 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:673 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:673.out 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:674 2023-05-21T16:57:18.702 INFO:teuthology.orchestra.run.smithi046.stdout:674.out 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:675 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:675.out 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:676 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:676.out 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:677 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:677.out 2023-05-21T16:57:18.703 INFO:teuthology.orchestra.run.smithi046.stdout:678 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:678.out 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:679 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:679.out 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:680 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:680.out 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:681 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:681.out 2023-05-21T16:57:18.704 INFO:teuthology.orchestra.run.smithi046.stdout:682 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:682.out 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:683 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:683.out 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:684 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:684.out 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:685 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:685.out 2023-05-21T16:57:18.705 INFO:teuthology.orchestra.run.smithi046.stdout:686 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:686.out 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:687 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:687.out 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:688 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:688.out 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:689 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:689.out 2023-05-21T16:57:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:690 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:690.out 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:691 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:691.out 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:692 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:692.out 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:693 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:693.out 2023-05-21T16:57:18.707 INFO:teuthology.orchestra.run.smithi046.stdout:694 2023-05-21T16:57:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:694.out 2023-05-21T16:57:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:695 2023-05-21T16:57:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:695.out 2023-05-21T16:57:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:696 2023-05-21T16:57:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:696.out 2023-05-21T16:57:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:697 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:697.out 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:698 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:698.out 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:699 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:699.out 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:700 2023-05-21T16:57:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:700.out 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:701 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:701.out 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:702 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:702.out 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:703 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:703.out 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:704 2023-05-21T16:57:18.710 INFO:teuthology.orchestra.run.smithi046.stdout:704.out 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:705 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:705.out 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:706 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:706.out 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:707 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:707.out 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:708 2023-05-21T16:57:18.711 INFO:teuthology.orchestra.run.smithi046.stdout:708.out 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:709 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:709.out 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:710 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:710.out 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:711 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:711.out 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:712 2023-05-21T16:57:18.712 INFO:teuthology.orchestra.run.smithi046.stdout:712.out 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:713 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:713.out 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:714 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:714.out 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:715 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:715.out 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:716 2023-05-21T16:57:18.713 INFO:teuthology.orchestra.run.smithi046.stdout:716.out 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:717 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:717.out 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:718 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:718.out 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:719 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:719.out 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:720 2023-05-21T16:57:18.714 INFO:teuthology.orchestra.run.smithi046.stdout:720.out 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:721 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:721.out 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:722 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:722.out 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:723 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:723.out 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:724 2023-05-21T16:57:18.715 INFO:teuthology.orchestra.run.smithi046.stdout:724.out 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:725 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:725.out 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:726 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:726.out 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:727 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:727.out 2023-05-21T16:57:18.716 INFO:teuthology.orchestra.run.smithi046.stdout:group.list 2023-05-21T16:57:18.717 INFO:teuthology.orchestra.run.smithi046.stdout:Makefile 2023-05-21T16:57:18.717 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-21T16:57:19.016 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:57:19.024 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:57:19.024 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:23.424 INFO:teuthology.orchestra.run.smithi046.stdout:generic/001 4s 2023-05-21T16:57:23.434 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/001 2023-05-21T16:57:23.435 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T16:57:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:23.442 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45098]: fuse finished with error 0 and tester_r 0 2023-05-21T16:57:23.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T16:57:23.456 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-21T16:57:23.762 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:57:23.771 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:57:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:24.689 INFO:teuthology.orchestra.run.smithi046.stdout:generic/002 1s 2023-05-21T16:57:24.701 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/002 2023-05-21T16:57:24.702 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T16:57:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:24.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T16:57:24.722 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-21T16:57:25.027 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:57:25.036 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:57:25.036 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:25.297 INFO:teuthology.orchestra.run.smithi046.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T16:57:25.306 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/003 2023-05-21T16:57:25.306 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/003 2023-05-21T16:57:25.306 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T16:57:25.312 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:25.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T16:57:25.329 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-21T16:57:25.627 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:57:25.636 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:57:25.636 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:25.910 INFO:teuthology.orchestra.run.smithi046.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-21T16:57:25.919 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/004 2023-05-21T16:57:25.919 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/004 2023-05-21T16:57:25.920 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T16:57:25.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:25.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T16:57:25.944 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-21T16:57:26.259 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:57:26.269 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:57:26.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:27.366 INFO:teuthology.orchestra.run.smithi046.stdout:generic/005 1s 2023-05-21T16:57:27.378 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/005 2023-05-21T16:57:27.378 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T16:57:27.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:27.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T16:57:27.399 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-21T16:57:27.685 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:57:27.696 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:57:27.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:57:46.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:57:46.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:58:16.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:58:16.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:58:19.460 INFO:teuthology.orchestra.run.smithi046.stdout:generic/006 52s 2023-05-21T16:58:19.471 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/006 2023-05-21T16:58:19.471 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T16:58:19.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:58:19.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T16:58:19.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-21T16:58:19.819 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T16:58:19.828 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T16:58:19.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T16:58:47.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:58:47.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:59:17.171 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:59:17.173 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:59:47.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T16:59:47.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:00:11.089 INFO:teuthology.orchestra.run.smithi046.stdout:generic/007 112s 2023-05-21T17:00:11.111 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/007 2023-05-21T17:00:11.111 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:00:11.121 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:11.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:00:11.150 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-21T17:00:11.477 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:00:11.486 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:00:11.487 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:13.612 INFO:teuthology.orchestra.run.smithi046.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-21T17:00:13.621 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/008 2023-05-21T17:00:13.621 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/008 2023-05-21T17:00:13.621 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:00:13.627 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:13.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:00:13.643 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-21T17:00:13.951 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:00:13.960 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:00:13.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:15.865 INFO:teuthology.orchestra.run.smithi046.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-21T17:00:15.873 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/009 2023-05-21T17:00:15.873 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/009 2023-05-21T17:00:15.873 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:00:15.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:15.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:00:15.895 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-21T17:00:16.283 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:00:16.291 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:00:16.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:16.544 INFO:teuthology.orchestra.run.smithi046.stdout:generic/010 [not run] /tmp/tmp.wfxug4os5zxfstests-dev/src/dbtest not built 2023-05-21T17:00:16.553 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/010 2023-05-21T17:00:16.553 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/010 2023-05-21T17:00:16.554 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:00:16.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:16.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:00:16.578 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-21T17:00:16.900 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:00:16.909 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:00:16.909 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:00:17.329 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:00:17.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:00:47.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:00:47.382 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:01:09.020 INFO:teuthology.orchestra.run.smithi046.stdout:generic/011 53s 2023-05-21T17:01:09.032 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/011 2023-05-21T17:01:09.032 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:01:09.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:01:09.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:01:09.055 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-21T17:01:09.385 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:01:09.394 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:01:09.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:01:11.429 INFO:teuthology.orchestra.run.smithi046.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:01:11.456 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/012 2023-05-21T17:01:11.456 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/012 2023-05-21T17:01:11.456 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:01:11.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:01:11.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:01:11.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-21T17:01:11.807 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:01:11.816 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:01:11.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:01:17.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:01:17.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:01:47.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:01:47.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:02:17.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:02:17.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:02:48.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:02:48.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:02:53.056 INFO:teuthology.orchestra.run.smithi046.stdout:generic/013 102s 2023-05-21T17:02:53.076 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/013 2023-05-21T17:02:53.077 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:02:53.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:02:53.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:02:53.097 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-21T17:02:53.420 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:02:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:02:53.430 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:03:18.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:03:18.544 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:03:48.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:03:48.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:03:48.649 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T17:03:48.638+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 85094) UID: 0 2023-05-21T17:03:48.649 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T17:03:48.638+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 85094) UID: 0 2023-05-21T17:06:58.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:06:58.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:07:28.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:07:28.223 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:07:58.289 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:07:58.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:08:24.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/014 331s 2023-05-21T17:08:25.004 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/014 2023-05-21T17:08:25.004 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:25.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:25.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:25.038 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-21T17:08:25.389 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:25.399 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:25.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:25.665 INFO:teuthology.orchestra.run.smithi046.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:08:25.669 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/015 2023-05-21T17:08:25.670 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/015 2023-05-21T17:08:25.670 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:25.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:25.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:25.702 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-21T17:08:26.085 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:26.089 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:26.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:27.960 INFO:teuthology.orchestra.run.smithi046.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:08:27.967 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/016 2023-05-21T17:08:27.967 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/016 2023-05-21T17:08:27.967 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:27.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:28.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:28.151 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-21T17:08:28.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:08:28.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:08:28.732 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:28.744 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:28.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:29.002 INFO:teuthology.orchestra.run.smithi046.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:08:29.009 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/017 2023-05-21T17:08:29.009 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/017 2023-05-21T17:08:29.009 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:29.012 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:29.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:29.038 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-21T17:08:29.417 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:29.426 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:29.685 INFO:teuthology.orchestra.run.smithi046.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:08:29.692 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/018 2023-05-21T17:08:29.692 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/018 2023-05-21T17:08:29.692 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:29.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:29.710 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-21T17:08:30.096 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:30.105 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:30.383 INFO:teuthology.orchestra.run.smithi046.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:08:30.388 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/019 2023-05-21T17:08:30.388 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/019 2023-05-21T17:08:30.388 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:30.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:30.426 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-21T17:08:30.827 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:30.837 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:49.711 INFO:teuthology.orchestra.run.smithi046.stdout:generic/020 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/020.out.bad) 2023-05-21T17:08:49.714 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/020.out 2023-05-21 16:55:34.831775201 +0000 2023-05-21T17:08:49.714 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/020.out.bad 2023-05-21 17:08:49.696049546 +0000 2023-05-21T17:08:49.714 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -39,27 +39,6 @@ 2023-05-21T17:08:49.714 INFO:teuthology.orchestra.run.smithi046.stdout: user.snrub="fish2\012" 2023-05-21T17:08:49.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: *** add lots of attributes 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: -*** check 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: - *** MAX_ATTRS attribute(s) 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: -*** remove lots of attributes 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: - *** print attributes 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: -# file: 2023-05-21T17:08:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: -user.snrub="fish2\012" 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: - 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: -*** really long value 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: -0000000 00 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: -* 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: -ATTRSIZE 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: -*** set/get/remove really long names (expect failure) 2023-05-21T17:08:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: -attr_set: Invalid argument 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: -attr_get: Invalid argument 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: -attr_remove: Invalid argument 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: -*** check final 2023-05-21T17:08:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: - *** print attributes 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: -# file: 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: -user.snrub="fish2\012" 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: - 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: -*** delete 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: +attr_set: No space left on device 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: +Could not set "attribute_2335" for /tmp/tmp.g8r3hAr3OQtest/attribute_87537 2023-05-21T17:08:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: +!!! failed to add "attribute_2335" 2023-05-21T17:08:49.719 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/020 2023-05-21T17:08:49.719 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/020 2023-05-21T17:08:49.719 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T17:08:49.725 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:49.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T17:08:49.736 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T17:08:49.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T17:08:49.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-21T17:08:50.479 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:50.487 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:50.487 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:52.293 INFO:teuthology.orchestra.run.smithi046.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:08:52.310 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/021 2023-05-21T17:08:52.310 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/021 2023-05-21T17:08:52.311 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:52.316 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:52.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:52.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-21T17:08:53.017 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:53.026 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:53.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:54.855 INFO:teuthology.orchestra.run.smithi046.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:08:54.861 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/022 2023-05-21T17:08:54.862 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/022 2023-05-21T17:08:54.862 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:08:54.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:54.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:08:54.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-21T17:08:55.627 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:08:55.644 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:08:55.644 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:08:58.451 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:08:58.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:09:28.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:09:28.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:09:58.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:09:58.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:10:14.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/023 79s 2023-05-21T17:10:14.313 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/023 2023-05-21T17:10:14.313 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:14.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:14.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:14.425 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-05-21T17:10:14.960 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:15.009 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:15.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:15.265 INFO:teuthology.orchestra.run.smithi046.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-05-21T17:10:15.273 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/024 2023-05-21T17:10:15.273 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/024 2023-05-21T17:10:15.273 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:15.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:15.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:15.314 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-05-21T17:10:15.932 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:15.941 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:15.941 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:16.250 INFO:teuthology.orchestra.run.smithi046.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-05-21T17:10:16.258 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/025 2023-05-21T17:10:16.258 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/025 2023-05-21T17:10:16.258 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:16.263 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:16.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:16.281 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-05-21T17:10:16.892 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:16.902 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:16.902 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:17.246 INFO:teuthology.orchestra.run.smithi046.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T17:10:17.254 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/026 2023-05-21T17:10:17.255 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/026 2023-05-21T17:10:17.255 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:17.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:17.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:17.279 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-05-21T17:10:17.589 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:17.597 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:17.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:17.852 INFO:teuthology.orchestra.run.smithi046.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:17.860 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/027 2023-05-21T17:10:17.861 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/027 2023-05-21T17:10:17.861 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:17.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:17.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:17.885 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-05-21T17:10:18.202 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:18.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:23.497 INFO:teuthology.orchestra.run.smithi046.stdout:generic/028 5s 2023-05-21T17:10:23.509 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/028 2023-05-21T17:10:23.510 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:23.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:23.531 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-05-21T17:10:23.817 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:23.825 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:23.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:24.068 INFO:teuthology.orchestra.run.smithi046.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:24.088 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/029 2023-05-21T17:10:24.089 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/029 2023-05-21T17:10:24.089 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:24.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:24.101 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-05-21T17:10:24.419 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:24.428 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:24.681 INFO:teuthology.orchestra.run.smithi046.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:24.690 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/030 2023-05-21T17:10:24.691 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/030 2023-05-21T17:10:24.691 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:24.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:24.714 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-05-21T17:10:25.027 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:25.041 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:25.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:25.292 INFO:teuthology.orchestra.run.smithi046.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:25.301 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/031 2023-05-21T17:10:25.302 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/031 2023-05-21T17:10:25.302 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:25.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:25.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:25.324 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-05-21T17:10:25.640 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:25.651 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:25.910 INFO:teuthology.orchestra.run.smithi046.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:25.919 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/032 2023-05-21T17:10:25.919 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/032 2023-05-21T17:10:25.920 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:25.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:25.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:25.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-05-21T17:10:26.263 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:26.273 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:26.274 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:26.531 INFO:teuthology.orchestra.run.smithi046.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:26.539 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/033 2023-05-21T17:10:26.540 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/033 2023-05-21T17:10:26.540 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:26.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:26.563 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-05-21T17:10:26.879 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:26.888 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:26.889 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:27.177 INFO:teuthology.orchestra.run.smithi046.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:27.187 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/034 2023-05-21T17:10:27.187 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/034 2023-05-21T17:10:27.187 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:27.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:27.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:27.209 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-05-21T17:10:27.527 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:27.536 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:27.913 INFO:teuthology.orchestra.run.smithi046.stdout:generic/035 0s 2023-05-21T17:10:27.925 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/035 2023-05-21T17:10:27.925 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:27.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:27.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:27.964 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-05-21T17:10:28.586 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:28.594 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:28.636 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:28.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:10:28.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:10:39.058 INFO:teuthology.orchestra.run.smithi046.stdout:generic/036 11s 2023-05-21T17:10:39.068 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/036 2023-05-21T17:10:39.068 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:39.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:39.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:39.106 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-05-21T17:10:39.649 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:39.658 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:39.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:39.921 INFO:teuthology.orchestra.run.smithi046.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/037 2023-05-21T17:10:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/037 2023-05-21T17:10:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:39.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:39.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:39.953 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-05-21T17:10:40.256 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:40.265 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:40.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:40.530 INFO:teuthology.orchestra.run.smithi046.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:40.545 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/038 2023-05-21T17:10:40.545 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/038 2023-05-21T17:10:40.545 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:40.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:40.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:40.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-05-21T17:10:40.882 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:40.892 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:40.893 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:41.170 INFO:teuthology.orchestra.run.smithi046.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:41.178 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/039 2023-05-21T17:10:41.178 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/039 2023-05-21T17:10:41.178 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:41.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:41.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:41.202 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-05-21T17:10:41.515 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:41.523 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:41.523 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:41.811 INFO:teuthology.orchestra.run.smithi046.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:41.820 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/040 2023-05-21T17:10:41.821 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/040 2023-05-21T17:10:41.821 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:41.827 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:41.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:41.845 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-05-21T17:10:42.155 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:42.165 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:42.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:42.441 INFO:teuthology.orchestra.run.smithi046.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:42.450 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/041 2023-05-21T17:10:42.451 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/041 2023-05-21T17:10:42.451 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:42.457 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:42.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:42.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-05-21T17:10:42.785 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:42.795 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:42.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:43.049 INFO:teuthology.orchestra.run.smithi046.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/042 2023-05-21T17:10:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/042 2023-05-21T17:10:43.056 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:43.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:43.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:43.077 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-05-21T17:10:43.386 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:43.395 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:43.396 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:43.649 INFO:teuthology.orchestra.run.smithi046.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:43.657 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/043 2023-05-21T17:10:43.658 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/043 2023-05-21T17:10:43.658 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:43.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:43.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:43.682 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-05-21T17:10:44.002 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:44.048 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:44.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:44.271 INFO:teuthology.orchestra.run.smithi046.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:44.279 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/044 2023-05-21T17:10:44.279 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/044 2023-05-21T17:10:44.279 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:44.285 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:44.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:44.303 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-05-21T17:10:44.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:44.625 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:44.888 INFO:teuthology.orchestra.run.smithi046.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:44.897 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/045 2023-05-21T17:10:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/045 2023-05-21T17:10:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:44.904 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:44.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:44.921 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-05-21T17:10:45.241 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:45.250 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:45.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:45.504 INFO:teuthology.orchestra.run.smithi046.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:45.513 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/046 2023-05-21T17:10:45.513 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/046 2023-05-21T17:10:45.513 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:45.519 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:45.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:45.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-05-21T17:10:45.860 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:45.869 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:45.869 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:46.126 INFO:teuthology.orchestra.run.smithi046.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:46.134 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/047 2023-05-21T17:10:46.134 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/047 2023-05-21T17:10:46.134 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:46.140 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:46.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:46.156 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-05-21T17:10:46.467 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:46.476 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:46.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:46.731 INFO:teuthology.orchestra.run.smithi046.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:46.740 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/048 2023-05-21T17:10:46.740 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/048 2023-05-21T17:10:46.741 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:46.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:46.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:46.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-05-21T17:10:47.065 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:47.074 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:47.333 INFO:teuthology.orchestra.run.smithi046.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:47.357 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/049 2023-05-21T17:10:47.357 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/049 2023-05-21T17:10:47.357 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:47.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:47.364 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-05-21T17:10:47.673 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:47.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:47.949 INFO:teuthology.orchestra.run.smithi046.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:47.959 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/050 2023-05-21T17:10:47.959 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/050 2023-05-21T17:10:47.959 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:47.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:47.981 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-05-21T17:10:48.300 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:48.310 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:48.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:48.570 INFO:teuthology.orchestra.run.smithi046.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:48.579 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/051 2023-05-21T17:10:48.579 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/051 2023-05-21T17:10:48.579 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:48.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:48.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:48.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-05-21T17:10:48.930 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:48.940 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:48.941 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:49.199 INFO:teuthology.orchestra.run.smithi046.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/052 2023-05-21T17:10:49.208 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/052 2023-05-21T17:10:49.208 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:49.213 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:49.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:49.232 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-05-21T17:10:49.541 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:49.551 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:49.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:49.803 INFO:teuthology.orchestra.run.smithi046.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:49.815 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/053 2023-05-21T17:10:49.816 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/053 2023-05-21T17:10:49.816 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:49.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:49.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-05-21T17:10:50.141 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:50.150 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:50.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:50.407 INFO:teuthology.orchestra.run.smithi046.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:50.416 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/054 2023-05-21T17:10:50.416 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/054 2023-05-21T17:10:50.416 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:50.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:50.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:50.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-05-21T17:10:50.760 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:50.769 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:50.769 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:51.031 INFO:teuthology.orchestra.run.smithi046.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:51.040 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/055 2023-05-21T17:10:51.041 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/055 2023-05-21T17:10:51.041 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:51.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:51.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:51.064 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-05-21T17:10:51.384 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:51.393 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:51.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:51.677 INFO:teuthology.orchestra.run.smithi046.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:51.686 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/056 2023-05-21T17:10:51.686 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/056 2023-05-21T17:10:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:51.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:51.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:51.710 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-05-21T17:10:52.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:52.034 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:52.034 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:52.320 INFO:teuthology.orchestra.run.smithi046.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:52.329 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/057 2023-05-21T17:10:52.329 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/057 2023-05-21T17:10:52.329 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:52.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:52.352 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-05-21T17:10:52.664 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:52.673 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:52.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:54.739 INFO:teuthology.orchestra.run.smithi046.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:10:54.748 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/058 2023-05-21T17:10:54.748 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/058 2023-05-21T17:10:54.749 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:54.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:54.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:54.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-05-21T17:10:55.403 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:55.412 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:55.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:55.675 INFO:teuthology.orchestra.run.smithi046.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:10:55.685 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/059 2023-05-21T17:10:55.685 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/059 2023-05-21T17:10:55.685 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:55.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:55.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:55.711 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-05-21T17:10:56.020 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:56.029 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:56.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:57.991 INFO:teuthology.orchestra.run.smithi046.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:10:58.000 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/060 2023-05-21T17:10:58.000 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/060 2023-05-21T17:10:58.000 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:10:58.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:58.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:10:58.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-05-21T17:10:58.626 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:10:58.633 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:10:58.634 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:10:58.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:10:58.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:11:00.649 INFO:teuthology.orchestra.run.smithi046.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:11:00.658 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/061 2023-05-21T17:11:00.658 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/061 2023-05-21T17:11:00.658 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:00.664 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:00.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:00.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-05-21T17:11:01.309 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:01.319 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:01.319 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:01.585 INFO:teuthology.orchestra.run.smithi046.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:01.594 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/062 2023-05-21T17:11:01.594 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/062 2023-05-21T17:11:01.594 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:01.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:01.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:01.613 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-05-21T17:11:01.908 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:01.917 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:01.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:03.914 INFO:teuthology.orchestra.run.smithi046.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T17:11:03.923 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/063 2023-05-21T17:11:03.923 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/063 2023-05-21T17:11:03.923 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:03.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:03.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:03.948 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-05-21T17:11:04.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:04.587 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:04.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:04.830 INFO:teuthology.orchestra.run.smithi046.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:04.838 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/064 2023-05-21T17:11:04.838 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/064 2023-05-21T17:11:04.838 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:04.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:04.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:04.861 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-05-21T17:11:05.176 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:05.185 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:05.185 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:05.459 INFO:teuthology.orchestra.run.smithi046.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/065 2023-05-21T17:11:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/065 2023-05-21T17:11:05.467 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:05.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:05.487 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-05-21T17:11:05.804 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:05.813 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:05.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:06.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/066 2023-05-21T17:11:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/066 2023-05-21T17:11:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:06.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:06.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:06.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-05-21T17:11:06.457 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:06.467 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:06.467 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:06.774 INFO:teuthology.orchestra.run.smithi046.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:06.782 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/067 2023-05-21T17:11:06.783 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/067 2023-05-21T17:11:06.783 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:06.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:06.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:06.807 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-05-21T17:11:07.115 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:07.124 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:07.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:07.404 INFO:teuthology.orchestra.run.smithi046.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:07.412 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/068 2023-05-21T17:11:07.413 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/068 2023-05-21T17:11:07.413 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:07.418 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:07.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:07.436 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-05-21T17:11:07.747 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:07.757 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:07.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:08.014 INFO:teuthology.orchestra.run.smithi046.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:11:08.049 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/069 2023-05-21T17:11:08.049 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/069 2023-05-21T17:11:08.049 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:11:08.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:08.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:11:08.050 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-05-21T17:11:08.373 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:11:08.384 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:11:08.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:11:28.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:11:28.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:11:58.971 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:11:59.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:12:29.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:12:29.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:12:43.495 INFO:teuthology.orchestra.run.smithi046.stdout:generic/070 95s 2023-05-21T17:12:43.512 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/070 2023-05-21T17:12:43.512 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:12:43.520 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:43.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:12:43.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-05-21T17:12:44.270 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:12:44.278 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:12:44.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:44.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:12:44.547 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/071 2023-05-21T17:12:44.548 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/071 2023-05-21T17:12:44.549 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:12:44.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:44.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:12:44.568 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-05-21T17:12:44.945 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:12:44.957 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:12:44.957 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:46.681 INFO:teuthology.orchestra.run.smithi046.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-21T17:12:46.688 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/072 2023-05-21T17:12:46.689 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/072 2023-05-21T17:12:46.689 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:12:46.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:46.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:12:46.715 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-05-21T17:12:47.131 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:12:47.137 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:12:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:47.426 INFO:teuthology.orchestra.run.smithi046.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:12:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/073 2023-05-21T17:12:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/073 2023-05-21T17:12:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:12:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:47.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:12:47.490 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-05-21T17:12:47.869 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:12:47.879 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:12:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:12:59.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:12:59.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:13:29.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:13:29.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:13:59.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:13:59.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:14:29.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:14:29.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:14:59.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:14:59.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:15:29.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:15:29.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:16:00.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:16:00.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:16:30.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:16:30.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:17:00.828 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:17:00.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:17:30.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:17:30.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:18:00.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:18:00.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:18:31.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:18:31.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:19:01.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:19:01.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:19:31.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:19:31.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:20:01.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:20:01.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:20:31.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:20:31.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:21:02.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:21:02.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:21:32.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:21:32.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:22:02.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:22:02.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:22:33.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:22:33.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:23:03.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:23:03.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:23:33.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:23:33.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:24:04.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:24:04.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:24:34.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:24:34.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:25:04.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:25:04.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:25:34.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:25:34.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:26:05.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:26:05.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:26:35.626 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:26:35.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:27:06.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:27:06.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:27:37.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:27:37.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:28:07.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:28:07.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:28:37.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:28:37.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:29:07.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:29:07.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:29:38.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:29:38.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:30:08.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:30:08.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:30:38.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:30:38.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:31:09.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:31:09.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:31:39.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:31:39.479 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:32:09.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:32:09.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:32:39.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:32:39.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:33:09.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:33:09.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:33:39.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:33:39.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:34:09.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:34:09.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:34:40.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:34:40.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:35:10.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:35:10.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:35:40.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:35:40.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:36:10.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:36:10.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:36:40.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:36:40.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:37:10.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:37:10.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:37:40.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:37:40.901 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:38:10.987 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:38:10.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:38:41.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:38:41.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:39:11.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:39:11.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:39:41.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:39:41.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:40:11.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:40:11.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:40:41.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:40:41.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:40:41.378 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T17:40:41.360+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41208) UID: 0 2023-05-21T17:40:41.379 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T17:40:41.360+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41208) UID: 0 2023-05-21T17:40:41.379 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T17:40:41.360+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41208) UID: 0 2023-05-21T17:40:41.379 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T17:40:41.360+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41208) UID: 0 2023-05-21T17:42:27.286 INFO:teuthology.orchestra.run.smithi046.stdout:generic/074 1780s 2023-05-21T17:42:27.371 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/074 2023-05-21T17:42:27.372 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:42:27.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:42:27.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:42:27.397 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-05-21T17:42:28.594 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:42:28.604 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:42:28.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:14.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:43:14.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:43:43.458 INFO:teuthology.orchestra.run.smithi046.stdout:generic/075 75s 2023-05-21T17:43:43.470 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/075 2023-05-21T17:43:43.470 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:43.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:43.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:43.493 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-05-21T17:43:44.164 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:44.173 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:44.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:44.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:43:44.209 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:43:44.429 INFO:teuthology.orchestra.run.smithi046.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:44.438 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/076 2023-05-21T17:43:44.438 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/076 2023-05-21T17:43:44.438 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:44.444 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:44.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:44.461 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-05-21T17:43:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:44.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:46.042 INFO:teuthology.orchestra.run.smithi046.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:46.050 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/077 2023-05-21T17:43:46.051 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/077 2023-05-21T17:43:46.051 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:46.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:46.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:46.074 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-05-21T17:43:46.390 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:46.399 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:46.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:46.727 INFO:teuthology.orchestra.run.smithi046.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-05-21T17:43:46.735 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/078 2023-05-21T17:43:46.735 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/078 2023-05-21T17:43:46.735 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:46.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:46.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:46.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-05-21T17:43:47.460 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:47.468 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:47.860 INFO:teuthology.orchestra.run.smithi046.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-05-21T17:43:47.869 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/079 2023-05-21T17:43:47.869 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/079 2023-05-21T17:43:47.869 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:47.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:47.894 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-05-21T17:43:48.222 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:48.232 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:50.621 INFO:teuthology.orchestra.run.smithi046.stdout:generic/080 2s 2023-05-21T17:43:50.634 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/080 2023-05-21T17:43:50.634 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:50.640 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:50.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:50.659 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-05-21T17:43:50.969 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:50.977 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:50.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:51.245 INFO:teuthology.orchestra.run.smithi046.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:51.254 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/081 2023-05-21T17:43:51.254 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/081 2023-05-21T17:43:51.254 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:51.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:51.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:51.277 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-05-21T17:43:51.594 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:51.604 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:51.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:51.874 INFO:teuthology.orchestra.run.smithi046.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:51.882 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/082 2023-05-21T17:43:51.883 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/082 2023-05-21T17:43:51.883 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:51.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:51.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:51.906 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-05-21T17:43:52.228 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:52.237 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:52.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:52.495 INFO:teuthology.orchestra.run.smithi046.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:52.503 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/083 2023-05-21T17:43:52.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/083 2023-05-21T17:43:52.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:52.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:52.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:52.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-05-21T17:43:52.853 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:52.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:52.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:53.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:53.128 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/084 2023-05-21T17:43:53.128 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/084 2023-05-21T17:43:53.129 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:53.134 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:53.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:53.153 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-05-21T17:43:53.473 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:53.481 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:53.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:53.796 INFO:teuthology.orchestra.run.smithi046.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T17:43:53.806 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/085 2023-05-21T17:43:53.806 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/085 2023-05-21T17:43:53.806 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:53.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:53.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:53.831 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-05-21T17:43:54.143 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:43:54.152 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:43:54.152 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:58.808 INFO:teuthology.orchestra.run.smithi046.stdout:generic/086 4s 2023-05-21T17:43:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/086 2023-05-21T17:43:58.906 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:43:58.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:43:58.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:43:58.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-05-21T17:44:00.571 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:44:00.580 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:44:00.580 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:44:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:generic/087 1s 2023-05-21T17:44:01.285 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/087 2023-05-21T17:44:01.285 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:44:01.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:44:01.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:44:01.308 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-05-21T17:44:02.008 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:44:02.017 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:44:02.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:44:02.373 INFO:teuthology.orchestra.run.smithi046.stdout:generic/088 0s 2023-05-21T17:44:02.388 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/088 2023-05-21T17:44:02.388 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T17:44:02.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:44:02.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T17:44:02.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-05-21T17:44:03.071 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T17:44:03.079 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T17:44:03.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T17:44:14.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:44:14.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:44:44.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:44:44.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:44:44.727 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T17:44:44.709+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124902) UID: 0 2023-05-21T17:44:44.727 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T17:44:44.709+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124902) UID: 0 2023-05-21T17:44:44.728 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T17:44:44.709+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124902) UID: 0 2023-05-21T17:44:44.728 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T17:44:44.709+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124902) UID: 0 2023-05-21T17:48:35.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:48:35.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:48:35.190 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T17:48:35.175+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124918) UID: 0 2023-05-21T17:48:35.191 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T17:48:35.175+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 124918) UID: 0 2023-05-21T17:51:45.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:51:45.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:52:16.520 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:52:16.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:52:46.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:52:46.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:53:16.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:53:16.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:53:47.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:53:47.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:54:17.401 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:54:17.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:54:17.446 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T17:54:17.425+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 125156) UID: 0 2023-05-21T17:54:17.446 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T17:54:17.425+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 125156) UID: 0 2023-05-21T17:56:59.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:56:59.350 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:57:29.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:57:29.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:57:59.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:57:59.927 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:58:29.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:58:29.999 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:59:00.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:59:00.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:59:30.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T17:59:30.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:00:00.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:00:00.930 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:00:00.945 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T18:00:00.925+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127195) UID: 0 2023-05-21T18:00:00.946 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T18:00:00.925+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127195) UID: 0 2023-05-21T18:02:37.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:02:37.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:03:07.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:03:07.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:03:37.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:03:37.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:04:07.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:04:07.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:04:38.074 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:04:38.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:05:08.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:05:08.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:05:38.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:05:38.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:06:08.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:06:08.628 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:06:08.646 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T18:06:08.622+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127227) UID: 0 2023-05-21T18:06:08.646 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T18:06:08.622+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127227) UID: 0 2023-05-21T18:07:05.531 INFO:teuthology.orchestra.run.smithi046.stdout:generic/089 1382s 2023-05-21T18:07:05.633 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/089 2023-05-21T18:07:05.634 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:07:05.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:07:05.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:07:05.717 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-05-21T18:07:06.915 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:07:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:07:06.923 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:07:07.253 INFO:teuthology.orchestra.run.smithi046.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:07:07.260 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/090 2023-05-21T18:07:07.260 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/090 2023-05-21T18:07:07.260 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:07:07.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:07:07.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:07:07.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-05-21T18:07:07.539 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:07:07.545 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:07:07.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:08:40.486 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:08:40.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:09:10.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:09:10.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:09:40.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:09:40.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:10:10.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:10:10.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:10:41.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:10:41.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:11:05.542 INFO:teuthology.orchestra.run.smithi046.stdout:generic/091 238s 2023-05-21T18:11:05.555 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/091 2023-05-21T18:11:05.555 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:05.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:05.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:05.657 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-05-21T18:11:06.259 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:06.266 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:06.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:07.234 INFO:teuthology.orchestra.run.smithi046.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T18:11:07.243 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/092 2023-05-21T18:11:07.243 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/092 2023-05-21T18:11:07.243 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:07.249 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:07.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:07.268 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-05-21T18:11:07.921 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:07.929 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:07.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:08.963 INFO:teuthology.orchestra.run.smithi046.stdout:generic/093 1s 2023-05-21T18:11:08.976 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/093 2023-05-21T18:11:08.976 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:08.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:08.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:08.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-05-21T18:11:09.664 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:09.674 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:09.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:09.950 INFO:teuthology.orchestra.run.smithi046.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:11:09.959 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/094 2023-05-21T18:11:09.959 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/094 2023-05-21T18:11:09.959 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:09.965 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:09.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:09.983 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-05-21T18:11:10.297 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:10.306 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:10.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:10.561 INFO:teuthology.orchestra.run.smithi046.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:11:10.570 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/095 2023-05-21T18:11:10.570 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/095 2023-05-21T18:11:10.570 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:10.575 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:10.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:10.594 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-05-21T18:11:10.932 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:10.942 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:11.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:11:11.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:11:11.200 INFO:teuthology.orchestra.run.smithi046.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:11:11.208 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/096 2023-05-21T18:11:11.208 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/096 2023-05-21T18:11:11.208 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:11.213 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:11.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:11.230 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-05-21T18:11:11.560 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:11.570 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:11.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:12.493 INFO:teuthology.orchestra.run.smithi046.stdout:generic/097 1s 2023-05-21T18:11:12.501 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/097 2023-05-21T18:11:12.502 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:12.505 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:12.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:12.520 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-05-21T18:11:12.842 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:12.851 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:12.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:13.110 INFO:teuthology.orchestra.run.smithi046.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:11:13.118 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/098 2023-05-21T18:11:13.118 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/098 2023-05-21T18:11:13.118 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:13.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:13.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:13.143 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-05-21T18:11:13.466 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:13.476 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:13.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:13.837 INFO:teuthology.orchestra.run.smithi046.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T18:11:13.845 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/099 2023-05-21T18:11:13.845 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/099 2023-05-21T18:11:13.845 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:11:13.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:13.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:11:13.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-05-21T18:11:14.197 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:11:14.206 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:11:14.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:11:41.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:11:41.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:11:41.300 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T18:11:41.285+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41339) UID: 0 2023-05-21T18:11:41.301 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T18:11:41.285+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41339) UID: 0 2023-05-21T18:11:41.301 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T18:11:41.285+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41339) UID: 0 2023-05-21T18:11:41.301 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T18:11:41.285+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41339) UID: 0 2023-05-21T18:12:07.934 INFO:teuthology.orchestra.run.smithi046.stdout:generic/100 53s 2023-05-21T18:12:07.948 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/100 2023-05-21T18:12:07.948 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:07.954 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:07.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:07.976 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-05-21T18:12:08.638 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:08.645 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:08.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:08.972 INFO:teuthology.orchestra.run.smithi046.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:08.981 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/101 2023-05-21T18:12:08.982 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/101 2023-05-21T18:12:08.982 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:08.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:09.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:09.006 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-05-21T18:12:09.320 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:09.329 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:09.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:09.594 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/102 2023-05-21T18:12:09.595 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/102 2023-05-21T18:12:09.595 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:09.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:09.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:09.612 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-05-21T18:12:09.939 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:09.949 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:09.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:10.204 INFO:teuthology.orchestra.run.smithi046.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:10.213 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/103 2023-05-21T18:12:10.213 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/103 2023-05-21T18:12:10.213 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:10.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:10.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:10.236 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-05-21T18:12:10.559 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:10.569 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:10.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:10.854 INFO:teuthology.orchestra.run.smithi046.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:10.862 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/104 2023-05-21T18:12:10.862 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/104 2023-05-21T18:12:10.863 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:10.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:10.886 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-05-21T18:12:11.193 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:11.202 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:11.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:11.529 INFO:teuthology.orchestra.run.smithi046.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:11.538 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/105 2023-05-21T18:12:11.538 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/105 2023-05-21T18:12:11.538 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:11.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:11.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:11.564 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-05-21T18:12:11.873 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:11.883 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:11.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:12.225 INFO:teuthology.orchestra.run.smithi046.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:12.233 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/106 2023-05-21T18:12:12.233 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/106 2023-05-21T18:12:12.233 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:12.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:12.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:12.257 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-05-21T18:12:12.574 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:12.583 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:12.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:12.930 INFO:teuthology.orchestra.run.smithi046.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:12.939 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/107 2023-05-21T18:12:12.939 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/107 2023-05-21T18:12:12.939 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:12.945 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:12.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:12.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-05-21T18:12:13.290 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:13.300 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:13.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:13.790 INFO:teuthology.orchestra.run.smithi046.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:13.799 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/108 2023-05-21T18:12:13.799 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/108 2023-05-21T18:12:13.800 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:13.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:13.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:13.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-05-21T18:12:14.150 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:14.160 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:14.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:14.418 INFO:teuthology.orchestra.run.smithi046.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:12:14.427 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/109 2023-05-21T18:12:14.427 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/109 2023-05-21T18:12:14.427 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:14.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:14.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:14.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-05-21T18:12:14.770 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:14.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:15.156 INFO:teuthology.orchestra.run.smithi046.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:12:15.165 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/110 2023-05-21T18:12:15.165 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/110 2023-05-21T18:12:15.165 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:15.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:15.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:15.188 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-05-21T18:12:15.890 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:15.899 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:15.899 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:16.257 INFO:teuthology.orchestra.run.smithi046.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:12:16.265 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/111 2023-05-21T18:12:16.265 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/111 2023-05-21T18:12:16.265 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:12:16.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:12:16.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:12:16.290 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-05-21T18:12:16.950 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:12:16.960 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:12:16.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:13:35.631 INFO:teuthology.orchestra.run.smithi046.stdout:generic/112 79s 2023-05-21T18:13:35.645 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/112 2023-05-21T18:13:35.645 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:13:35.652 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:13:35.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:13:35.673 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-05-21T18:13:36.362 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:13:36.371 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:13:36.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:13:55.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:13:55.005 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:14:25.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:14:25.200 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:14:25.311 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T18:14:25.297+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154200) UID: 0 2023-05-21T18:14:25.311 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T18:14:25.297+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154200) UID: 0 2023-05-21T18:14:25.312 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T18:14:25.297+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154200) UID: 0 2023-05-21T18:14:25.312 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T18:14:25.297+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154200) UID: 0 2023-05-21T18:14:29.439 INFO:teuthology.orchestra.run.smithi046.stdout:generic/113 53s 2023-05-21T18:14:29.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/113 2023-05-21T18:14:29.450 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:29.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:29.469 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-05-21T18:14:30.189 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:30.196 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:30.576 INFO:teuthology.orchestra.run.smithi046.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-05-21T18:14:30.583 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/114 2023-05-21T18:14:30.583 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/114 2023-05-21T18:14:30.584 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:30.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:30.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-05-21T18:14:30.883 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:30.891 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:31.202 INFO:teuthology.orchestra.run.smithi046.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:14:31.209 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/115 2023-05-21T18:14:31.209 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/115 2023-05-21T18:14:31.209 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:31.213 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:31.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:31.229 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-05-21T18:14:31.908 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:31.914 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:31.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:32.225 INFO:teuthology.orchestra.run.smithi046.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:14:32.232 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/116 2023-05-21T18:14:32.232 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/116 2023-05-21T18:14:32.232 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:32.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:32.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:32.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-05-21T18:14:32.907 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:32.913 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:32.913 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:33.138 INFO:teuthology.orchestra.run.smithi046.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:14:33.143 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/117 2023-05-21T18:14:33.144 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/117 2023-05-21T18:14:33.144 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:33.148 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:33.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:33.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-05-21T18:14:33.437 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:33.444 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:33.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:33.750 INFO:teuthology.orchestra.run.smithi046.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:14:33.756 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/118 2023-05-21T18:14:33.756 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/118 2023-05-21T18:14:33.756 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:33.760 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:33.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:33.775 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-05-21T18:14:34.447 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:34.454 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:34.454 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:34.762 INFO:teuthology.orchestra.run.smithi046.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:14:34.768 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/119 2023-05-21T18:14:34.768 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/119 2023-05-21T18:14:34.768 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:34.772 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:34.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:34.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-05-21T18:14:35.501 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:35.509 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:35.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:35.736 INFO:teuthology.orchestra.run.smithi046.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:14:35.744 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/120 2023-05-21T18:14:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/120 2023-05-21T18:14:35.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:35.749 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:35.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:35.765 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-05-21T18:14:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:36.031 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:36.031 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:36.350 INFO:teuthology.orchestra.run.smithi046.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T18:14:36.356 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/121 2023-05-21T18:14:36.357 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/121 2023-05-21T18:14:36.357 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:36.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:36.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:36.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-05-21T18:14:37.070 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:37.075 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:37.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:37.392 INFO:teuthology.orchestra.run.smithi046.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T18:14:37.398 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/122 2023-05-21T18:14:37.398 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/122 2023-05-21T18:14:37.398 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:37.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:37.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:37.419 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-05-21T18:14:38.105 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:38.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:38.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:38.711 INFO:teuthology.orchestra.run.smithi046.stdout:generic/123 0s 2023-05-21T18:14:38.718 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/123 2023-05-21T18:14:38.719 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:38.722 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:38.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:38.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-05-21T18:14:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:39.413 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:39.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:39.637 INFO:teuthology.orchestra.run.smithi046.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:14:39.645 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/124 2023-05-21T18:14:39.645 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/124 2023-05-21T18:14:39.645 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:14:39.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:14:39.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:14:39.666 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-05-21T18:14:39.942 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:14:39.950 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:14:39.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:15:41.680 INFO:teuthology.orchestra.run.smithi046.stdout:generic/125 62s 2023-05-21T18:15:41.699 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/125 2023-05-21T18:15:41.699 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:15:41.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:15:41.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:15:41.734 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-05-21T18:15:42.407 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:15:42.415 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:15:42.415 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:15:43.526 INFO:teuthology.orchestra.run.smithi046.stdout:generic/126 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/126.out.bad) 2023-05-21T18:15:43.531 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/126.out 2023-05-21 16:55:34.839775028 +0000 2023-05-21T18:15:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/126.out.bad 2023-05-21 18:15:43.484613142 +0000 2023-05-21T18:15:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,7 +1,7 @@ 2023-05-21T18:15:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 126 2023-05-21T18:15:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-05-21T18:15:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-05-21T18:15:43.532 INFO:teuthology.orchestra.run.smithi046.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-05-21T18:15:43.533 INFO:teuthology.orchestra.run.smithi046.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-05-21T18:15:43.533 INFO:teuthology.orchestra.run.smithi046.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-05-21T18:15:43.533 INFO:teuthology.orchestra.run.smithi046.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-05-21T18:15:43.533 INFO:teuthology.orchestra.run.smithi046.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-05-21T18:15:43.533 INFO:teuthology.orchestra.run.smithi046.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-05-21T18:15:43.533 INFO:teuthology.orchestra.run.smithi046.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-05-21T18:15:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/126 2023-05-21T18:15:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/126 2023-05-21T18:15:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:15:43.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:15:43.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:15:43.556 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:15:43.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:15:43.557 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-05-21T18:15:44.230 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:15:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:15:44.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:16:54.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:16:54.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:17:24.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:17:25.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:17:55.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:17:55.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:18:25.305 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:18:25.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:18:55.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:18:55.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:19:25.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:19:25.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:19:55.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:19:55.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:20:25.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:20:25.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:20:55.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:20:55.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:21:26.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:21:26.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:21:56.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:21:56.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:22:26.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:22:26.375 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:22:56.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:22:56.445 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:23:26.493 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:23:26.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:23:56.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:23:56.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:24:26.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:24:26.731 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:24:56.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:24:56.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:25:26.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:25:26.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:25:57.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:25:57.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:26:27.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:26:27.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:26:57.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:26:57.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:27:27.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:27:27.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:27:57.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:27:57.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:28:27.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:28:27.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:28:57.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:28:57.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:29:27.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:29:27.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:29:57.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:29:57.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:30:28.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:30:28.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:30:58.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:30:58.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:31:28.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:31:28.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:31:58.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:31:58.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:32:28.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:32:28.375 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:32:58.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:32:58.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:33:28.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:33:28.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:33:58.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:33:58.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:34:28.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:34:28.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:34:58.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:34:58.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:35:29.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:35:29.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:35:59.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:35:59.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:36:29.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:36:29.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:36:59.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:36:59.628 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:36:59.649 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T18:36:59.638+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160631) UID: 0 2023-05-21T18:36:59.650 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T18:36:59.638+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160631) UID: 0 2023-05-21T18:36:59.650 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T18:36:59.638+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160631) UID: 0 2023-05-21T18:36:59.651 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T18:36:59.638+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 160631) UID: 0 2023-05-21T18:39:30.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:39:30.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:40:01.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:40:01.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:40:31.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:40:31.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:40:54.045 INFO:teuthology.orchestra.run.smithi046.stdout:generic/127 1510s 2023-05-21T18:40:54.054 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/127 2023-05-21T18:40:54.054 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:40:54.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:54.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:40:54.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-05-21T18:40:54.777 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:40:54.787 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:40:54.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:55.037 INFO:teuthology.orchestra.run.smithi046.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:40:55.045 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/128 2023-05-21T18:40:55.045 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/128 2023-05-21T18:40:55.046 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:40:55.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:55.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:40:55.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-05-21T18:40:55.387 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:40:55.397 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:40:55.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:55.651 INFO:teuthology.orchestra.run.smithi046.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:40:55.659 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/129 2023-05-21T18:40:55.660 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/129 2023-05-21T18:40:55.660 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:40:55.664 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:55.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:40:55.681 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-05-21T18:40:56.009 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:40:56.018 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:40:56.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:56.274 INFO:teuthology.orchestra.run.smithi046.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:40:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/130 2023-05-21T18:40:56.283 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/130 2023-05-21T18:40:56.283 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:40:56.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:56.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:40:56.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-05-21T18:40:56.619 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:40:56.628 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:40:56.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:58.139 INFO:teuthology.orchestra.run.smithi046.stdout:generic/131 2s 2023-05-21T18:40:58.149 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/131 2023-05-21T18:40:58.149 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:40:58.154 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:58.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:40:58.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-05-21T18:40:58.879 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:40:58.888 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:40:58.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:59.135 INFO:teuthology.orchestra.run.smithi046.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:40:59.143 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/132 2023-05-21T18:40:59.143 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/132 2023-05-21T18:40:59.144 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:40:59.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:40:59.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:40:59.167 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-05-21T18:40:59.484 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:40:59.493 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:40:59.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:41:01.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:41:01.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:41:31.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:41:31.690 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:42:01.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:42:01.849 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:42:31.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:42:31.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:43:02.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:43:02.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:43:32.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:43:32.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:44:02.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:44:02.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:44:32.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:44:32.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:45:02.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:45:02.450 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:45:32.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:45:32.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:46:02.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:46:02.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:46:32.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:46:32.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:47:02.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:47:02.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:47:32.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:47:32.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:47:55.595 INFO:teuthology.orchestra.run.smithi046.stdout:generic/133 416s 2023-05-21T18:47:55.620 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/133 2023-05-21T18:47:55.620 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:47:55.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:55.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:47:55.672 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-05-21T18:47:56.389 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:47:56.397 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:47:56.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:56.770 INFO:teuthology.orchestra.run.smithi046.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:47:56.778 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/134 2023-05-21T18:47:56.778 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/134 2023-05-21T18:47:56.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:47:56.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:56.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:47:56.860 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-05-21T18:47:57.511 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:47:57.521 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:47:57.521 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:57.858 INFO:teuthology.orchestra.run.smithi046.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:47:57.867 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/135 2023-05-21T18:47:57.867 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/135 2023-05-21T18:47:57.867 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:47:57.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:57.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:47:57.889 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-05-21T18:47:58.197 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:47:58.206 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:47:58.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:58.615 INFO:teuthology.orchestra.run.smithi046.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T18:47:58.623 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/136 2023-05-21T18:47:58.623 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/136 2023-05-21T18:47:58.623 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:47:58.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:58.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:47:58.663 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-05-21T18:47:59.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:47:59.400 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:47:59.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:59.737 INFO:teuthology.orchestra.run.smithi046.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:47:59.745 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/137 2023-05-21T18:47:59.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/137 2023-05-21T18:47:59.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:47:59.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:47:59.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:47:59.770 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-05-21T18:48:00.486 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:00.495 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:00.496 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:00.843 INFO:teuthology.orchestra.run.smithi046.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:00.851 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/138 2023-05-21T18:48:00.852 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/138 2023-05-21T18:48:00.852 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:00.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:00.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:00.875 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-05-21T18:48:01.586 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:01.596 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:01.612 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:01.959 INFO:teuthology.orchestra.run.smithi046.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:01.966 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/139 2023-05-21T18:48:01.967 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/139 2023-05-21T18:48:01.967 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:01.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:01.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:01.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-05-21T18:48:02.728 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:02.736 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:02.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:02.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:48:02.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:48:03.085 INFO:teuthology.orchestra.run.smithi046.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:03.093 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/140 2023-05-21T18:48:03.093 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/140 2023-05-21T18:48:03.094 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:03.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:03.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:03.120 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-05-21T18:48:03.832 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:03.841 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:03.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:04.100 INFO:teuthology.orchestra.run.smithi046.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:04.107 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/141 2023-05-21T18:48:04.108 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/141 2023-05-21T18:48:04.108 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:04.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:04.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:04.131 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-05-21T18:48:04.441 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:04.449 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:04.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:04.803 INFO:teuthology.orchestra.run.smithi046.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:04.812 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/142 2023-05-21T18:48:04.812 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/142 2023-05-21T18:48:04.812 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:04.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:04.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:04.837 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-05-21T18:48:05.529 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:05.538 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:05.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:05.890 INFO:teuthology.orchestra.run.smithi046.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:05.897 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/143 2023-05-21T18:48:05.897 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/143 2023-05-21T18:48:05.897 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:05.902 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:05.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:05.919 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-05-21T18:48:06.649 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:06.659 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:06.690 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:07.006 INFO:teuthology.orchestra.run.smithi046.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:07.013 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/144 2023-05-21T18:48:07.013 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/144 2023-05-21T18:48:07.014 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:07.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:07.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:07.063 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-05-21T18:48:07.725 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:07.732 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:07.732 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:08.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:08.084 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/145 2023-05-21T18:48:08.084 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/145 2023-05-21T18:48:08.085 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:08.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:08.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:08.107 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-05-21T18:48:08.765 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:08.773 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:08.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:09.130 INFO:teuthology.orchestra.run.smithi046.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/146 2023-05-21T18:48:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/146 2023-05-21T18:48:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:09.143 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:09.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:09.161 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-05-21T18:48:09.852 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:09.861 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:09.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:10.213 INFO:teuthology.orchestra.run.smithi046.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:10.221 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/147 2023-05-21T18:48:10.222 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/147 2023-05-21T18:48:10.222 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:10.227 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:10.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:10.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-05-21T18:48:10.954 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:10.963 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:11.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:11.307 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/148 2023-05-21T18:48:11.307 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/148 2023-05-21T18:48:11.308 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:11.312 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:11.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:11.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-05-21T18:48:12.046 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:12.055 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:12.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:12.414 INFO:teuthology.orchestra.run.smithi046.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:12.423 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/149 2023-05-21T18:48:12.423 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/149 2023-05-21T18:48:12.424 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:12.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:12.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:12.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-05-21T18:48:13.152 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:13.160 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:13.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:13.516 INFO:teuthology.orchestra.run.smithi046.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:13.524 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/150 2023-05-21T18:48:13.524 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/150 2023-05-21T18:48:13.525 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:13.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:13.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:13.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-05-21T18:48:14.243 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:14.252 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:14.622 INFO:teuthology.orchestra.run.smithi046.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:14.628 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/151 2023-05-21T18:48:14.628 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/151 2023-05-21T18:48:14.628 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:14.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:14.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:14.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-05-21T18:48:15.360 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:15.370 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:15.370 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:15.727 INFO:teuthology.orchestra.run.smithi046.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:15.737 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/152 2023-05-21T18:48:15.737 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/152 2023-05-21T18:48:15.737 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:15.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:15.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:15.762 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-05-21T18:48:16.456 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:16.466 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:16.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:16.818 INFO:teuthology.orchestra.run.smithi046.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:16.827 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/153 2023-05-21T18:48:16.827 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/153 2023-05-21T18:48:16.827 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:16.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:16.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:16.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-05-21T18:48:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:17.552 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:17.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:17.901 INFO:teuthology.orchestra.run.smithi046.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:17.909 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/154 2023-05-21T18:48:17.909 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/154 2023-05-21T18:48:17.909 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:17.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:17.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:17.933 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-05-21T18:48:18.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:18.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:18.968 INFO:teuthology.orchestra.run.smithi046.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:18.977 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/155 2023-05-21T18:48:18.977 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/155 2023-05-21T18:48:18.977 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:18.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:18.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:18.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-05-21T18:48:19.689 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:19.700 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:19.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:20.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:20.086 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/156 2023-05-21T18:48:20.087 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/156 2023-05-21T18:48:20.087 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:20.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:20.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:20.106 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-05-21T18:48:20.773 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:20.783 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:20.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:21.148 INFO:teuthology.orchestra.run.smithi046.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:21.155 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/157 2023-05-21T18:48:21.169 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/157 2023-05-21T18:48:21.169 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:21.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:21.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:21.180 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-05-21T18:48:21.866 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:21.875 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:22.247 INFO:teuthology.orchestra.run.smithi046.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:22.255 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/158 2023-05-21T18:48:22.255 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/158 2023-05-21T18:48:22.255 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:22.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:22.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:22.279 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-05-21T18:48:23.019 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:23.024 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:23.024 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:23.342 INFO:teuthology.orchestra.run.smithi046.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-05-21T18:48:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/159 2023-05-21T18:48:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/159 2023-05-21T18:48:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:23.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:23.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-05-21T18:48:23.680 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:23.690 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:23.690 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:24.009 INFO:teuthology.orchestra.run.smithi046.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-05-21T18:48:24.015 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/160 2023-05-21T18:48:24.016 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/160 2023-05-21T18:48:24.016 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:24.019 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:24.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:24.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-05-21T18:48:24.358 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:24.367 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:24.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:24.637 INFO:teuthology.orchestra.run.smithi046.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:24.668 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/161 2023-05-21T18:48:24.669 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/161 2023-05-21T18:48:24.669 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:24.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:24.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-05-21T18:48:24.996 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:25.004 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:25.005 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:25.269 INFO:teuthology.orchestra.run.smithi046.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:25.277 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/162 2023-05-21T18:48:25.277 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/162 2023-05-21T18:48:25.277 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:25.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:25.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:25.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-05-21T18:48:25.608 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:25.616 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:25.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:25.877 INFO:teuthology.orchestra.run.smithi046.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:25.885 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/163 2023-05-21T18:48:25.885 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/163 2023-05-21T18:48:25.885 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:25.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:25.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:25.906 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-05-21T18:48:26.224 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:26.233 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:26.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:26.482 INFO:teuthology.orchestra.run.smithi046.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:26.491 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/164 2023-05-21T18:48:26.491 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/164 2023-05-21T18:48:26.492 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:26.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:26.515 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-05-21T18:48:26.837 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:26.846 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:26.847 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:27.105 INFO:teuthology.orchestra.run.smithi046.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:27.112 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/165 2023-05-21T18:48:27.113 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/165 2023-05-21T18:48:27.113 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:27.118 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:27.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:27.135 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-05-21T18:48:27.458 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:27.468 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:27.468 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:27.729 INFO:teuthology.orchestra.run.smithi046.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:27.736 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/166 2023-05-21T18:48:27.737 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/166 2023-05-21T18:48:27.737 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:27.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:27.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:27.759 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-05-21T18:48:28.075 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:28.084 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:28.085 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:28.338 INFO:teuthology.orchestra.run.smithi046.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:28.346 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/167 2023-05-21T18:48:28.346 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/167 2023-05-21T18:48:28.346 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:28.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:28.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:28.370 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-05-21T18:48:28.677 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:28.687 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:28.687 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:28.946 INFO:teuthology.orchestra.run.smithi046.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:28.956 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/168 2023-05-21T18:48:28.956 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/168 2023-05-21T18:48:28.956 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:28.962 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:28.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:28.980 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-05-21T18:48:29.293 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:29.302 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:29.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:29.580 INFO:teuthology.orchestra.run.smithi046.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/169 2023-05-21T18:48:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/169 2023-05-21T18:48:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:29.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:29.611 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-05-21T18:48:29.927 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:29.936 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:30.287 INFO:teuthology.orchestra.run.smithi046.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:30.295 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/170 2023-05-21T18:48:30.295 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/170 2023-05-21T18:48:30.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:30.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:30.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-05-21T18:48:30.635 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:30.644 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:30.948 INFO:teuthology.orchestra.run.smithi046.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:30.956 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/171 2023-05-21T18:48:30.956 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/171 2023-05-21T18:48:30.956 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:30.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:30.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:30.978 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-05-21T18:48:31.300 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:31.308 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:31.309 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:31.588 INFO:teuthology.orchestra.run.smithi046.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:31.597 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/172 2023-05-21T18:48:31.597 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/172 2023-05-21T18:48:31.597 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:31.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:31.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:31.620 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-05-21T18:48:31.946 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:31.956 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:31.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:32.226 INFO:teuthology.orchestra.run.smithi046.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:32.234 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/173 2023-05-21T18:48:32.234 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/173 2023-05-21T18:48:32.234 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:32.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:32.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:32.263 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-05-21T18:48:32.586 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:32.594 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:32.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:32.871 INFO:teuthology.orchestra.run.smithi046.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:32.879 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/174 2023-05-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/174 2023-05-21T18:48:32.893 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:32.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:32.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:32.903 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-05-21T18:48:33.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:48:33.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:48:33.233 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:33.242 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:33.242 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:33.503 INFO:teuthology.orchestra.run.smithi046.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:33.512 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/175 2023-05-21T18:48:33.512 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/175 2023-05-21T18:48:33.512 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:33.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:33.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:33.536 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-05-21T18:48:33.848 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:33.857 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:33.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:34.120 INFO:teuthology.orchestra.run.smithi046.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:34.128 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/176 2023-05-21T18:48:34.128 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/176 2023-05-21T18:48:34.128 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:34.133 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:34.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:34.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-05-21T18:48:34.469 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:34.479 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:34.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:34.813 INFO:teuthology.orchestra.run.smithi046.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:34.822 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/177 2023-05-21T18:48:34.822 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/177 2023-05-21T18:48:34.822 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:34.829 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:34.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:34.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-05-21T18:48:35.168 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:35.179 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:35.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:35.553 INFO:teuthology.orchestra.run.smithi046.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:35.559 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/178 2023-05-21T18:48:35.560 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/178 2023-05-21T18:48:35.560 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:35.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:35.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:35.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-05-21T18:48:36.278 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:36.288 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:36.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:36.649 INFO:teuthology.orchestra.run.smithi046.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:36.657 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/179 2023-05-21T18:48:36.657 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/179 2023-05-21T18:48:36.658 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:36.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:36.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:36.682 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-05-21T18:48:37.378 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:37.387 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:37.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:37.746 INFO:teuthology.orchestra.run.smithi046.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:37.755 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/180 2023-05-21T18:48:37.755 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/180 2023-05-21T18:48:37.755 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:37.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:37.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:37.787 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-05-21T18:48:38.475 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:38.484 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:38.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:38.841 INFO:teuthology.orchestra.run.smithi046.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:38.849 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/181 2023-05-21T18:48:38.850 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/181 2023-05-21T18:48:38.850 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:38.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:38.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:38.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-05-21T18:48:39.612 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:39.621 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:39.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T18:48:39.999 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/182 2023-05-21T18:48:39.999 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/182 2023-05-21T18:48:39.999 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:40.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:40.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:40.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-05-21T18:48:40.762 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:40.769 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:40.769 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:41.027 INFO:teuthology.orchestra.run.smithi046.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:41.034 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/183 2023-05-21T18:48:41.035 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/183 2023-05-21T18:48:41.035 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:41.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:41.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:41.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-05-21T18:48:41.372 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:41.382 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:41.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:41.737 INFO:teuthology.orchestra.run.smithi046.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/184.out.bad) 2023-05-21T18:48:41.740 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/184.out 2023-05-21 16:55:34.843774941 +0000 2023-05-21T18:48:41.741 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/184.out.bad 2023-05-21 18:48:41.727635888 +0000 2023-05-21T18:48:41.741 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1 +1,2 @@ 2023-05-21T18:48:41.741 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 184 2023-05-21T18:48:41.741 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.wfxug4os5zxfstests-dev/tests/generic/184: line 23: /tmp/tmp.g8r3hAr3OQtest/null: Permission denied 2023-05-21T18:48:41.744 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/184 2023-05-21T18:48:41.745 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/184 2023-05-21T18:48:41.745 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:48:41.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:41.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:48:41.763 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:48:41.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:48:41.764 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-05-21T18:48:42.077 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:42.085 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:42.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:42.347 INFO:teuthology.orchestra.run.smithi046.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:42.355 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/185 2023-05-21T18:48:42.356 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/185 2023-05-21T18:48:42.356 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:42.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:42.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:42.381 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-05-21T18:48:42.696 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:42.705 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:42.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:42.962 INFO:teuthology.orchestra.run.smithi046.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:42.970 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/186 2023-05-21T18:48:42.970 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/186 2023-05-21T18:48:42.971 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:42.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:42.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:42.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-05-21T18:48:43.305 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:43.313 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:43.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:43.567 INFO:teuthology.orchestra.run.smithi046.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:43.575 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/187 2023-05-21T18:48:43.576 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/187 2023-05-21T18:48:43.576 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:43.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:43.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:43.600 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-05-21T18:48:43.908 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:43.918 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:44.176 INFO:teuthology.orchestra.run.smithi046.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:44.185 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/188 2023-05-21T18:48:44.185 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/188 2023-05-21T18:48:44.185 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:44.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:44.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:44.214 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-05-21T18:48:44.525 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:44.534 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:44.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/189 2023-05-21T18:48:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/189 2023-05-21T18:48:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:44.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:44.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:44.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-05-21T18:48:45.149 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:45.158 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:45.158 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:45.414 INFO:teuthology.orchestra.run.smithi046.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:45.423 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/190 2023-05-21T18:48:45.423 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/190 2023-05-21T18:48:45.423 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:45.428 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:45.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:45.447 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-05-21T18:48:45.767 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:45.776 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:45.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:46.038 INFO:teuthology.orchestra.run.smithi046.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:46.046 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/191 2023-05-21T18:48:46.047 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/191 2023-05-21T18:48:46.047 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:46.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:46.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:46.069 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-05-21T18:48:46.399 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:46.408 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:46.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:51.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/192 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/192.out.bad) 2023-05-21T18:48:51.970 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/192.out 2023-05-21 16:55:34.843774941 +0000 2023-05-21T18:48:51.970 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/192.out.bad 2023-05-21 18:48:51.931526893 +0000 2023-05-21T18:48:51.970 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,6 @@ 2023-05-21T18:48:51.970 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 192 2023-05-21T18:48:51.970 INFO:teuthology.orchestra.run.smithi046.stdout: sleep for 5 seconds 2023-05-21T18:48:51.971 INFO:teuthology.orchestra.run.smithi046.stdout: test 2023-05-21T18:48:51.971 INFO:teuthology.orchestra.run.smithi046.stdout: -delta1 is in range 2023-05-21T18:48:51.971 INFO:teuthology.orchestra.run.smithi046.stdout: +delta1 has value of 0 2023-05-21T18:48:51.971 INFO:teuthology.orchestra.run.smithi046.stdout: +delta1 is NOT in range 5 .. 7 2023-05-21T18:48:51.971 INFO:teuthology.orchestra.run.smithi046.stdout: delta2 is in range 2023-05-21T18:48:51.971 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/192 2023-05-21T18:48:51.972 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/192 2023-05-21T18:48:51.972 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:48:51.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:51.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:48:52.004 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:48:52.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:48:52.023 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-05-21T18:48:52.353 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:52.363 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:53.637 INFO:teuthology.orchestra.run.smithi046.stdout:generic/193 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/193.out.bad) 2023-05-21T18:48:53.640 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/193.out 2023-05-21 16:55:34.843774941 +0000 2023-05-21T18:48:53.640 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/193.out.bad 2023-05-21 18:48:53.627508773 +0000 2023-05-21T18:48:53.641 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -24,7 +24,6 @@ 2023-05-21T18:48:53.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:53.641 INFO:teuthology.orchestra.run.smithi046.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-05-21T18:48:53.641 INFO:teuthology.orchestra.run.smithi046.stdout: user: chmod a+r on root owned file (should fail) 2023-05-21T18:48:53.641 INFO:teuthology.orchestra.run.smithi046.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-05-21T18:48:53.642 INFO:teuthology.orchestra.run.smithi046.stdout: check that the sgid bit is cleared 2023-05-21T18:48:53.642 INFO:teuthology.orchestra.run.smithi046.stdout: -rw-rw-rw- 2023-05-21T18:48:53.642 INFO:teuthology.orchestra.run.smithi046.stdout: check that suid bit is not cleared 2023-05-21T18:48:53.645 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/193 2023-05-21T18:48:53.646 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/193 2023-05-21T18:48:53.646 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:48:53.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:53.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:48:53.669 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:48:53.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:48:53.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-05-21T18:48:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:54.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:54.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:54.670 INFO:teuthology.orchestra.run.smithi046.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:54.679 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/194 2023-05-21T18:48:54.679 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/194 2023-05-21T18:48:54.679 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:54.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:54.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:54.702 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-05-21T18:48:55.026 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:55.035 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:55.035 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:55.294 INFO:teuthology.orchestra.run.smithi046.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:55.302 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/195 2023-05-21T18:48:55.303 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/195 2023-05-21T18:48:55.303 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:55.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:55.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:55.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-05-21T18:48:55.648 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:55.657 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:55.657 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:55.914 INFO:teuthology.orchestra.run.smithi046.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:55.922 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/196 2023-05-21T18:48:55.923 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/196 2023-05-21T18:48:55.923 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:55.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:55.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:55.945 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-05-21T18:48:56.259 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:56.267 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:56.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:56.523 INFO:teuthology.orchestra.run.smithi046.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:56.531 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/197 2023-05-21T18:48:56.532 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/197 2023-05-21T18:48:56.532 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:56.537 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:56.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:56.555 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-05-21T18:48:56.864 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:56.873 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:56.874 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:58.194 INFO:teuthology.orchestra.run.smithi046.stdout:generic/198 2s 2023-05-21T18:48:58.206 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/198 2023-05-21T18:48:58.206 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:58.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:58.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:58.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-05-21T18:48:58.958 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:58.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:59.229 INFO:teuthology.orchestra.run.smithi046.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:59.237 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/199 2023-05-21T18:48:59.238 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/199 2023-05-21T18:48:59.238 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:59.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:59.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:59.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-05-21T18:48:59.574 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:48:59.584 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:48:59.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:59.840 INFO:teuthology.orchestra.run.smithi046.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:48:59.849 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/200 2023-05-21T18:48:59.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/200 2023-05-21T18:48:59.849 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:48:59.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:48:59.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:48:59.874 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-05-21T18:49:00.193 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:00.202 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:00.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:00.465 INFO:teuthology.orchestra.run.smithi046.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:49:00.473 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/201 2023-05-21T18:49:00.473 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/201 2023-05-21T18:49:00.474 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:00.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:00.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:00.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-05-21T18:49:00.812 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:00.822 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:00.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:01.084 INFO:teuthology.orchestra.run.smithi046.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:49:01.091 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/202 2023-05-21T18:49:01.092 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/202 2023-05-21T18:49:01.092 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:01.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:01.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:01.114 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-05-21T18:49:01.430 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:01.439 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:01.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:01.699 INFO:teuthology.orchestra.run.smithi046.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:49:01.708 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/203 2023-05-21T18:49:01.708 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/203 2023-05-21T18:49:01.708 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:01.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:01.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:01.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-05-21T18:49:02.044 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:02.052 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:02.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:03.218 INFO:teuthology.orchestra.run.smithi046.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:49:03.226 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/204 2023-05-21T18:49:03.226 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/204 2023-05-21T18:49:03.226 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:03.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:49:03.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:03.244 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:49:03.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:03.252 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-05-21T18:49:03.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:03.624 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:03.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:03.872 INFO:teuthology.orchestra.run.smithi046.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:49:03.880 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/205 2023-05-21T18:49:03.880 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/205 2023-05-21T18:49:03.881 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:03.885 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:03.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:03.904 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-05-21T18:49:04.211 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:04.220 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:04.220 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:04.493 INFO:teuthology.orchestra.run.smithi046.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:49:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/206 2023-05-21T18:49:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/206 2023-05-21T18:49:04.501 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:04.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:04.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:04.524 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-05-21T18:49:04.846 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:04.856 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:04.856 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:33.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:49:33.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:49:37.051 INFO:teuthology.orchestra.run.smithi046.stdout:generic/207 33s 2023-05-21T18:49:37.064 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/207 2023-05-21T18:49:37.064 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:49:37.070 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:49:37.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:49:37.110 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-05-21T18:49:37.758 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:49:37.767 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:49:37.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:50:03.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:50:03.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:50:33.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:50:33.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:51:03.744 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:51:03.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:51:33.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:51:33.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:52:04.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:52:04.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:52:34.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:52:34.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:52:58.300 INFO:teuthology.orchestra.run.smithi046.stdout:generic/208 201s 2023-05-21T18:52:58.313 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/208 2023-05-21T18:52:58.313 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:52:58.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:52:58.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:52:58.368 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-05-21T18:52:59.054 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:52:59.063 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:52:59.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:04.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:53:04.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:53:16.293 INFO:teuthology.orchestra.run.smithi046.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/209.out.bad) 2023-05-21T18:53:16.359 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/209.out 2023-05-21 16:55:34.843774941 +0000 2023-05-21T18:53:16.359 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/209.out.bad 2023-05-21 18:53:16.256688949 +0000 2023-05-21T18:53:16.359 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,2 @@ 2023-05-21T18:53:16.360 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 209 2023-05-21T18:53:16.360 INFO:teuthology.orchestra.run.smithi046.stdout: -test ran for 30 seconds without error 2023-05-21T18:53:16.360 INFO:teuthology.orchestra.run.smithi046.stdout: +reader found old byte at pos 4096 2023-05-21T18:53:16.360 INFO:teuthology.orchestra.run.smithi046.stdout: \ No newline at end of file 2023-05-21T18:53:16.382 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/209 2023-05-21T18:53:16.382 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/209 2023-05-21T18:53:16.382 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:53:16.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:16.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:53:16.445 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:53:16.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:53:16.446 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-05-21T18:53:16.728 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:16.737 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:16.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:17.217 INFO:teuthology.orchestra.run.smithi046.stdout:generic/210 1s 2023-05-21T18:53:17.229 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/210 2023-05-21T18:53:17.229 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:17.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:17.264 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-05-21T18:53:17.912 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:17.923 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:17.923 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:18.439 INFO:teuthology.orchestra.run.smithi046.stdout:generic/211 1s 2023-05-21T18:53:18.450 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/211 2023-05-21T18:53:18.451 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:18.455 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:18.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:18.472 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-05-21T18:53:18.784 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:18.792 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:18.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:19.221 INFO:teuthology.orchestra.run.smithi046.stdout:generic/212 1s 2023-05-21T18:53:19.233 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/212 2023-05-21T18:53:19.233 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:19.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:19.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:19.255 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-05-21T18:53:19.573 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:19.582 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:19.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:20.275 INFO:teuthology.orchestra.run.smithi046.stdout:generic/213 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/213.out.bad) 2023-05-21T18:53:20.279 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/213.out 2023-05-21 16:55:34.843774941 +0000 2023-05-21T18:53:20.280 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/213.out.bad 2023-05-21 18:53:20.260645778 +0000 2023-05-21T18:53:20.280 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,4 +1,3 @@ 2023-05-21T18:53:20.280 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 213 2023-05-21T18:53:20.280 INFO:teuthology.orchestra.run.smithi046.stdout: We should get: fallocate: No space left on device 2023-05-21T18:53:20.280 INFO:teuthology.orchestra.run.smithi046.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-05-21T18:53:20.280 INFO:teuthology.orchestra.run.smithi046.stdout: -fallocate: No space left on device 2023-05-21T18:53:20.284 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/213 2023-05-21T18:53:20.285 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/213 2023-05-21T18:53:20.285 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:53:20.290 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:20.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:53:20.305 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:53:20.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:53:20.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-05-21T18:53:20.982 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:20.991 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:20.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:21.799 INFO:teuthology.orchestra.run.smithi046.stdout:generic/214 0s 2023-05-21T18:53:21.816 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/214 2023-05-21T18:53:21.817 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:21.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:21.855 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-05-21T18:53:22.681 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:22.692 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:26.078 INFO:teuthology.orchestra.run.smithi046.stdout:generic/215 4s 2023-05-21T18:53:26.090 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/215 2023-05-21T18:53:26.090 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:26.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:26.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:26.122 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-05-21T18:53:26.500 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:26.508 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:26.769 INFO:teuthology.orchestra.run.smithi046.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:26.781 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/216 2023-05-21T18:53:26.781 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/216 2023-05-21T18:53:26.781 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:26.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:26.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:26.811 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-05-21T18:53:27.220 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:27.224 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:27.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:27.505 INFO:teuthology.orchestra.run.smithi046.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/217 2023-05-21T18:53:27.527 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/217 2023-05-21T18:53:27.527 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:27.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:27.551 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-05-21T18:53:28.058 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:28.072 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:28.072 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:28.331 INFO:teuthology.orchestra.run.smithi046.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:28.342 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/218 2023-05-21T18:53:28.342 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/218 2023-05-21T18:53:28.342 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:28.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:28.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:28.383 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-05-21T18:53:28.790 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:28.801 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:28.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:29.079 INFO:teuthology.orchestra.run.smithi046.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:29.088 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/219 2023-05-21T18:53:29.088 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/219 2023-05-21T18:53:29.089 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:29.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:29.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:29.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-05-21T18:53:29.521 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:29.537 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:29.830 INFO:teuthology.orchestra.run.smithi046.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:29.847 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/220 2023-05-21T18:53:29.847 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/220 2023-05-21T18:53:29.847 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:29.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:29.895 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-05-21T18:53:30.262 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:30.270 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:31.640 INFO:teuthology.orchestra.run.smithi046.stdout:generic/221 1s 2023-05-21T18:53:31.662 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/221 2023-05-21T18:53:31.662 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:31.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:31.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:31.683 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-05-21T18:53:32.109 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:32.117 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:32.117 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:32.425 INFO:teuthology.orchestra.run.smithi046.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:32.439 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/222 2023-05-21T18:53:32.439 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/222 2023-05-21T18:53:32.439 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:32.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:32.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:32.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-05-21T18:53:32.922 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:32.938 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:32.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:33.210 INFO:teuthology.orchestra.run.smithi046.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:33.224 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/223 2023-05-21T18:53:33.225 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/223 2023-05-21T18:53:33.225 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:33.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:33.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:33.258 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-05-21T18:53:33.677 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:33.698 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:33.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:33.992 INFO:teuthology.orchestra.run.smithi046.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:34.000 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/224 2023-05-21T18:53:34.000 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/224 2023-05-21T18:53:34.000 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:34.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:34.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:34.029 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-05-21T18:53:34.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:53:34.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:53:34.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:34.460 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:34.460 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:34.731 INFO:teuthology.orchestra.run.smithi046.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:34.745 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/225 2023-05-21T18:53:34.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/225 2023-05-21T18:53:34.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:34.750 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:34.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:34.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-05-21T18:53:35.183 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:35.196 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:35.196 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:35.469 INFO:teuthology.orchestra.run.smithi046.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:35.479 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/226 2023-05-21T18:53:35.479 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/226 2023-05-21T18:53:35.479 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:35.485 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:35.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:35.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-05-21T18:53:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:35.978 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:35.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:36.261 INFO:teuthology.orchestra.run.smithi046.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:36.270 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/227 2023-05-21T18:53:36.271 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/227 2023-05-21T18:53:36.271 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:36.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:36.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:36.310 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-05-21T18:53:36.725 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:36.737 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:36.737 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:37.177 INFO:teuthology.orchestra.run.smithi046.stdout:generic/228 1s 2023-05-21T18:53:37.191 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/228 2023-05-21T18:53:37.191 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:37.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:37.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:37.213 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-05-21T18:53:38.027 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:38.035 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:38.035 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:38.307 INFO:teuthology.orchestra.run.smithi046.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:38.311 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/229 2023-05-21T18:53:38.312 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/229 2023-05-21T18:53:38.312 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:38.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:38.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:38.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-05-21T18:53:38.745 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:38.758 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:38.759 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:39.023 INFO:teuthology.orchestra.run.smithi046.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:39.031 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/230 2023-05-21T18:53:39.031 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/230 2023-05-21T18:53:39.031 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:39.034 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:39.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:39.059 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-05-21T18:53:39.458 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:39.477 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:39.478 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:39.757 INFO:teuthology.orchestra.run.smithi046.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:39.766 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/231 2023-05-21T18:53:39.766 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/231 2023-05-21T18:53:39.766 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:39.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:39.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:39.785 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-05-21T18:53:40.190 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:40.203 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:40.438 INFO:teuthology.orchestra.run.smithi046.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:40.443 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/232 2023-05-21T18:53:40.443 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/232 2023-05-21T18:53:40.444 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:40.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:40.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:40.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-05-21T18:53:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:40.856 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:40.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:41.123 INFO:teuthology.orchestra.run.smithi046.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:41.132 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/233 2023-05-21T18:53:41.132 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/233 2023-05-21T18:53:41.132 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:41.135 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:41.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:41.156 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-05-21T18:53:41.521 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:41.527 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:41.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:41.797 INFO:teuthology.orchestra.run.smithi046.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:41.807 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/234 2023-05-21T18:53:41.808 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/234 2023-05-21T18:53:41.808 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:41.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:41.838 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-05-21T18:53:42.235 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:42.241 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:42.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:42.536 INFO:teuthology.orchestra.run.smithi046.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:42.549 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/235 2023-05-21T18:53:42.549 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/235 2023-05-21T18:53:42.550 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:42.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:42.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:42.576 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-05-21T18:53:42.988 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:43.002 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:43.002 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:generic/236 1s 2023-05-21T18:53:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/236 2023-05-21T18:53:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:44.770 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:44.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:44.812 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-05-21T18:53:45.590 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:45.613 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:45.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:45.992 INFO:teuthology.orchestra.run.smithi046.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T18:53:46.004 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/237 2023-05-21T18:53:46.004 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/237 2023-05-21T18:53:46.004 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:46.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:46.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:46.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-05-21T18:53:46.427 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:46.438 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:46.439 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:46.732 INFO:teuthology.orchestra.run.smithi046.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:53:46.736 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/238 2023-05-21T18:53:46.737 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/238 2023-05-21T18:53:46.737 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:53:46.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:53:46.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:53:46.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-05-21T18:53:47.185 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:53:47.190 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:53:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:54:04.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:54:04.522 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:54:34.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:54:34.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:55:05.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:55:05.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:55:35.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:55:35.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:56:05.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:56:05.267 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:56:15.781 INFO:teuthology.orchestra.run.smithi046.stdout:generic/239 148s 2023-05-21T18:56:15.802 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/239 2023-05-21T18:56:15.802 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:56:15.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:56:15.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:56:15.904 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-05-21T18:56:16.586 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:56:16.594 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:56:16.594 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:56:20.979 INFO:teuthology.orchestra.run.smithi046.stdout:generic/240 4s 2023-05-21T18:56:20.993 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/240 2023-05-21T18:56:20.994 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:56:20.997 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:56:21.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:56:21.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-05-21T18:56:21.800 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:56:21.808 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:56:21.809 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:56:35.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:56:35.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:57:05.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:57:05.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:57:35.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:57:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:generic/241 74s 2023-05-21T18:57:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/241 2023-05-21T18:57:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:57:35.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:35.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T18:57:35.852 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T18:57:35.839+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41596) UID: 0 2023-05-21T18:57:35.860 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T18:57:35.839+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41596) UID: 0 2023-05-21T18:57:35.861 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T18:57:35.843+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41596) UID: 0 2023-05-21T18:57:35.861 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T18:57:35.843+0000 7f39e6513700 -1 Fail to open '/proc/41596/cmdline' error = (2) No such file or directory 2023-05-21T18:57:35.862 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T18:57:35.843+0000 7f39e6513700 -1 received signal: Hangup from (PID: 41596) UID: 0 2023-05-21T18:57:35.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:57:35.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-05-21T18:57:36.616 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:57:36.627 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:57:36.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:37.115 INFO:teuthology.orchestra.run.smithi046.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:57:37.120 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/242 2023-05-21T18:57:37.121 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/242 2023-05-21T18:57:37.121 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:57:37.127 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:37.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:57:37.152 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-05-21T18:57:37.573 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:57:37.581 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:57:37.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:38.145 INFO:teuthology.orchestra.run.smithi046.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:57:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/243 2023-05-21T18:57:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/243 2023-05-21T18:57:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:57:38.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:38.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:57:38.192 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-05-21T18:57:38.608 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:57:38.618 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:57:38.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-21T18:57:39.275 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/244 2023-05-21T18:57:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/244 2023-05-21T18:57:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:57:39.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:39.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:57:39.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-05-21T18:57:39.852 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:57:39.875 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:57:39.876 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:40.396 INFO:teuthology.orchestra.run.smithi046.stdout:generic/245 1s 2023-05-21T18:57:40.418 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/245 2023-05-21T18:57:40.418 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:57:40.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:40.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:57:40.433 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-05-21T18:57:41.281 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:57:41.293 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:57:41.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:41.781 INFO:teuthology.orchestra.run.smithi046.stdout:generic/246 0s 2023-05-21T18:57:41.791 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/246 2023-05-21T18:57:41.791 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:57:41.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:57:41.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:57:41.819 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-05-21T18:57:42.591 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:57:42.599 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:57:42.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:44.607 INFO:teuthology.orchestra.run.smithi046.stdout:generic/247 62s 2023-05-21T18:58:44.628 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/247 2023-05-21T18:58:44.629 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:44.629 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:44.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:44.715 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-05-21T18:58:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:45.158 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:45.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:46.198 INFO:teuthology.orchestra.run.smithi046.stdout:generic/248 1s 2023-05-21T18:58:46.214 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/248 2023-05-21T18:58:46.214 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:46.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:46.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:46.247 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-05-21T18:58:46.690 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:46.702 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:46.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:49.490 INFO:teuthology.orchestra.run.smithi046.stdout:generic/249 3s 2023-05-21T18:58:49.515 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/249 2023-05-21T18:58:49.515 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:49.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:49.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:49.560 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-05-21T18:58:50.390 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:50.396 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:50.396 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:50.771 INFO:teuthology.orchestra.run.smithi046.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:58:50.775 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/250 2023-05-21T18:58:50.775 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/250 2023-05-21T18:58:50.775 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:50.780 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:50.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:50.817 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-05-21T18:58:51.212 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:51.219 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:51.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:51.516 INFO:teuthology.orchestra.run.smithi046.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:58:51.524 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/251 2023-05-21T18:58:51.524 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/251 2023-05-21T18:58:51.524 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:51.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:51.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:51.546 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-05-21T18:58:51.985 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:51.991 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:51.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:52.318 INFO:teuthology.orchestra.run.smithi046.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:58:52.328 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/252 2023-05-21T18:58:52.328 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/252 2023-05-21T18:58:52.328 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:52.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:52.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-05-21T18:58:52.761 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:52.773 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:52.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:53.042 INFO:teuthology.orchestra.run.smithi046.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:58:53.048 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/253 2023-05-21T18:58:53.049 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/253 2023-05-21T18:58:53.049 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:53.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:53.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:53.074 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-05-21T18:58:53.507 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:53.525 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:53.807 INFO:teuthology.orchestra.run.smithi046.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:58:53.816 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/254 2023-05-21T18:58:53.817 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/254 2023-05-21T18:58:53.817 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:53.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:53.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:53.852 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-05-21T18:58:54.282 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:54.294 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:54.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:56.207 INFO:teuthology.orchestra.run.smithi046.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T18:58:56.215 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/255 2023-05-21T18:58:56.215 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/255 2023-05-21T18:58:56.215 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:56.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:56.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:56.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-05-21T18:58:57.129 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:57.149 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:57.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:58.821 INFO:teuthology.orchestra.run.smithi046.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:58:58.835 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/256 2023-05-21T18:58:58.835 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/256 2023-05-21T18:58:58.835 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:58:58.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:58:58.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:58:58.869 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-05-21T18:58:59.273 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:58:59.292 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:58:59.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:02.238 INFO:teuthology.orchestra.run.smithi046.stdout:generic/257 3s 2023-05-21T18:59:02.252 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/257 2023-05-21T18:59:02.252 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:59:02.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:02.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:59:02.278 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-05-21T18:59:03.066 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:59:03.079 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:59:03.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:03.473 INFO:teuthology.orchestra.run.smithi046.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/258.out.bad) 2023-05-21T18:59:03.489 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/258.out 2023-05-21 16:55:34.847774854 +0000 2023-05-21T18:59:03.489 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/258.out.bad 2023-05-21 18:59:03.461517292 +0000 2023-05-21T18:59:03.490 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,6 @@ 2023-05-21T18:59:03.490 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 258 2023-05-21T18:59:03.490 INFO:teuthology.orchestra.run.smithi046.stdout: Creating file with timestamp of Jan 1, 1960 2023-05-21T18:59:03.490 INFO:teuthology.orchestra.run.smithi046.stdout: Testing for negative seconds since epoch 2023-05-21T18:59:03.490 INFO:teuthology.orchestra.run.smithi046.stdout: -Remounting to flush cache 2023-05-21T18:59:03.490 INFO:teuthology.orchestra.run.smithi046.stdout: -Testing for negative seconds since epoch 2023-05-21T18:59:03.491 INFO:teuthology.orchestra.run.smithi046.stdout: +Timestamp wrapped: 3979351756 2023-05-21T18:59:03.491 INFO:teuthology.orchestra.run.smithi046.stdout: +Timestamp wrapped 2023-05-21T18:59:03.491 INFO:teuthology.orchestra.run.smithi046.stdout: +(see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/258.full for details) 2023-05-21T18:59:03.495 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/258 2023-05-21T18:59:03.495 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/258 2023-05-21T18:59:03.495 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T18:59:03.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:03.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T18:59:03.561 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T18:59:03.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T18:59:03.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-05-21T18:59:03.983 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:59:04.002 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:59:04.003 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:04.263 INFO:teuthology.orchestra.run.smithi046.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:59:04.273 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/259 2023-05-21T18:59:04.273 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/259 2023-05-21T18:59:04.274 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:59:04.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:04.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:59:04.299 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-05-21T18:59:04.804 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:59:04.816 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:59:04.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:05.169 INFO:teuthology.orchestra.run.smithi046.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:59:05.173 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/260 2023-05-21T18:59:05.173 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/260 2023-05-21T18:59:05.174 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:59:05.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:05.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:59:05.202 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-05-21T18:59:05.644 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:59:05.649 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:59:05.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:05.931 INFO:teuthology.orchestra.run.smithi046.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:59:05.939 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/261 2023-05-21T18:59:05.940 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/261 2023-05-21T18:59:05.940 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:59:05.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:05.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:59:05.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-05-21T18:59:06.364 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:59:06.371 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:59:06.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:06.645 INFO:teuthology.orchestra.run.smithi046.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T18:59:06.665 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/262 2023-05-21T18:59:06.665 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/262 2023-05-21T18:59:06.665 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T18:59:06.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T18:59:06.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T18:59:06.704 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-05-21T18:59:07.100 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T18:59:07.117 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T18:59:07.118 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:17.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:00:17.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:00:18.018 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T19:00:18.008+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41605) UID: 0 2023-05-21T19:00:18.018 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T19:00:18.008+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41605) UID: 0 2023-05-21T19:00:18.019 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T19:00:18.008+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41605) UID: 0 2023-05-21T19:00:18.019 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T19:00:18.008+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41605) UID: 0 2023-05-21T19:00:49.568 INFO:teuthology.orchestra.run.smithi046.stdout:generic/263 102s 2023-05-21T19:00:49.581 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/263 2023-05-21T19:00:49.581 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:49.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:49.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:49.638 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-05-21T19:00:50.315 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:50.323 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:50.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:50.622 INFO:teuthology.orchestra.run.smithi046.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:50.632 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/264 2023-05-21T19:00:50.633 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/264 2023-05-21T19:00:50.633 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:50.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:50.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:50.655 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-05-21T19:00:50.970 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:50.979 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:50.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:51.333 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/265 2023-05-21T19:00:51.333 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/265 2023-05-21T19:00:51.333 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:51.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:51.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:51.357 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-05-21T19:00:51.674 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:51.683 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:51.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:51.995 INFO:teuthology.orchestra.run.smithi046.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:52.002 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/266 2023-05-21T19:00:52.003 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/266 2023-05-21T19:00:52.003 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:52.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:52.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:52.026 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-05-21T19:00:52.350 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:52.360 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:52.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:52.669 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/267 2023-05-21T19:00:52.669 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/267 2023-05-21T19:00:52.669 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:52.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:52.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:52.693 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-05-21T19:00:53.010 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:53.019 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:53.019 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:53.315 INFO:teuthology.orchestra.run.smithi046.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:53.325 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/268 2023-05-21T19:00:53.325 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/268 2023-05-21T19:00:53.325 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:53.330 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:53.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:53.354 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-05-21T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:53.681 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:53.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:53.938 INFO:teuthology.orchestra.run.smithi046.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:53.947 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/269 2023-05-21T19:00:53.947 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/269 2023-05-21T19:00:53.947 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:53.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:53.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:53.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-05-21T19:00:54.288 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:54.298 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:54.298 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:54.558 INFO:teuthology.orchestra.run.smithi046.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-21T19:00:54.566 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/270 2023-05-21T19:00:54.566 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/270 2023-05-21T19:00:54.566 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:54.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:54.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:54.590 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-05-21T19:00:54.909 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:54.919 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:54.919 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:55.201 INFO:teuthology.orchestra.run.smithi046.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:55.211 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/271 2023-05-21T19:00:55.211 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/271 2023-05-21T19:00:55.211 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:55.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:55.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:55.234 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-05-21T19:00:55.552 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:55.561 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:55.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:55.850 INFO:teuthology.orchestra.run.smithi046.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:55.859 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/272 2023-05-21T19:00:55.860 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/272 2023-05-21T19:00:55.860 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:55.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:55.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:55.883 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-05-21T19:00:56.203 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:56.212 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:56.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:56.473 INFO:teuthology.orchestra.run.smithi046.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:56.481 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/273 2023-05-21T19:00:56.482 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/273 2023-05-21T19:00:56.482 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:56.487 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:56.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:56.507 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-05-21T19:00:56.815 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:56.825 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:56.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:57.078 INFO:teuthology.orchestra.run.smithi046.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:57.086 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/274 2023-05-21T19:00:57.087 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/274 2023-05-21T19:00:57.087 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:57.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:57.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:57.111 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-05-21T19:00:57.428 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:57.438 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:57.438 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:57.710 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/275 2023-05-21T19:00:57.710 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/275 2023-05-21T19:00:57.713 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:57.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:57.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:57.758 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-05-21T19:00:58.087 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:58.095 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:58.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:58.382 INFO:teuthology.orchestra.run.smithi046.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:58.390 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/276 2023-05-21T19:00:58.391 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/276 2023-05-21T19:00:58.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:58.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:58.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:58.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-05-21T19:00:58.730 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:58.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:59.017 INFO:teuthology.orchestra.run.smithi046.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/277 2023-05-21T19:00:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/277 2023-05-21T19:00:59.027 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:59.033 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:59.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:59.051 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-05-21T19:00:59.369 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:00:59.378 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:00:59.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:59.666 INFO:teuthology.orchestra.run.smithi046.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:00:59.676 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/278 2023-05-21T19:00:59.676 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/278 2023-05-21T19:00:59.677 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:00:59.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:00:59.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:00:59.701 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-05-21T19:01:00.019 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:00.028 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:00.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:00.310 INFO:teuthology.orchestra.run.smithi046.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:01:00.318 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/279 2023-05-21T19:01:00.319 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/279 2023-05-21T19:01:00.319 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:00.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:00.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:00.342 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-05-21T19:01:00.661 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:00.670 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:00.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:00.964 INFO:teuthology.orchestra.run.smithi046.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:01:00.974 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/280 2023-05-21T19:01:00.974 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/280 2023-05-21T19:01:00.974 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:00.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:00.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:00.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-05-21T19:01:01.316 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:01.324 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:01.325 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:01.611 INFO:teuthology.orchestra.run.smithi046.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:01:01.621 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/281 2023-05-21T19:01:01.622 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/281 2023-05-21T19:01:01.622 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:01.627 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:01.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:01.645 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-05-21T19:01:01.962 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:01.972 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:01.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:02.261 INFO:teuthology.orchestra.run.smithi046.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:01:02.270 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/282 2023-05-21T19:01:02.278 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/282 2023-05-21T19:01:02.279 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:02.279 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:02.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:02.296 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-05-21T19:01:02.611 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:02.620 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:02.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:02.918 INFO:teuthology.orchestra.run.smithi046.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:01:02.927 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/283 2023-05-21T19:01:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/283 2023-05-21T19:01:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:02.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:02.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:02.956 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-05-21T19:01:03.270 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:03.280 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:03.280 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:03.547 INFO:teuthology.orchestra.run.smithi046.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:01:03.555 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/284 2023-05-21T19:01:03.555 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/284 2023-05-21T19:01:03.555 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:03.560 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:03.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:03.582 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-05-21T19:01:03.905 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:03.915 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:03.915 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:06.803 INFO:teuthology.orchestra.run.smithi046.stdout:generic/285 3s 2023-05-21T19:01:06.813 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/285 2023-05-21T19:01:06.814 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:01:06.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:01:06.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:01:06.843 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-05-21T19:01:07.555 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:01:07.564 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:01:07.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:24.503 INFO:teuthology.orchestra.run.smithi046.stdout:generic/286 77s 2023-05-21T19:02:24.545 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/286 2023-05-21T19:02:24.545 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:24.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:24.649 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-05-21T19:02:25.856 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:25.866 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:25.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:26.193 INFO:teuthology.orchestra.run.smithi046.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:26.205 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/287 2023-05-21T19:02:26.205 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/287 2023-05-21T19:02:26.205 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:26.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:26.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:26.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-05-21T19:02:26.539 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:26.548 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:26.813 INFO:teuthology.orchestra.run.smithi046.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:26.820 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/288 2023-05-21T19:02:26.821 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/288 2023-05-21T19:02:26.821 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:26.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:26.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:26.844 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-05-21T19:02:27.164 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:27.172 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:27.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:27.440 INFO:teuthology.orchestra.run.smithi046.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:27.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/289 2023-05-21T19:02:27.449 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/289 2023-05-21T19:02:27.449 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:27.455 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:27.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:27.473 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-05-21T19:02:27.789 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:27.798 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:27.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:28.059 INFO:teuthology.orchestra.run.smithi046.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:28.068 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/290 2023-05-21T19:02:28.068 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/290 2023-05-21T19:02:28.068 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:28.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:28.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:28.092 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-05-21T19:02:28.416 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:28.427 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:28.427 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:28.685 INFO:teuthology.orchestra.run.smithi046.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:28.693 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/291 2023-05-21T19:02:28.694 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/291 2023-05-21T19:02:28.694 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:28.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:28.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:28.717 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-05-21T19:02:29.033 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:29.042 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:29.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:29.315 INFO:teuthology.orchestra.run.smithi046.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:29.324 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/292 2023-05-21T19:02:29.325 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/292 2023-05-21T19:02:29.325 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:29.330 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:29.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:29.348 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-05-21T19:02:29.658 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:29.665 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:29.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:02:29.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:02:29.934 INFO:teuthology.orchestra.run.smithi046.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:29.942 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/293 2023-05-21T19:02:29.943 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/293 2023-05-21T19:02:29.943 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:29.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:29.965 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-05-21T19:02:30.294 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:30.303 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:30.562 INFO:teuthology.orchestra.run.smithi046.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:30.570 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/294 2023-05-21T19:02:30.570 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/294 2023-05-21T19:02:30.571 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:30.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:30.595 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-05-21T19:02:30.909 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:30.918 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:30.919 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:31.188 INFO:teuthology.orchestra.run.smithi046.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:31.196 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/295 2023-05-21T19:02:31.197 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/295 2023-05-21T19:02:31.197 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:31.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:31.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:31.220 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-05-21T19:02:31.548 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:31.559 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:31.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:31.823 INFO:teuthology.orchestra.run.smithi046.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:31.831 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/296 2023-05-21T19:02:31.832 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/296 2023-05-21T19:02:31.832 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:31.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:31.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:31.857 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-05-21T19:02:32.175 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:32.185 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:32.185 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:32.454 INFO:teuthology.orchestra.run.smithi046.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:32.462 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/297 2023-05-21T19:02:32.462 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/297 2023-05-21T19:02:32.462 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:32.468 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:32.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:32.486 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-05-21T19:02:32.811 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:32.821 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:32.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:33.346 INFO:teuthology.orchestra.run.smithi046.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:33.354 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/298 2023-05-21T19:02:33.354 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/298 2023-05-21T19:02:33.354 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:33.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:33.377 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-05-21T19:02:33.696 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:33.705 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:33.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:34.030 INFO:teuthology.orchestra.run.smithi046.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:34.039 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/299 2023-05-21T19:02:34.040 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/299 2023-05-21T19:02:34.040 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:34.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:34.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:34.065 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-05-21T19:02:34.381 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:34.390 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:34.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:34.638 INFO:teuthology.orchestra.run.smithi046.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:34.645 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/300 2023-05-21T19:02:34.646 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/300 2023-05-21T19:02:34.646 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:34.651 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:34.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:34.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-05-21T19:02:34.989 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:34.997 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:34.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:35.259 INFO:teuthology.orchestra.run.smithi046.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:35.268 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/301 2023-05-21T19:02:35.268 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/301 2023-05-21T19:02:35.269 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:35.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:35.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:35.292 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-05-21T19:02:35.608 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:35.618 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:35.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/302 2023-05-21T19:02:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/302 2023-05-21T19:02:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:35.897 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:35.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:35.917 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-05-21T19:02:36.235 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:36.245 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:36.245 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:36.609 INFO:teuthology.orchestra.run.smithi046.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T19:02:36.617 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/303 2023-05-21T19:02:36.617 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/303 2023-05-21T19:02:36.617 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:36.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:36.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:36.640 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-05-21T19:02:37.365 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:37.373 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:37.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:37.749 INFO:teuthology.orchestra.run.smithi046.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T19:02:37.756 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/304 2023-05-21T19:02:37.756 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/304 2023-05-21T19:02:37.756 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:37.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:37.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:37.779 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-05-21T19:02:38.517 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:38.524 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:38.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:38.779 INFO:teuthology.orchestra.run.smithi046.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:38.788 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/305 2023-05-21T19:02:38.788 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/305 2023-05-21T19:02:38.788 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:38.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:38.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:38.810 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-05-21T19:02:39.136 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:39.146 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:39.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:39.408 INFO:teuthology.orchestra.run.smithi046.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:39.416 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/306 2023-05-21T19:02:39.416 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/306 2023-05-21T19:02:39.416 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:39.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:39.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:39.440 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-05-21T19:02:39.755 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:39.764 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:39.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:40.028 INFO:teuthology.orchestra.run.smithi046.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:02:40.036 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/307 2023-05-21T19:02:40.037 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/307 2023-05-21T19:02:40.037 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:40.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:40.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:40.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-05-21T19:02:40.378 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:40.387 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:40.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:40.712 INFO:teuthology.orchestra.run.smithi046.stdout:generic/308 0s 2023-05-21T19:02:40.725 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/308 2023-05-21T19:02:40.726 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:40.732 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:40.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:40.750 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-05-21T19:02:41.062 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:41.071 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:41.071 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:42.485 INFO:teuthology.orchestra.run.smithi046.stdout:generic/309 1s 2023-05-21T19:02:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/309 2023-05-21T19:02:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:02:42.504 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:42.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:02:42.522 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-05-21T19:02:43.204 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:02:43.214 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:02:43.214 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:02:59.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:02:59.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:03:29.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:03:29.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:03:59.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:03:59.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:04:22.370 INFO:teuthology.orchestra.run.smithi046.stdout:generic/310 99s 2023-05-21T19:04:22.387 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/310 2023-05-21T19:04:22.387 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:22.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:22.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:22.482 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-05-21T19:04:23.285 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:23.382 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:23.702 INFO:teuthology.orchestra.run.smithi046.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:23.710 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/311 2023-05-21T19:04:23.710 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/311 2023-05-21T19:04:23.711 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:23.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:23.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:23.736 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-05-21T19:04:24.047 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:24.056 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:24.370 INFO:teuthology.orchestra.run.smithi046.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:24.377 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/312 2023-05-21T19:04:24.378 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/312 2023-05-21T19:04:24.378 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:24.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:24.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:24.401 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-05-21T19:04:24.719 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:24.729 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:29.135 INFO:teuthology.orchestra.run.smithi046.stdout:generic/313 5s 2023-05-21T19:04:29.147 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/313 2023-05-21T19:04:29.147 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:29.152 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:29.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:29.172 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-05-21T19:04:29.489 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:29.497 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:30.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:04:30.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:04:30.207 INFO:teuthology.orchestra.run.smithi046.stdout:generic/314 1s 2023-05-21T19:04:30.218 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/314 2023-05-21T19:04:30.218 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:30.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:30.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-05-21T19:04:30.536 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:30.546 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:33.846 INFO:teuthology.orchestra.run.smithi046.stdout:generic/315 3s 2023-05-21T19:04:33.858 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/315 2023-05-21T19:04:33.858 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:33.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:33.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:33.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-05-21T19:04:34.558 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:34.566 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:34.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:36.543 INFO:teuthology.orchestra.run.smithi046.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T19:04:36.551 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/316 2023-05-21T19:04:36.552 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/316 2023-05-21T19:04:36.552 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:36.557 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:36.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:36.575 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-05-21T19:04:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:37.275 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:37.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:37.539 INFO:teuthology.orchestra.run.smithi046.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:37.548 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/317 2023-05-21T19:04:37.548 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/317 2023-05-21T19:04:37.548 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:37.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:37.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:37.571 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-05-21T19:04:37.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:37.896 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:37.896 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:38.165 INFO:teuthology.orchestra.run.smithi046.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:38.170 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/318 2023-05-21T19:04:38.170 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/318 2023-05-21T19:04:38.170 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:38.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:38.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:38.192 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-05-21T19:04:38.511 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:38.520 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:38.520 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:38.829 INFO:teuthology.orchestra.run.smithi046.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T19:04:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/319 2023-05-21T19:04:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/319 2023-05-21T19:04:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:38.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:38.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:38.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-05-21T19:04:39.176 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:39.185 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:39.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:39.449 INFO:teuthology.orchestra.run.smithi046.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:39.457 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/320 2023-05-21T19:04:39.457 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/320 2023-05-21T19:04:39.457 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:39.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:39.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:39.484 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-05-21T19:04:39.808 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:39.817 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:39.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:40.135 INFO:teuthology.orchestra.run.smithi046.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:40.144 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/321 2023-05-21T19:04:40.145 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/321 2023-05-21T19:04:40.145 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:40.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:40.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:40.170 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-05-21T19:04:40.461 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:40.471 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:40.471 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:40.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:04:40.759 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/322 2023-05-21T19:04:40.760 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/322 2023-05-21T19:04:40.760 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:04:40.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:04:40.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:04:40.785 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-05-21T19:04:41.101 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:04:41.110 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:04:41.110 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:05:00.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:05:00.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:05:30.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:05:30.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:06:00.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:06:00.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:06:30.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:06:30.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:06:43.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/323 122s 2023-05-21T19:06:43.088 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/323 2023-05-21T19:06:43.089 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:43.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:43.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:43.238 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-05-21T19:06:43.836 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:43.845 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:43.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:44.148 INFO:teuthology.orchestra.run.smithi046.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:44.156 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/324 2023-05-21T19:06:44.156 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/324 2023-05-21T19:06:44.156 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:44.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:44.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:44.178 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-05-21T19:06:44.494 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:44.503 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:44.504 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:44.857 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/325 2023-05-21T19:06:44.857 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/325 2023-05-21T19:06:44.857 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:44.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:44.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:44.884 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-05-21T19:06:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:45.226 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:45.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:45.506 INFO:teuthology.orchestra.run.smithi046.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:45.514 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/326 2023-05-21T19:06:45.514 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/326 2023-05-21T19:06:45.515 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:45.520 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:45.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:45.537 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-05-21T19:06:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:45.867 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:45.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:46.135 INFO:teuthology.orchestra.run.smithi046.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:46.213 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/327 2023-05-21T19:06:46.213 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/327 2023-05-21T19:06:46.213 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:46.213 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:46.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:46.214 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-05-21T19:06:46.547 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:46.557 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:46.558 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:46.821 INFO:teuthology.orchestra.run.smithi046.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/328 2023-05-21T19:06:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/328 2023-05-21T19:06:46.830 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:46.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:46.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-05-21T19:06:47.169 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:47.179 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:47.482 INFO:teuthology.orchestra.run.smithi046.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:47.493 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/329 2023-05-21T19:06:47.493 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/329 2023-05-21T19:06:47.493 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:47.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:47.515 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-05-21T19:06:47.832 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:48.112 INFO:teuthology.orchestra.run.smithi046.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/330 2023-05-21T19:06:48.120 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/330 2023-05-21T19:06:48.121 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:48.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:48.144 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-05-21T19:06:48.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:48.461 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:48.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:48.746 INFO:teuthology.orchestra.run.smithi046.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:48.755 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/331 2023-05-21T19:06:48.756 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/331 2023-05-21T19:06:48.756 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:48.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:48.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:48.780 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-05-21T19:06:49.096 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:49.105 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:49.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:49.373 INFO:teuthology.orchestra.run.smithi046.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:49.382 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/332 2023-05-21T19:06:49.383 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/332 2023-05-21T19:06:49.383 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:49.388 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:49.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:49.417 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-05-21T19:06:49.731 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:49.740 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:49.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:50.001 INFO:teuthology.orchestra.run.smithi046.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:50.009 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/333 2023-05-21T19:06:50.010 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/333 2023-05-21T19:06:50.010 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:50.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:50.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:50.032 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-05-21T19:06:50.333 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:50.342 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:50.342 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:50.607 INFO:teuthology.orchestra.run.smithi046.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:50.615 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/334 2023-05-21T19:06:50.615 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/334 2023-05-21T19:06:50.615 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:50.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:50.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:50.639 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-05-21T19:06:50.956 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:50.966 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:50.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:51.269 INFO:teuthology.orchestra.run.smithi046.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:51.278 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/335 2023-05-21T19:06:51.278 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/335 2023-05-21T19:06:51.279 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:51.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:51.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:51.304 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-05-21T19:06:51.633 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:51.642 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:51.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:51.924 INFO:teuthology.orchestra.run.smithi046.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:51.931 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/336 2023-05-21T19:06:51.931 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/336 2023-05-21T19:06:51.931 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:51.936 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:51.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:51.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-05-21T19:06:52.275 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:52.284 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:52.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:52.547 INFO:teuthology.orchestra.run.smithi046.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:52.556 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/337 2023-05-21T19:06:52.556 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/337 2023-05-21T19:06:52.557 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:52.562 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:52.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:52.580 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-05-21T19:06:52.898 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:52.906 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:52.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:53.202 INFO:teuthology.orchestra.run.smithi046.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:53.212 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/338 2023-05-21T19:06:53.212 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/338 2023-05-21T19:06:53.212 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:53.218 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:53.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:53.239 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-05-21T19:06:53.566 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:53.575 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:53.575 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:53.832 INFO:teuthology.orchestra.run.smithi046.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:53.841 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/339 2023-05-21T19:06:53.841 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/339 2023-05-21T19:06:53.841 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:53.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:53.864 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-05-21T19:06:54.178 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:54.188 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:54.188 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:54.440 INFO:teuthology.orchestra.run.smithi046.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/340 2023-05-21T19:06:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/340 2023-05-21T19:06:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:54.455 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:54.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:54.472 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-05-21T19:06:54.792 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:54.801 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:54.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:55.105 INFO:teuthology.orchestra.run.smithi046.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:55.114 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/341 2023-05-21T19:06:55.115 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/341 2023-05-21T19:06:55.115 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:55.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:55.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:55.139 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-05-21T19:06:55.465 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:55.475 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:55.475 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:55.764 INFO:teuthology.orchestra.run.smithi046.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:55.773 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/342 2023-05-21T19:06:55.774 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/342 2023-05-21T19:06:55.774 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:55.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:55.801 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-05-21T19:06:56.135 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:56.145 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:56.145 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:56.436 INFO:teuthology.orchestra.run.smithi046.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:56.446 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/343 2023-05-21T19:06:56.446 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/343 2023-05-21T19:06:56.447 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:56.451 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:56.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:56.471 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-05-21T19:06:56.785 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:56.794 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:56.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:57.056 INFO:teuthology.orchestra.run.smithi046.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:57.064 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/344 2023-05-21T19:06:57.064 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/344 2023-05-21T19:06:57.064 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:57.070 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:57.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:57.088 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-05-21T19:06:57.403 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:57.413 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:57.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:57.673 INFO:teuthology.orchestra.run.smithi046.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:57.682 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/345 2023-05-21T19:06:57.683 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/345 2023-05-21T19:06:57.683 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:57.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:57.707 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-05-21T19:06:58.014 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:58.024 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:58.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:58.286 INFO:teuthology.orchestra.run.smithi046.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:58.294 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/346 2023-05-21T19:06:58.295 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/346 2023-05-21T19:06:58.295 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:58.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:58.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:58.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-05-21T19:06:58.625 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:58.634 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:58.635 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:59.011 INFO:teuthology.orchestra.run.smithi046.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:59.020 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/347 2023-05-21T19:06:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/347 2023-05-21T19:06:59.021 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:59.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:59.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:59.044 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-05-21T19:06:59.353 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:06:59.361 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:06:59.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:59.643 INFO:teuthology.orchestra.run.smithi046.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:06:59.652 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/348 2023-05-21T19:06:59.652 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/348 2023-05-21T19:06:59.652 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:06:59.657 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:06:59.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:06:59.675 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-05-21T19:06:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:00.050 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:00.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:00.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:07:00.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:07:02.008 INFO:teuthology.orchestra.run.smithi046.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-21T19:07:02.016 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/349 2023-05-21T19:07:02.016 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/349 2023-05-21T19:07:02.017 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:02.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:02.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:02.040 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-05-21T19:07:02.356 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:02.365 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:02.366 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:05.486 INFO:teuthology.orchestra.run.smithi046.stdout:generic/350 3s 2023-05-21T19:07:05.497 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/350 2023-05-21T19:07:05.497 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:05.502 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:05.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:05.518 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-05-21T19:07:05.843 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:05.853 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:05.853 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:07.740 INFO:teuthology.orchestra.run.smithi046.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-21T19:07:07.747 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/351 2023-05-21T19:07:07.748 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/351 2023-05-21T19:07:07.748 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:07.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:07.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:07.776 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-05-21T19:07:08.469 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:08.479 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:08.479 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:08.761 INFO:teuthology.orchestra.run.smithi046.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:08.770 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/352 2023-05-21T19:07:08.770 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/352 2023-05-21T19:07:08.770 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:08.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:08.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:08.793 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-05-21T19:07:09.099 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:09.108 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:09.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:09.371 INFO:teuthology.orchestra.run.smithi046.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:09.379 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/353 2023-05-21T19:07:09.380 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/353 2023-05-21T19:07:09.380 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:09.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:09.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:09.404 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-05-21T19:07:09.726 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:09.736 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:09.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:09.988 INFO:teuthology.orchestra.run.smithi046.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:09.996 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/354 2023-05-21T19:07:09.997 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/354 2023-05-21T19:07:09.997 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:10.002 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:10.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:10.020 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-05-21T19:07:10.336 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:10.345 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:10.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:11.224 INFO:teuthology.orchestra.run.smithi046.stdout:generic/355 1s 2023-05-21T19:07:11.236 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/355 2023-05-21T19:07:11.237 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:11.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:11.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:11.259 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-05-21T19:07:11.968 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:11.977 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:11.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:12.244 INFO:teuthology.orchestra.run.smithi046.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:12.252 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/356 2023-05-21T19:07:12.253 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/356 2023-05-21T19:07:12.253 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:12.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:12.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:12.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-05-21T19:07:12.595 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:12.604 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:12.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:12.866 INFO:teuthology.orchestra.run.smithi046.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:12.874 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/357 2023-05-21T19:07:12.874 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/357 2023-05-21T19:07:12.875 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:12.880 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:12.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:12.897 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-05-21T19:07:13.214 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:13.222 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:13.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:13.480 INFO:teuthology.orchestra.run.smithi046.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:13.488 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/358 2023-05-21T19:07:13.489 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/358 2023-05-21T19:07:13.489 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:13.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:13.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:13.513 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-05-21T19:07:13.824 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:13.833 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:13.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:14.100 INFO:teuthology.orchestra.run.smithi046.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:14.109 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/359 2023-05-21T19:07:14.109 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/359 2023-05-21T19:07:14.109 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:14.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:14.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:14.134 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-05-21T19:07:14.451 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:14.462 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:14.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:generic/360 0s 2023-05-21T19:07:14.867 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/360 2023-05-21T19:07:14.867 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:14.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:14.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:14.889 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-05-21T19:07:15.204 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:15.212 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:15.212 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:15.502 INFO:teuthology.orchestra.run.smithi046.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:15.511 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/361 2023-05-21T19:07:15.511 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/361 2023-05-21T19:07:15.512 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:15.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:15.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:15.535 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-05-21T19:07:15.861 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:15.870 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:15.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:16.130 INFO:teuthology.orchestra.run.smithi046.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:16.139 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/362 2023-05-21T19:07:16.139 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/362 2023-05-21T19:07:16.139 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:16.145 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:16.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:16.163 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-05-21T19:07:16.488 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:16.498 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:16.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:16.757 INFO:teuthology.orchestra.run.smithi046.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:16.766 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/363 2023-05-21T19:07:16.766 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/363 2023-05-21T19:07:16.766 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:16.772 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:16.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:16.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-05-21T19:07:17.105 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:17.115 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:17.376 INFO:teuthology.orchestra.run.smithi046.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:17.384 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/364 2023-05-21T19:07:17.384 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/364 2023-05-21T19:07:17.384 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:17.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:17.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:17.408 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-05-21T19:07:17.725 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:17.734 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:17.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:17.995 INFO:teuthology.orchestra.run.smithi046.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:18.003 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/365 2023-05-21T19:07:18.003 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/365 2023-05-21T19:07:18.003 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:18.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:18.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-05-21T19:07:18.340 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:18.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:18.599 INFO:teuthology.orchestra.run.smithi046.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:18.608 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/366 2023-05-21T19:07:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/366 2023-05-21T19:07:18.609 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:18.614 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:18.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:18.633 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-05-21T19:07:18.961 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:18.969 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:18.970 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:19.223 INFO:teuthology.orchestra.run.smithi046.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:19.232 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/367 2023-05-21T19:07:19.232 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/367 2023-05-21T19:07:19.233 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:19.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:19.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:19.256 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-05-21T19:07:19.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:19.587 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:19.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:19.836 INFO:teuthology.orchestra.run.smithi046.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:19.844 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/368 2023-05-21T19:07:19.844 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/368 2023-05-21T19:07:19.845 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:19.850 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:19.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:19.867 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-05-21T19:07:20.179 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:20.189 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:20.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:20.450 INFO:teuthology.orchestra.run.smithi046.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:20.458 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/369 2023-05-21T19:07:20.458 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/369 2023-05-21T19:07:20.459 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:20.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:20.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:20.481 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-05-21T19:07:20.797 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:20.807 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:20.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:21.064 INFO:teuthology.orchestra.run.smithi046.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:21.075 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/370 2023-05-21T19:07:21.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/370 2023-05-21T19:07:21.076 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:21.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:21.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:21.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-05-21T19:07:21.421 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:21.430 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:21.430 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:21.698 INFO:teuthology.orchestra.run.smithi046.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:21.707 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/371 2023-05-21T19:07:21.707 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/371 2023-05-21T19:07:21.707 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:21.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:21.730 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-05-21T19:07:22.043 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:22.053 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:22.314 INFO:teuthology.orchestra.run.smithi046.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:22.323 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/372 2023-05-21T19:07:22.323 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/372 2023-05-21T19:07:22.323 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:22.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:22.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:22.346 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-05-21T19:07:22.668 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:22.678 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:22.936 INFO:teuthology.orchestra.run.smithi046.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:22.944 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/373 2023-05-21T19:07:22.944 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/373 2023-05-21T19:07:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:22.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:22.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:22.967 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-05-21T19:07:23.284 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:23.294 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:23.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:23.553 INFO:teuthology.orchestra.run.smithi046.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:23.561 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/374 2023-05-21T19:07:23.561 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/374 2023-05-21T19:07:23.561 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:23.567 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:23.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:23.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-05-21T19:07:23.911 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:23.921 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:23.921 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:24.267 INFO:teuthology.orchestra.run.smithi046.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T19:07:24.276 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/375 2023-05-21T19:07:24.276 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/375 2023-05-21T19:07:24.277 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:24.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:24.292 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-05-21T19:07:24.619 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:24.627 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:24.937 INFO:teuthology.orchestra.run.smithi046.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:24.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/376 2023-05-21T19:07:24.945 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/376 2023-05-21T19:07:24.945 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:24.951 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:24.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:24.969 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-05-21T19:07:25.282 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:25.291 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:25.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:25.560 INFO:teuthology.orchestra.run.smithi046.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:25.568 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/377 2023-05-21T19:07:25.568 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/377 2023-05-21T19:07:25.568 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:25.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:25.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:25.593 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-05-21T19:07:25.907 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:25.917 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:25.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:26.429 INFO:teuthology.orchestra.run.smithi046.stdout:generic/378 1s 2023-05-21T19:07:26.440 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/378 2023-05-21T19:07:26.440 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:26.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:26.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:26.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-05-21T19:07:27.120 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:27.130 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:27.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:27.407 INFO:teuthology.orchestra.run.smithi046.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:27.416 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/379 2023-05-21T19:07:27.416 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/379 2023-05-21T19:07:27.416 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:27.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:27.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:27.439 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-05-21T19:07:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:27.757 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:27.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:28.025 INFO:teuthology.orchestra.run.smithi046.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:28.034 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/380 2023-05-21T19:07:28.034 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/380 2023-05-21T19:07:28.034 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:28.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:28.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:28.057 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-05-21T19:07:28.363 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:28.372 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:28.373 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:28.633 INFO:teuthology.orchestra.run.smithi046.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:28.641 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/381 2023-05-21T19:07:28.642 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/381 2023-05-21T19:07:28.642 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:28.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:28.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:28.666 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-05-21T19:07:28.981 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:28.991 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:28.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:29.252 INFO:teuthology.orchestra.run.smithi046.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:29.261 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/382 2023-05-21T19:07:29.262 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/382 2023-05-21T19:07:29.262 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:29.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:29.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:29.285 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-05-21T19:07:29.613 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:29.623 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:29.885 INFO:teuthology.orchestra.run.smithi046.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:29.893 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/383 2023-05-21T19:07:29.894 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/383 2023-05-21T19:07:29.894 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:29.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:29.918 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-05-21T19:07:30.230 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:30.239 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:30.513 INFO:teuthology.orchestra.run.smithi046.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-21T19:07:30.533 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/384 2023-05-21T19:07:30.533 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/384 2023-05-21T19:07:30.533 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:30.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:30.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-05-21T19:07:30.869 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:30.878 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:31.145 INFO:teuthology.orchestra.run.smithi046.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:31.155 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/385 2023-05-21T19:07:31.155 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/385 2023-05-21T19:07:31.155 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:31.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:31.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:31.178 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-05-21T19:07:31.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:07:31.262 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:07:31.495 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:31.504 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:31.769 INFO:teuthology.orchestra.run.smithi046.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-21T19:07:31.777 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/386 2023-05-21T19:07:31.777 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/386 2023-05-21T19:07:31.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:31.782 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:31.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:31.798 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-05-21T19:07:32.104 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:32.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:32.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:32.377 INFO:teuthology.orchestra.run.smithi046.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:32.386 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/387 2023-05-21T19:07:32.387 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/387 2023-05-21T19:07:32.387 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:32.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:32.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:32.411 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-05-21T19:07:32.735 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:32.744 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:32.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:33.017 INFO:teuthology.orchestra.run.smithi046.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:33.026 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/388 2023-05-21T19:07:33.026 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/388 2023-05-21T19:07:33.026 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:33.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:33.050 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-05-21T19:07:33.373 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:33.383 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:33.669 INFO:teuthology.orchestra.run.smithi046.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-05-21T19:07:33.679 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/389 2023-05-21T19:07:33.679 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/389 2023-05-21T19:07:33.679 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:33.685 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:33.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:33.705 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-05-21T19:07:34.020 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:34.028 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:34.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:34.296 INFO:teuthology.orchestra.run.smithi046.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:07:34.305 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/390 2023-05-21T19:07:34.305 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/390 2023-05-21T19:07:34.305 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:07:34.311 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:07:34.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:07:34.330 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-05-21T19:07:34.647 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:07:34.657 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:07:34.657 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:01.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:08:01.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:08:19.084 INFO:teuthology.orchestra.run.smithi046.stdout:generic/391 45s 2023-05-21T19:08:19.211 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/391 2023-05-21T19:08:19.212 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:19.218 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:19.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:19.268 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-05-21T19:08:20.645 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:20.665 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:20.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:21.060 INFO:teuthology.orchestra.run.smithi046.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:21.065 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/392 2023-05-21T19:08:21.066 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/392 2023-05-21T19:08:21.066 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:21.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:21.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:21.102 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-05-21T19:08:21.527 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:21.542 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:21.542 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:21.852 INFO:teuthology.orchestra.run.smithi046.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:21.858 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/393 2023-05-21T19:08:21.858 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/393 2023-05-21T19:08:21.858 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:21.865 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:21.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:21.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-05-21T19:08:22.253 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:22.265 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:22.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:22.751 INFO:teuthology.orchestra.run.smithi046.stdout:generic/394 0s 2023-05-21T19:08:22.762 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/394 2023-05-21T19:08:22.763 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:22.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:22.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:22.785 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-05-21T19:08:23.620 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:23.630 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:23.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:23.982 INFO:teuthology.orchestra.run.smithi046.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:23.993 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/395 2023-05-21T19:08:23.993 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/395 2023-05-21T19:08:23.994 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:24.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:24.019 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-05-21T19:08:24.446 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:24.463 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:24.858 INFO:teuthology.orchestra.run.smithi046.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/396 2023-05-21T19:08:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/396 2023-05-21T19:08:24.873 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:24.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:24.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:24.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-05-21T19:08:25.319 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:25.324 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:25.746 INFO:teuthology.orchestra.run.smithi046.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:25.753 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/397 2023-05-21T19:08:25.753 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/397 2023-05-21T19:08:25.753 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:25.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:25.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:25.782 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-05-21T19:08:26.099 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:26.109 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:26.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:26.441 INFO:teuthology.orchestra.run.smithi046.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:26.450 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/398 2023-05-21T19:08:26.451 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/398 2023-05-21T19:08:26.451 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:26.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:26.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:26.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-05-21T19:08:26.800 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:26.810 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:26.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:27.144 INFO:teuthology.orchestra.run.smithi046.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:27.153 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/399 2023-05-21T19:08:27.154 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/399 2023-05-21T19:08:27.154 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:27.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:27.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:27.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-05-21T19:08:27.500 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:27.509 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:27.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:27.766 INFO:teuthology.orchestra.run.smithi046.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-21T19:08:27.774 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/400 2023-05-21T19:08:27.775 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/400 2023-05-21T19:08:27.775 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:27.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:27.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:27.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-05-21T19:08:28.118 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:28.127 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:28.128 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:28.394 INFO:teuthology.orchestra.run.smithi046.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:28.403 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/401 2023-05-21T19:08:28.403 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/401 2023-05-21T19:08:28.404 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:28.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:28.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:28.428 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-05-21T19:08:28.756 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:28.765 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:28.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:29.023 INFO:teuthology.orchestra.run.smithi046.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:29.031 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/402 2023-05-21T19:08:29.032 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/402 2023-05-21T19:08:29.032 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:29.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:29.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:29.055 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-05-21T19:08:29.366 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:29.375 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:29.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:29.626 INFO:teuthology.orchestra.run.smithi046.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:29.636 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/403 2023-05-21T19:08:29.636 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/403 2023-05-21T19:08:29.637 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:29.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:29.658 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-05-21T19:08:29.977 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:29.985 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:31.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:08:31.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:08:31.972 INFO:teuthology.orchestra.run.smithi046.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-21T19:08:31.980 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/404 2023-05-21T19:08:31.981 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/404 2023-05-21T19:08:31.981 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:31.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:32.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:32.004 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-05-21T19:08:32.711 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:32.721 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:33.095 INFO:teuthology.orchestra.run.smithi046.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:33.103 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/405 2023-05-21T19:08:33.103 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/405 2023-05-21T19:08:33.103 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:33.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:33.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:33.126 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-05-21T19:08:33.439 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:33.448 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:33.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:33.710 INFO:teuthology.orchestra.run.smithi046.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:33.718 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/406 2023-05-21T19:08:33.718 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/406 2023-05-21T19:08:33.718 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:33.723 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:33.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:33.741 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-05-21T19:08:34.052 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:34.062 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:34.062 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:34.465 INFO:teuthology.orchestra.run.smithi046.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T19:08:34.473 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/407 2023-05-21T19:08:34.474 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/407 2023-05-21T19:08:34.474 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:34.480 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:34.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:34.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-05-21T19:08:35.214 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:35.222 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:35.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:35.588 INFO:teuthology.orchestra.run.smithi046.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T19:08:35.596 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/408 2023-05-21T19:08:35.596 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/408 2023-05-21T19:08:35.596 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:35.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:35.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:35.618 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-05-21T19:08:36.331 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:36.335 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:36.336 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:36.582 INFO:teuthology.orchestra.run.smithi046.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:36.591 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/409 2023-05-21T19:08:36.591 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/409 2023-05-21T19:08:36.591 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:36.596 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:36.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:36.615 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-05-21T19:08:36.939 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:36.948 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:36.948 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:37.212 INFO:teuthology.orchestra.run.smithi046.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:37.221 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/410 2023-05-21T19:08:37.221 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/410 2023-05-21T19:08:37.221 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:37.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:37.288 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-05-21T19:08:37.628 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:37.638 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:37.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:37.913 INFO:teuthology.orchestra.run.smithi046.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:37.921 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/411 2023-05-21T19:08:37.921 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/411 2023-05-21T19:08:37.921 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:37.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:37.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:37.947 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-05-21T19:08:38.268 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:38.277 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:38.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:38.540 INFO:teuthology.orchestra.run.smithi046.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:38.548 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/412 2023-05-21T19:08:38.548 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/412 2023-05-21T19:08:38.549 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:38.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:38.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:38.575 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-05-21T19:08:38.901 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:38.910 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:38.910 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:39.175 INFO:teuthology.orchestra.run.smithi046.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:39.184 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/413 2023-05-21T19:08:39.185 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/413 2023-05-21T19:08:39.185 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:39.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:39.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:39.207 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-05-21T19:08:39.529 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:39.538 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:39.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:39.796 INFO:teuthology.orchestra.run.smithi046.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:39.805 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/414 2023-05-21T19:08:39.805 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/414 2023-05-21T19:08:39.805 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:39.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:39.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:39.829 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-05-21T19:08:40.155 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:40.164 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:40.427 INFO:teuthology.orchestra.run.smithi046.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:40.435 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/415 2023-05-21T19:08:40.435 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/415 2023-05-21T19:08:40.436 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:40.441 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:40.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:40.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-05-21T19:08:40.774 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:40.783 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:40.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:41.041 INFO:teuthology.orchestra.run.smithi046.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:41.049 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/416 2023-05-21T19:08:41.049 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/416 2023-05-21T19:08:41.049 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:41.054 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:41.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:41.071 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-05-21T19:08:41.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:41.403 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:41.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:41.664 INFO:teuthology.orchestra.run.smithi046.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:41.672 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/417 2023-05-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/417 2023-05-21T19:08:41.673 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:41.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:41.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:41.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-05-21T19:08:42.016 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:42.025 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:42.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:42.356 INFO:teuthology.orchestra.run.smithi046.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-05-21T19:08:42.365 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/418 2023-05-21T19:08:42.366 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/418 2023-05-21T19:08:42.366 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:42.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:42.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:42.389 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-05-21T19:08:42.711 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:42.721 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:42.722 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:43.053 INFO:teuthology.orchestra.run.smithi046.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:43.062 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/419 2023-05-21T19:08:43.063 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/419 2023-05-21T19:08:43.063 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:43.067 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:43.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:43.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-05-21T19:08:43.408 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:43.416 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:43.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:45.374 INFO:teuthology.orchestra.run.smithi046.stdout:generic/420 2s 2023-05-21T19:08:45.387 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/420 2023-05-21T19:08:45.387 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:45.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:45.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:45.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-05-21T19:08:46.141 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:46.147 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:46.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:46.448 INFO:teuthology.orchestra.run.smithi046.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:46.457 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/421 2023-05-21T19:08:46.457 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/421 2023-05-21T19:08:46.457 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:46.462 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:46.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:46.480 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-05-21T19:08:46.803 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:47.073 INFO:teuthology.orchestra.run.smithi046.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:47.081 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/422 2023-05-21T19:08:47.082 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/422 2023-05-21T19:08:47.082 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:47.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:47.105 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-05-21T19:08:47.428 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:47.437 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:47.989 INFO:teuthology.orchestra.run.smithi046.stdout:generic/423 0s 2023-05-21T19:08:47.999 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/423 2023-05-21T19:08:47.999 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:48.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:48.021 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-05-21T19:08:48.736 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:48.746 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:48.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:49.104 INFO:teuthology.orchestra.run.smithi046.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-05-21T19:08:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/424 2023-05-21T19:08:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/424 2023-05-21T19:08:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:49.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:49.137 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-05-21T19:08:49.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:49.458 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:49.458 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:49.714 INFO:teuthology.orchestra.run.smithi046.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:08:49.723 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/425 2023-05-21T19:08:49.724 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/425 2023-05-21T19:08:49.724 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:08:49.730 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:08:49.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:08:49.748 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-05-21T19:08:50.058 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:08:50.065 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:08:50.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:01.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:09:01.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:09:32.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:09:32.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:09:47.316 INFO:teuthology.orchestra.run.smithi046.stdout:generic/426 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/426.out.bad) 2023-05-21T19:09:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/426.out 2023-05-21 16:55:34.855774680 +0000 2023-05-21T19:09:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/426.out.bad 2023-05-21 19:09:47.299096582 +0000 2023-05-21T19:09:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,268 @@ 2023-05-21T19:09:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 426 2023-05-21T19:09:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir -d 2023-05-21T19:09:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000364) opened an unlinked file! 2023-05-21T19:09:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000365) opened an unlinked file! 2023-05-21T19:09:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000366) opened an unlinked file! 2023-05-21T19:09:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000367) opened an unlinked file! 2023-05-21T19:09:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000368) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000369) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000370) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000371) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000372) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000373) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000374) opened an unlinked file! 2023-05-21T19:09:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000375) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000376) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000377) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000378) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000379) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000380) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000381) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000382) opened an unlinked file! 2023-05-21T19:09:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000383) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000384) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000385) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000386) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000387) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000388) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000389) opened an unlinked file! 2023-05-21T19:09:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000390) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000391) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000392) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000393) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000394) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000395) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000396) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000397) opened an unlinked file! 2023-05-21T19:09:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000398) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000399) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000400) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000401) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000402) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000403) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000404) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000405) opened an unlinked file! 2023-05-21T19:09:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000406) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000407) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000408) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000409) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000410) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000411) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000412) opened an unlinked file! 2023-05-21T19:09:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000413) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000414) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000415) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000416) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000417) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000418) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000419) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000420) opened an unlinked file! 2023-05-21T19:09:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000421) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000422) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000423) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000424) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000425) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000426) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000427) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000428) opened an unlinked file! 2023-05-21T19:09:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000429) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000430) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000431) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000432) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000433) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000434) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000435) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000436) opened an unlinked file! 2023-05-21T19:09:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000437) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000438) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000439) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000440) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000441) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000442) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000443) opened an unlinked file! 2023-05-21T19:09:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000444) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000445) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000446) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000447) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000448) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000449) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000450) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000451) opened an unlinked file! 2023-05-21T19:09:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000452) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000453) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000454) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000455) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000456) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000457) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000458) opened an unlinked file! 2023-05-21T19:09:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000459) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000460) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000461) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000462) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000463) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000464) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000465) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000466) opened an unlinked file! 2023-05-21T19:09:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000467) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000468) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000469) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000470) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000471) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000472) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000473) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000474) opened an unlinked file! 2023-05-21T19:09:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000475) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000476) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000477) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000478) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000479) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000480) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000481) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000482) opened an unlinked file! 2023-05-21T19:09:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000483) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000484) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000485) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000486) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000487) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000488) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000489) opened an unlinked file! 2023-05-21T19:09:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000490) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000491) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000492) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000493) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000494) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000495) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000496) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000497) opened an unlinked file! 2023-05-21T19:09:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000498) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000499) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000500) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000501) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000502) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000503) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000504) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000505) opened an unlinked file! 2023-05-21T19:09:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000506) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000507) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000508) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000509) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000510) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000511) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000512) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000513) opened an unlinked file! 2023-05-21T19:09:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000514) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000515) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000516) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000517) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000518) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000519) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000520) opened an unlinked file! 2023-05-21T19:09:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000521) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000522) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000523) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000524) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000525) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000526) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000527) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000528) opened an unlinked file! 2023-05-21T19:09:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000529) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000530) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000531) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000532) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000533) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000534) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000535) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000536) opened an unlinked file! 2023-05-21T19:09:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000537) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000538) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000539) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000540) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000541) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000542) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000543) opened an unlinked file! 2023-05-21T19:09:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000544) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000545) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000546) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000547) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000548) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000549) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000550) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000551) opened an unlinked file! 2023-05-21T19:09:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000552) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000553) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000554) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000555) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000556) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000557) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000558) opened an unlinked file! 2023-05-21T19:09:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000559) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000560) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000561) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000562) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000563) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000564) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000565) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000566) opened an unlinked file! 2023-05-21T19:09:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000567) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000568) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000569) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000570) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000571) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000572) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000573) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000574) opened an unlinked file! 2023-05-21T19:09:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000575) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000576) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000577) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000578) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000579) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000580) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000581) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000582) opened an unlinked file! 2023-05-21T19:09:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000583) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000584) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000585) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000586) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000587) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000588) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000589) opened an unlinked file! 2023-05-21T19:09:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000590) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000591) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000592) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000593) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000594) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000595) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000596) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000597) opened an unlinked file! 2023-05-21T19:09:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000598) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000599) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000600) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000601) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000602) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000603) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000604) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000605) opened an unlinked file! 2023-05-21T19:09:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000606) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000607) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000608) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000609) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000610) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000611) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000612) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000613) opened an unlinked file! 2023-05-21T19:09:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000614) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000615) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000616) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000617) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000618) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000619) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000620) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000621) opened an unlinked file! 2023-05-21T19:09:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000622) opened an unlinked file! 2023-05-21T19:09:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000623) opened an unlinked file! 2023-05-21T19:09:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000624) opened an unlinked file! 2023-05-21T19:09:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000625) opened an unlinked file! 2023-05-21T19:09:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/426-dir/file000626) opened an unlinked file! 2023-05-21T19:09:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir 2023-05-21T19:09:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir -l 2023-05-21T19:09:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/426-dir -u 2023-05-21T19:09:47.371 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/426 2023-05-21T19:09:47.371 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/426 2023-05-21T19:09:47.372 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T19:09:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:47.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T19:09:47.480 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T19:09:47.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T19:09:47.481 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-05-21T19:09:49.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:49.404 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:49.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:49.743 INFO:teuthology.orchestra.run.smithi046.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:09:49.752 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/427 2023-05-21T19:09:49.753 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/427 2023-05-21T19:09:49.753 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:49.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:49.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:49.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-05-21T19:09:50.105 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:50.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:50.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:50.459 INFO:teuthology.orchestra.run.smithi046.stdout:generic/428 0s 2023-05-21T19:09:50.471 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/428 2023-05-21T19:09:50.472 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:50.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:50.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:50.497 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-05-21T19:09:50.804 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:50.812 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:50.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:51.145 INFO:teuthology.orchestra.run.smithi046.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:09:51.154 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/429 2023-05-21T19:09:51.154 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/429 2023-05-21T19:09:51.155 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:51.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:51.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:51.178 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-05-21T19:09:51.507 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:51.517 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:51.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:generic/430 1s 2023-05-21T19:09:52.099 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/430 2023-05-21T19:09:52.099 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:52.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:52.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:52.123 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-05-21T19:09:52.834 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:52.842 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:52.843 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:53.377 INFO:teuthology.orchestra.run.smithi046.stdout:generic/431 1s 2023-05-21T19:09:53.390 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/431 2023-05-21T19:09:53.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:53.396 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:53.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:53.414 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-05-21T19:09:54.073 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:54.082 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:54.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:54.614 INFO:teuthology.orchestra.run.smithi046.stdout:generic/432 0s 2023-05-21T19:09:54.627 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/432 2023-05-21T19:09:54.628 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:54.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:54.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:54.651 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-05-21T19:09:55.361 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:55.371 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:55.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:55.852 INFO:teuthology.orchestra.run.smithi046.stdout:generic/433 0s 2023-05-21T19:09:55.865 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/433 2023-05-21T19:09:55.865 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:55.871 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:55.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:55.888 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-05-21T19:09:56.589 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:56.599 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:56.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:57.080 INFO:teuthology.orchestra.run.smithi046.stdout:generic/434 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/434.out.bad) 2023-05-21T19:09:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/434.out 2023-05-21 16:55:34.855774680 +0000 2023-05-21T19:09:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/434.out.bad 2023-05-21 19:09:57.070995799 +0000 2023-05-21T19:09:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -9,6 +9,6 @@ 2023-05-21T19:09:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: copy_range: Bad file descriptor 2023-05-21T19:09:57.085 INFO:teuthology.orchestra.run.smithi046.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-05-21T19:09:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: Try to copy to a device 2023-05-21T19:09:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: -copy_range: Invalid argument 2023-05-21T19:09:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: +/tmp/tmp.g8r3hAr3OQtest/test-434/dev1: Permission denied 2023-05-21T19:09:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: Try to copy to a fifo 2023-05-21T19:09:57.086 INFO:teuthology.orchestra.run.smithi046.stdout: copy_range: Invalid argument 2023-05-21T19:09:57.090 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/434 2023-05-21T19:09:57.091 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/434 2023-05-21T19:09:57.091 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T19:09:57.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:57.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T19:09:57.112 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T19:09:57.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T19:09:57.113 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-05-21T19:09:57.856 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:57.866 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:57.866 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:58.205 INFO:teuthology.orchestra.run.smithi046.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:09:58.214 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/435 2023-05-21T19:09:58.215 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/435 2023-05-21T19:09:58.215 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:09:58.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:09:58.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:09:58.236 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-05-21T19:09:58.557 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:09:58.566 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:09:58.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:10:00.345 INFO:teuthology.orchestra.run.smithi046.stdout:generic/436 2s 2023-05-21T19:10:00.359 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/436 2023-05-21T19:10:00.359 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:10:00.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:10:00.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:10:00.382 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-05-21T19:10:01.081 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:10:01.089 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:10:01.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:10:02.241 INFO:teuthology.orchestra.run.smithi046.stdout:generic/437 1s 2023-05-21T19:10:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/437 2023-05-21T19:10:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:10:02.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:10:02.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:10:02.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-05-21T19:10:02.610 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:10:02.620 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:10:02.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:10:03.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:10:03.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:10:33.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:10:33.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:11:03.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:11:03.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:11:33.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:11:33.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:11:33.400 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T19:11:33.394+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 338384) UID: 0 2023-05-21T19:11:33.401 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T19:11:33.394+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 338384) UID: 0 2023-05-21T19:11:57.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/438 115s 2023-05-21T19:11:57.683 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/438 2023-05-21T19:11:57.683 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:11:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:57.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:11:57.794 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-05-21T19:11:58.075 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:11:58.084 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:11:58.084 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:58.322 INFO:teuthology.orchestra.run.smithi046.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:11:58.330 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/439 2023-05-21T19:11:58.330 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/439 2023-05-21T19:11:58.331 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:11:58.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:58.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:11:58.350 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-05-21T19:11:58.666 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:11:58.673 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:11:58.685 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:58.968 INFO:teuthology.orchestra.run.smithi046.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:11:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/440 2023-05-21T19:11:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/440 2023-05-21T19:11:58.974 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:11:58.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:58.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:11:58.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-05-21T19:11:59.291 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:11:59.299 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:11:59.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:59.671 INFO:teuthology.orchestra.run.smithi046.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:11:59.680 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/441 2023-05-21T19:11:59.681 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/441 2023-05-21T19:11:59.681 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:11:59.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:11:59.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:11:59.703 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-05-21T19:11:59.986 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:11:59.992 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:11:59.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:00.231 INFO:teuthology.orchestra.run.smithi046.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:00.238 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/442 2023-05-21T19:12:00.239 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/442 2023-05-21T19:12:00.239 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:00.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:00.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:00.261 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-05-21T19:12:00.527 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:00.534 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:00.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:00.821 INFO:teuthology.orchestra.run.smithi046.stdout:generic/443 0s 2023-05-21T19:12:00.832 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/443 2023-05-21T19:12:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:00.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:00.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:00.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-05-21T19:12:01.105 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:01.112 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:01.112 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:01.399 INFO:teuthology.orchestra.run.smithi046.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T19:12:01.406 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/444 2023-05-21T19:12:01.406 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/444 2023-05-21T19:12:01.406 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:01.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:01.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:01.423 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-05-21T19:12:01.709 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:01.716 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:01.717 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:03.172 INFO:teuthology.orchestra.run.smithi046.stdout:generic/445 2s 2023-05-21T19:12:03.191 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/445 2023-05-21T19:12:03.191 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:03.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:03.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:03.206 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-05-21T19:12:03.863 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:03.869 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:03.869 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:04.082 INFO:teuthology.orchestra.run.smithi046.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:04.089 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/446 2023-05-21T19:12:04.090 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/446 2023-05-21T19:12:04.090 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:04.094 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:04.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:04.109 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-05-21T19:12:04.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:04.396 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:04.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:04.626 INFO:teuthology.orchestra.run.smithi046.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:04.632 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/447 2023-05-21T19:12:04.632 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/447 2023-05-21T19:12:04.633 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:04.637 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:04.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:04.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-05-21T19:12:04.935 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:04.941 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:04.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:06.375 INFO:teuthology.orchestra.run.smithi046.stdout:generic/448 2s 2023-05-21T19:12:06.384 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/448 2023-05-21T19:12:06.384 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:06.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:06.403 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-05-21T19:12:07.076 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:07.082 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:07.083 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:07.300 INFO:teuthology.orchestra.run.smithi046.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:07.307 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/449 2023-05-21T19:12:07.308 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/449 2023-05-21T19:12:07.308 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:07.312 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:07.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:07.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-05-21T19:12:07.604 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:07.610 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:07.615 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:09.916 INFO:teuthology.orchestra.run.smithi046.stdout:generic/450 2s 2023-05-21T19:12:09.931 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/450 2023-05-21T19:12:09.931 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:09.937 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:09.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:09.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-05-21T19:12:10.694 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:10.703 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:10.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:11.380 INFO:teuthology.orchestra.run.smithi046.stdout:generic/451 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/451.out.bad) 2023-05-21T19:12:11.384 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/451.out 2023-05-21 16:55:34.859774593 +0000 2023-05-21T19:12:11.384 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/451.out.bad 2023-05-21 19:12:11.369670361 +0000 2023-05-21T19:12:11.384 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,5 @@ 2023-05-21T19:12:11.384 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 451 2023-05-21T19:12:11.384 INFO:teuthology.orchestra.run.smithi046.stdout: +get stale data from buffer read 2023-05-21T19:12:11.385 INFO:teuthology.orchestra.run.smithi046.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-05-21T19:12:11.385 INFO:teuthology.orchestra.run.smithi046.stdout: +000a0000 2023-05-21T19:12:11.385 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden 2023-05-21T19:12:11.389 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/451 2023-05-21T19:12:11.389 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/451 2023-05-21T19:12:11.389 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T19:12:11.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:11.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T19:12:11.408 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T19:12:11.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T19:12:11.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-05-21T19:12:12.101 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:12.106 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:12.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:12.328 INFO:teuthology.orchestra.run.smithi046.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:12.335 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/452 2023-05-21T19:12:12.335 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/452 2023-05-21T19:12:12.336 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:12.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:12.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:12.355 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-05-21T19:12:12.643 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:12.650 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:12.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:12.871 INFO:teuthology.orchestra.run.smithi046.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:12.878 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/453 2023-05-21T19:12:12.878 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/453 2023-05-21T19:12:12.878 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:12.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:12.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:12.897 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-05-21T19:12:13.169 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:13.175 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:13.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:13.387 INFO:teuthology.orchestra.run.smithi046.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:13.395 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/454 2023-05-21T19:12:13.395 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/454 2023-05-21T19:12:13.395 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:13.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:13.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:13.415 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-05-21T19:12:13.691 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:13.698 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:13.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:14.097 INFO:teuthology.orchestra.run.smithi046.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:14.105 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/455 2023-05-21T19:12:14.106 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/455 2023-05-21T19:12:14.106 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:14.111 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:14.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:14.126 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-05-21T19:12:14.414 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:14.421 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:14.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:14.678 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/456 2023-05-21T19:12:14.679 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/456 2023-05-21T19:12:14.679 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:14.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:14.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:14.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-05-21T19:12:14.979 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:14.986 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:14.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:15.288 INFO:teuthology.orchestra.run.smithi046.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:15.296 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/457 2023-05-21T19:12:15.296 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/457 2023-05-21T19:12:15.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:15.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:15.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:15.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-05-21T19:12:15.632 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:15.642 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:15.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:16.003 INFO:teuthology.orchestra.run.smithi046.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:16.012 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/458 2023-05-21T19:12:16.012 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/458 2023-05-21T19:12:16.012 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:16.017 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:16.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:16.036 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-05-21T19:12:16.343 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:16.350 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:16.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:16.847 INFO:teuthology.orchestra.run.smithi046.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:16.855 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/459 2023-05-21T19:12:16.856 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/459 2023-05-21T19:12:16.856 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:16.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:16.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:16.876 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-05-21T19:12:17.149 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:17.157 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:17.157 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:17.382 INFO:teuthology.orchestra.run.smithi046.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:17.390 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/460 2023-05-21T19:12:17.391 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/460 2023-05-21T19:12:17.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:17.396 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:17.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:17.412 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-05-21T19:12:17.685 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:17.692 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:17.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:17.917 INFO:teuthology.orchestra.run.smithi046.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:17.924 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/461 2023-05-21T19:12:17.924 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/461 2023-05-21T19:12:17.924 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:17.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:17.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:17.941 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-05-21T19:12:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:18.247 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:18.476 INFO:teuthology.orchestra.run.smithi046.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/462 2023-05-21T19:12:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/462 2023-05-21T19:12:18.483 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:18.488 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:18.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:18.505 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-05-21T19:12:18.788 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:18.794 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:18.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:19.130 INFO:teuthology.orchestra.run.smithi046.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T19:12:19.138 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/463 2023-05-21T19:12:19.139 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/463 2023-05-21T19:12:19.139 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:19.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:19.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:19.160 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-05-21T19:12:19.820 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:19.830 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:19.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:20.038 INFO:teuthology.orchestra.run.smithi046.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:20.044 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/464 2023-05-21T19:12:20.044 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/464 2023-05-21T19:12:20.044 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:20.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:20.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:20.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-05-21T19:12:20.340 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:20.348 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:20.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:39.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/465 19s 2023-05-21T19:12:39.778 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/465 2023-05-21T19:12:39.778 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:39.855 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:39.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:40.100 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-05-21T19:12:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:40.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:40.619 INFO:teuthology.orchestra.run.smithi046.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:40.626 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/466 2023-05-21T19:12:40.626 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/466 2023-05-21T19:12:40.627 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:40.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:40.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:40.647 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-05-21T19:12:40.915 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:40.921 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:40.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:52.675 INFO:teuthology.orchestra.run.smithi046.stdout:generic/467 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/467.out.bad) 2023-05-21T19:12:52.694 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/467.out 2023-05-21 16:55:34.859774593 +0000 2023-05-21T19:12:52.694 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/467.out.bad 2023-05-21 19:12:52.565291260 +0000 2023-05-21T19:12:52.695 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,5 +1,15 @@ 2023-05-21T19:12:52.695 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 467 2023-05-21T19:12:52.695 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-05-21T19:12:52.695 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000000) opened an unlinked file! 2023-05-21T19:12:52.695 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000001) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000002) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000003) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000004) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000005) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000006) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000007) opened an unlinked file! 2023-05-21T19:12:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000008) opened an unlinked file! 2023-05-21T19:12:52.697 INFO:teuthology.orchestra.run.smithi046.stdout: +open_by_handle(/tmp/tmp.g8r3hAr3OQtest/467-dir/file000009) opened an unlinked file! 2023-05-21T19:12:52.697 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-05-21T19:12:52.697 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-05-21T19:12:52.697 INFO:teuthology.orchestra.run.smithi046.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-05-21T19:12:52.734 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/467 2023-05-21T19:12:52.734 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/467 2023-05-21T19:12:52.734 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T19:12:52.783 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:52.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T19:12:52.876 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T19:12:52.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T19:12:52.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-05-21T19:12:56.760 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:56.767 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:56.768 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:57.199 INFO:teuthology.orchestra.run.smithi046.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:12:57.207 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/468 2023-05-21T19:12:57.207 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/468 2023-05-21T19:12:57.207 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:12:57.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:12:57.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:12:57.226 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-05-21T19:12:57.500 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:12:57.508 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:12:57.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:00.316 INFO:teuthology.orchestra.run.smithi046.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-21T19:13:00.324 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/469 2023-05-21T19:13:00.324 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/469 2023-05-21T19:13:00.324 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:00.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:00.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:00.344 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-05-21T19:13:01.031 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:01.039 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:01.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:01.431 INFO:teuthology.orchestra.run.smithi046.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:01.440 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/470 2023-05-21T19:13:01.440 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/470 2023-05-21T19:13:01.441 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:01.446 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:01.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:01.464 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-05-21T19:13:01.750 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:01.757 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:01.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:02.111 INFO:teuthology.orchestra.run.smithi046.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-05-21T19:13:02.118 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/471 2023-05-21T19:13:02.119 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/471 2023-05-21T19:13:02.119 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:02.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:02.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:02.141 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-05-21T19:13:02.825 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:02.832 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:02.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:03.101 INFO:teuthology.orchestra.run.smithi046.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:03.110 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/472 2023-05-21T19:13:03.110 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/472 2023-05-21T19:13:03.111 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:03.116 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:03.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:03.132 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-05-21T19:13:03.419 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:03.426 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:03.426 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:03.740 INFO:teuthology.orchestra.run.smithi046.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-21T19:13:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/473 2023-05-21T19:13:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/473 2023-05-21T19:13:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:03.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:03.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:03.768 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-05-21T19:13:04.048 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:04.054 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:04.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:04.298 INFO:teuthology.orchestra.run.smithi046.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:04.307 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/474 2023-05-21T19:13:04.308 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/474 2023-05-21T19:13:04.308 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:04.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:04.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:04.327 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-05-21T19:13:04.621 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:04.628 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:04.628 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:04.914 INFO:teuthology.orchestra.run.smithi046.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:04.922 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/475 2023-05-21T19:13:04.922 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/475 2023-05-21T19:13:04.922 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:04.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:04.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:04.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-05-21T19:13:05.224 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:05.230 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:05.231 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:05.453 INFO:teuthology.orchestra.run.smithi046.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:05.459 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/476 2023-05-21T19:13:05.460 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/476 2023-05-21T19:13:05.460 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:05.464 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:05.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:05.479 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-05-21T19:13:05.777 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:05.785 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:05.785 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:19.171 INFO:teuthology.orchestra.run.smithi046.stdout:generic/477 13s 2023-05-21T19:13:19.513 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/477 2023-05-21T19:13:19.513 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:19.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:19.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:19.567 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-05-21T19:13:22.624 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:22.633 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:52.975 INFO:teuthology.orchestra.run.smithi046.stdout:generic/478 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/478.out.bad) 2023-05-21T19:13:52.981 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/478.out 2023-05-21 16:55:34.859774593 +0000 2023-05-21T19:13:52.981 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/478.out.bad 2023-05-21 19:13:52.600722487 +0000 2023-05-21T19:13:52.981 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -10,7 +10,7 @@ 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: get wrlck 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: +get wrlck 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.982 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -25,7 +25,7 @@ 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: get wrlck 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2023-05-21T19:13:52.983 INFO:teuthology.orchestra.run.smithi046.stdout: +get wrlck 2023-05-21T19:13:52.984 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.984 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.984 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.984 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -37,7 +37,7 @@ 2023-05-21T19:13:52.984 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2023-05-21T19:13:52.984 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: +get rdlck 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2023-05-21T19:13:52.985 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -46,7 +46,7 @@ 2023-05-21T19:13:52.986 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2023-05-21T19:13:52.986 INFO:teuthology.orchestra.run.smithi046.stdout: get rdlck 2023-05-21T19:13:52.986 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.986 INFO:teuthology.orchestra.run.smithi046.stdout: -lock could be placed 2023-05-21T19:13:52.986 INFO:teuthology.orchestra.run.smithi046.stdout: +get rdlck 2023-05-21T19:13:52.986 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.987 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.987 INFO:teuthology.orchestra.run.smithi046.stdout: lock could be placed 2023-05-21T19:13:52.988 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/478 2023-05-21T19:13:52.988 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/478 2023-05-21T19:13:52.988 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T19:13:52.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:53.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T19:13:53.012 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T19:13:53.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T19:13:53.013 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-05-21T19:13:53.351 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:53.358 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:53.359 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:53.746 INFO:teuthology.orchestra.run.smithi046.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:53.756 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/479 2023-05-21T19:13:53.756 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/479 2023-05-21T19:13:53.756 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:53.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:53.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:53.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-05-21T19:13:54.081 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:54.358 INFO:teuthology.orchestra.run.smithi046.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:54.365 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/480 2023-05-21T19:13:54.366 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/480 2023-05-21T19:13:54.366 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:54.370 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:54.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:54.386 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-05-21T19:13:54.668 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:54.675 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:54.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:54.928 INFO:teuthology.orchestra.run.smithi046.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/481 2023-05-21T19:13:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/481 2023-05-21T19:13:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:54.942 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:54.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:54.957 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-05-21T19:13:55.239 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:55.247 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:55.247 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:55.626 INFO:teuthology.orchestra.run.smithi046.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:55.632 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/482 2023-05-21T19:13:55.633 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/482 2023-05-21T19:13:55.633 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:55.637 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:55.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:55.653 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-05-21T19:13:55.925 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:55.931 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:55.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:56.173 INFO:teuthology.orchestra.run.smithi046.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:56.180 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/483 2023-05-21T19:13:56.180 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/483 2023-05-21T19:13:56.180 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:56.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:56.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:56.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-05-21T19:13:56.468 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:56.475 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:56.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:56.738 INFO:teuthology.orchestra.run.smithi046.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:56.745 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/484 2023-05-21T19:13:56.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/484 2023-05-21T19:13:56.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:56.749 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:56.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:56.765 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-05-21T19:13:57.036 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:57.044 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:57.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:58.702 INFO:teuthology.orchestra.run.smithi046.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-21T19:13:58.710 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/485 2023-05-21T19:13:58.710 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/485 2023-05-21T19:13:58.711 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:58.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:58.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:58.732 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-05-21T19:13:59.437 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:13:59.444 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:13:59.444 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:59.729 INFO:teuthology.orchestra.run.smithi046.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:13:59.734 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/486 2023-05-21T19:13:59.734 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/486 2023-05-21T19:13:59.734 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:13:59.737 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:13:59.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:13:59.748 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-05-21T19:14:00.028 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:00.037 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:00.037 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:00.274 INFO:teuthology.orchestra.run.smithi046.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/487 2023-05-21T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/487 2023-05-21T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:00.288 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:00.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:00.305 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-05-21T19:14:00.580 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:00.587 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:00.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:00.799 INFO:teuthology.orchestra.run.smithi046.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:00.805 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/488 2023-05-21T19:14:00.805 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/488 2023-05-21T19:14:00.806 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:00.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:00.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:00.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-05-21T19:14:01.100 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:01.107 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:01.107 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:01.361 INFO:teuthology.orchestra.run.smithi046.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:01.368 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/489 2023-05-21T19:14:01.368 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/489 2023-05-21T19:14:01.368 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:01.373 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:01.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:01.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-05-21T19:14:01.656 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:01.663 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:01.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:03.146 INFO:teuthology.orchestra.run.smithi046.stdout:generic/490 2s 2023-05-21T19:14:03.156 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/490 2023-05-21T19:14:03.156 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:03.161 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:03.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:03.179 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-05-21T19:14:03.828 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:03.835 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:03.835 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:04.077 INFO:teuthology.orchestra.run.smithi046.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:04.085 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/491 2023-05-21T19:14:04.085 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/491 2023-05-21T19:14:04.085 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:04.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:04.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:04.107 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-05-21T19:14:04.390 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:04.398 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:04.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:04.631 INFO:teuthology.orchestra.run.smithi046.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:04.638 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/492 2023-05-21T19:14:04.639 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/492 2023-05-21T19:14:04.639 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:04.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:04.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:04.662 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-05-21T19:14:04.933 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:04.940 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:04.940 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:05.180 INFO:teuthology.orchestra.run.smithi046.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:05.188 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/493 2023-05-21T19:14:05.189 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/493 2023-05-21T19:14:05.189 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:05.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:05.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:05.211 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-05-21T19:14:05.489 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:05.496 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:05.497 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:05.710 INFO:teuthology.orchestra.run.smithi046.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:05.717 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/494 2023-05-21T19:14:05.717 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/494 2023-05-21T19:14:05.717 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:05.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:05.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-05-21T19:14:06.010 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:06.017 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:06.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:06.239 INFO:teuthology.orchestra.run.smithi046.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:06.246 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/495 2023-05-21T19:14:06.246 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/495 2023-05-21T19:14:06.246 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:06.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:06.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-05-21T19:14:06.536 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:06.543 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:06.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:06.791 INFO:teuthology.orchestra.run.smithi046.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:06.800 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/496 2023-05-21T19:14:06.801 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/496 2023-05-21T19:14:06.801 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:06.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:06.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:06.821 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-05-21T19:14:07.095 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:07.101 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:07.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:07.324 INFO:teuthology.orchestra.run.smithi046.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:07.329 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/497 2023-05-21T19:14:07.329 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/497 2023-05-21T19:14:07.329 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:07.333 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:07.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:07.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-05-21T19:14:07.630 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:07.638 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:07.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:07.886 INFO:teuthology.orchestra.run.smithi046.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:07.892 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/498 2023-05-21T19:14:07.893 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/498 2023-05-21T19:14:07.893 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:07.897 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:07.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:07.913 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-05-21T19:14:08.207 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:08.215 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:08.215 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:08.436 INFO:teuthology.orchestra.run.smithi046.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:08.443 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/499 2023-05-21T19:14:08.443 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/499 2023-05-21T19:14:08.444 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:08.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:08.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:08.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-05-21T19:14:08.734 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:08.742 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:08.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:09.065 INFO:teuthology.orchestra.run.smithi046.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:09.073 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/500 2023-05-21T19:14:09.073 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/500 2023-05-21T19:14:09.073 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:09.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:09.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:09.096 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-05-21T19:14:09.366 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:09.373 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:09.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:09.640 INFO:teuthology.orchestra.run.smithi046.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:09.647 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/501 2023-05-21T19:14:09.647 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/501 2023-05-21T19:14:09.647 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:09.652 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:09.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:09.666 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-05-21T19:14:09.931 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:09.938 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:09.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:10.184 INFO:teuthology.orchestra.run.smithi046.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:10.192 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/502 2023-05-21T19:14:10.192 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/502 2023-05-21T19:14:10.192 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:10.197 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:10.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:10.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-05-21T19:14:10.479 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:10.487 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:10.487 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:10.719 INFO:teuthology.orchestra.run.smithi046.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:10.726 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/503 2023-05-21T19:14:10.726 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/503 2023-05-21T19:14:10.726 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:10.730 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:10.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:10.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-05-21T19:14:11.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:11.032 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:11.033 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:11.354 INFO:teuthology.orchestra.run.smithi046.stdout:generic/504 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/504.out.bad) 2023-05-21T19:14:11.359 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/504.out 2023-05-21 16:55:34.859774593 +0000 2023-05-21T19:14:11.359 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/504.out.bad 2023-05-21 19:14:11.344538367 +0000 2023-05-21T19:14:11.359 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,3 @@ 2023-05-21T19:14:11.359 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 504 2023-05-21T19:14:11.359 INFO:teuthology.orchestra.run.smithi046.stdout: +lock info not found 2023-05-21T19:14:11.360 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden 2023-05-21T19:14:11.364 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/504 2023-05-21T19:14:11.365 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/504 2023-05-21T19:14:11.365 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T19:14:11.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:11.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T19:14:11.386 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T19:14:11.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T19:14:11.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-05-21T19:14:11.666 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:11.673 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:11.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:11.895 INFO:teuthology.orchestra.run.smithi046.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:11.903 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/505 2023-05-21T19:14:11.903 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/505 2023-05-21T19:14:11.904 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:11.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:11.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:11.922 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-05-21T19:14:12.182 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:12.189 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:12.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:12.430 INFO:teuthology.orchestra.run.smithi046.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:12.437 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/506 2023-05-21T19:14:12.438 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/506 2023-05-21T19:14:12.438 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:12.442 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:12.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:12.457 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-05-21T19:14:12.722 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:12.730 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:12.731 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:13.046 INFO:teuthology.orchestra.run.smithi046.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-05-21T19:14:13.053 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/507 2023-05-21T19:14:13.053 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/507 2023-05-21T19:14:13.053 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:13.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:13.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-05-21T19:14:13.341 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:13.348 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:13.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:13.586 INFO:teuthology.orchestra.run.smithi046.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-05-21T19:14:13.593 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/508 2023-05-21T19:14:13.593 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/508 2023-05-21T19:14:13.593 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:13.597 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:13.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:13.613 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-05-21T19:14:13.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:13.894 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:13.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:14.140 INFO:teuthology.orchestra.run.smithi046.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:14.150 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/509 2023-05-21T19:14:14.150 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/509 2023-05-21T19:14:14.150 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:14.155 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:14.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:14.171 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-05-21T19:14:14.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:14.458 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:14.458 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:14.875 INFO:teuthology.orchestra.run.smithi046.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:14.883 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/510 2023-05-21T19:14:14.883 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/510 2023-05-21T19:14:14.883 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:14.889 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:14.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:14.907 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-05-21T19:14:15.228 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:15.237 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:15.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:15.550 INFO:teuthology.orchestra.run.smithi046.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:15.558 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/511 2023-05-21T19:14:15.558 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/511 2023-05-21T19:14:15.559 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:15.562 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:15.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:15.579 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-05-21T19:14:15.873 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:15.882 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:15.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:16.164 INFO:teuthology.orchestra.run.smithi046.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:16.174 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/512 2023-05-21T19:14:16.174 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/512 2023-05-21T19:14:16.175 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:16.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:16.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:16.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-05-21T19:14:16.523 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:16.531 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:16.789 INFO:teuthology.orchestra.run.smithi046.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:16.797 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/513 2023-05-21T19:14:16.798 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/513 2023-05-21T19:14:16.798 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:16.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:16.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:16.823 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-05-21T19:14:17.141 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:17.151 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:17.152 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:17.420 INFO:teuthology.orchestra.run.smithi046.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:17.429 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/514 2023-05-21T19:14:17.429 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/514 2023-05-21T19:14:17.429 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:17.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:17.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:17.452 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-05-21T19:14:17.769 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:17.778 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:17.778 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:18.043 INFO:teuthology.orchestra.run.smithi046.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:18.052 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/515 2023-05-21T19:14:18.053 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/515 2023-05-21T19:14:18.053 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:18.058 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:18.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:18.076 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-05-21T19:14:18.398 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:18.408 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:18.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:18.784 INFO:teuthology.orchestra.run.smithi046.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-21T19:14:18.791 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/516 2023-05-21T19:14:18.791 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/516 2023-05-21T19:14:18.792 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:18.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:18.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:18.813 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-05-21T19:14:19.528 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:19.533 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:19.533 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:19.798 INFO:teuthology.orchestra.run.smithi046.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:19.806 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/517 2023-05-21T19:14:19.807 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/517 2023-05-21T19:14:19.807 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:19.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:19.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:19.832 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-05-21T19:14:20.163 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:20.172 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:20.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:20.440 INFO:teuthology.orchestra.run.smithi046.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:20.448 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/518 2023-05-21T19:14:20.448 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/518 2023-05-21T19:14:20.448 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:20.453 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:20.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:20.470 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-05-21T19:14:20.794 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:20.802 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:20.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:21.063 INFO:teuthology.orchestra.run.smithi046.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:21.071 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/519 2023-05-21T19:14:21.071 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/519 2023-05-21T19:14:21.071 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:21.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:21.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:21.095 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-05-21T19:14:21.417 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:21.426 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:21.426 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:21.727 INFO:teuthology.orchestra.run.smithi046.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T19:14:21.736 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/520 2023-05-21T19:14:21.736 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/520 2023-05-21T19:14:21.736 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T19:14:21.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:21.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T19:14:21.760 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-05-21T19:14:22.081 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T19:14:22.090 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T19:14:22.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T19:14:46.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:14:46.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:15:16.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:15:16.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:15:46.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:15:46.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:16:16.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:16:16.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:16:46.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:16:46.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:17:16.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:17:16.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:17:46.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:17:46.758 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:18:16.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:18:16.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:18:47.021 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:18:47.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:19:17.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:19:17.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:19:47.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:19:47.252 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:20:17.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:20:17.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:20:47.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:20:47.430 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:21:17.565 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:21:17.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:21:47.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:21:47.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:22:17.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:22:17.771 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:22:47.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:22:47.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:23:17.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:23:17.940 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:23:48.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:23:48.029 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:24:18.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:24:18.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:24:48.212 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:24:48.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:25:18.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:25:18.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:25:48.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:25:48.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:26:18.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:26:18.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:26:48.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:26:48.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:27:18.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:27:18.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:27:48.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:27:48.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:28:18.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:28:18.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:28:49.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:28:49.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:29:19.129 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:29:19.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:29:49.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:29:49.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:30:19.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:30:19.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:30:49.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:30:49.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:31:19.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:31:19.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:31:49.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:31:49.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:32:19.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:32:19.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:32:50.001 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:32:50.035 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:33:20.125 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:33:20.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:33:50.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:33:50.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:34:20.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:34:20.366 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:34:50.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:34:50.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:35:20.580 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:35:20.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:35:50.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:35:50.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:36:20.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:36:20.931 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:36:51.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:36:51.163 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:37:21.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:37:21.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:37:51.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:37:51.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:38:21.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:38:21.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:38:51.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:38:51.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:39:21.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:39:21.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:39:51.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:39:51.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:40:21.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:40:21.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:40:21.880 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T19:40:21.872+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377462) UID: 0 2023-05-21T19:40:21.880 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T19:40:21.872+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377462) UID: 0 2023-05-21T19:40:21.881 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T19:40:21.872+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377462) UID: 0 2023-05-21T19:40:21.881 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T19:40:21.872+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377462) UID: 0 2023-05-21T19:42:30.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:42:30.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:43:00.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:43:00.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:43:30.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:43:30.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:44:00.407 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:44:00.411 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:44:30.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:44:30.461 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:45:00.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:45:00.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:45:30.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:45:30.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:46:00.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:46:00.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:46:30.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:46:30.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:47:00.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:47:00.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:47:31.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:47:31.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:48:01.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:48:01.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:48:31.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:48:31.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:49:01.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:49:01.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:49:31.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:49:31.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:50:01.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:50:01.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:50:31.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:50:31.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:51:01.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:51:01.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:51:32.058 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:51:32.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:52:02.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:52:02.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:52:32.187 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:52:32.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:53:02.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:53:02.289 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:53:32.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:53:32.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:54:02.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:54:02.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:54:32.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:54:32.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:55:02.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:55:02.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:55:32.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:55:32.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:56:02.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:56:02.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:56:33.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:56:33.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:57:03.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:57:03.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:57:33.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:57:33.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:58:03.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:58:03.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:58:33.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:58:33.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:59:03.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:59:03.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:59:33.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T19:59:33.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:00:03.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:00:03.930 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:00:34.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:00:34.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:01:04.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:01:04.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:01:34.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:01:34.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:02:04.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:02:04.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:02:34.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:02:34.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:03:04.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:03:04.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:03:04.587 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T20:03:04.566+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377592) UID: 0 2023-05-21T20:03:04.587 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T20:03:04.566+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377592) UID: 0 2023-05-21T20:03:04.588 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T20:03:04.566+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377592) UID: 0 2023-05-21T20:03:04.588 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T20:03:04.566+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 377592) UID: 0 2023-05-21T20:05:29.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:05:29.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:05:59.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:05:59.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:06:29.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:06:29.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:06:59.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:06:59.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:07:29.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:07:29.999 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:08:00.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:08:00.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:08:30.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:08:30.156 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:09:00.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:09:00.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:09:30.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:09:30.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:10:00.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:10:00.708 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:10:30.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:10:30.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:11:00.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:11:00.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:11:30.947 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:11:30.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:12:01.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:12:01.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:12:31.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:12:31.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:13:01.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:13:01.262 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:13:31.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:13:31.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:14:01.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:14:01.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:14:31.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:14:31.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:15:01.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:15:01.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:15:31.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:15:31.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:16:02.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:16:02.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:16:32.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:16:32.095 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:17:02.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:17:02.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:17:32.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:17:32.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:18:02.434 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:18:02.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:18:32.601 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:18:32.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:18:32.640 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T20:18:32.608+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42044) UID: 0 2023-05-21T20:18:32.641 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T20:18:32.608+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42044) UID: 0 2023-05-21T20:18:32.641 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T20:18:32.608+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42044) UID: 0 2023-05-21T20:18:32.641 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T20:18:32.608+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42044) UID: 0 2023-05-21T20:20:42.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:20:42.931 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:21:13.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:21:13.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:21:43.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:21:43.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:22:13.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:22:13.198 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:22:43.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:22:43.252 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:23:13.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:23:13.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:23:43.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:23:43.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:24:13.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:24:13.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:24:43.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:24:43.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:25:13.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:25:13.726 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:25:43.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:25:43.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:26:14.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:26:14.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:26:44.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:26:44.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:27:14.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:27:14.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:27:44.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:27:44.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:28:14.434 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:28:14.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:28:44.552 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:28:44.581 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:29:14.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:29:14.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:29:44.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:29:44.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:30:14.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:30:14.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:30:45.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:30:45.035 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:31:15.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:31:15.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:31:45.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:31:45.638 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:32:15.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:32:15.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:32:45.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:32:45.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:33:15.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:33:15.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:33:45.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:33:45.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:34:16.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:34:16.102 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:34:46.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:34:46.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:35:16.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:35:16.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:35:46.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:35:46.332 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:36:16.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:36:16.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:36:46.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:36:46.635 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:37:16.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:37:16.730 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:37:46.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:37:46.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:38:16.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:38:16.930 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:38:46.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:38:46.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:39:17.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:39:17.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:39:47.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:39:47.209 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:40:17.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:40:17.544 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:40:47.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:40:47.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:41:17.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:41:17.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:41:47.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:41:47.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:42:17.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:42:17.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:42:48.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:42:48.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:43:18.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:43:18.173 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:43:48.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:43:48.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:44:18.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:44:18.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:44:48.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:44:48.449 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:45:18.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:45:18.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:45:48.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:45:48.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:45:54.944 INFO:teuthology.orchestra.run.smithi046.stdout:generic/521 5492s 2023-05-21T20:45:54.958 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/521 2023-05-21T20:45:54.959 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T20:45:54.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T20:45:54.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T20:45:55.077 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-05-21T20:45:55.648 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T20:45:55.656 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T20:45:55.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T20:46:18.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:46:18.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:46:48.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:46:48.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:47:18.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:47:18.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:47:48.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:47:48.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:48:18.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:48:19.005 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:48:49.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:48:49.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:49:19.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:49:19.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:49:49.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:49:49.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:50:19.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:50:19.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:50:49.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:50:49.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:51:19.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:51:19.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:51:49.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:51:49.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:52:19.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:52:19.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:52:49.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:52:49.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:53:20.067 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:53:20.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:53:50.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:53:50.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:54:20.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:54:20.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:54:50.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:54:50.354 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:55:20.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:55:20.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:55:50.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:55:50.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:56:20.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:56:20.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:56:50.750 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:56:50.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:57:20.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:57:20.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:57:50.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:57:50.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:58:21.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:58:21.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:58:51.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:58:51.261 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:59:21.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:59:21.311 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:59:51.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T20:59:51.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:00:21.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:00:21.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:00:51.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:00:51.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:01:21.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:01:21.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:01:51.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:01:51.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:02:21.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:02:21.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:02:51.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:02:51.933 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:03:21.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:03:21.983 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:03:52.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:03:52.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:04:22.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:04:22.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:04:52.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:04:52.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:05:22.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:05:22.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:05:52.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:05:52.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:06:22.289 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:06:22.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:06:52.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:06:52.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:07:22.407 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:07:22.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:07:52.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:07:52.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:08:22.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:08:22.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:08:52.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:08:52.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:09:22.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:09:22.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:09:52.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:09:52.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:09:53.000 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T21:09:52.987+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42343) UID: 0 2023-05-21T21:09:53.001 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T21:09:52.987+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42343) UID: 0 2023-05-21T21:09:53.001 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T21:09:52.987+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42343) UID: 0 2023-05-21T21:09:53.001 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T21:09:52.987+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42343) UID: 0 2023-05-21T21:12:05.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:12:05.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:12:35.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:12:35.516 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:13:05.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:13:05.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:13:35.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:13:35.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:14:05.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:14:05.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:14:35.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:14:35.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:15:05.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:15:05.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:15:35.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:15:35.813 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:15:35.855 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T21:15:35.849+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 378486) UID: 0 2023-05-21T21:15:35.858 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T21:15:35.849+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 378486) UID: 0 2023-05-21T21:18:11.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:18:11.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:18:41.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:18:41.155 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:19:11.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:19:11.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:19:41.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:19:41.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:20:11.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:20:11.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:20:41.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:20:41.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:21:11.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:21:11.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:21:41.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:21:41.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:22:11.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:22:11.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:22:41.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:22:41.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:23:11.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:23:11.687 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:23:42.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:23:42.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:24:12.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:24:12.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:24:42.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:24:42.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:25:12.329 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:25:12.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:25:42.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:25:42.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:26:12.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:26:12.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:26:42.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:26:42.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:27:12.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:27:12.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:27:42.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:27:42.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:28:12.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:28:12.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:28:42.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:28:42.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:29:12.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:29:12.959 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:29:43.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:29:43.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:30:13.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:30:13.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:30:13.228 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T21:30:13.176+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378571) UID: 0 2023-05-21T21:30:13.340 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T21:30:13.176+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378571) UID: 0 2023-05-21T21:30:13.370 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T21:30:13.176+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378571) UID: 0 2023-05-21T21:30:13.428 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T21:30:13.176+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378571) UID: 0 2023-05-21T21:32:29.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:32:29.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:32:59.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:32:59.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:33:29.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:33:29.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:34:00.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:34:00.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:34:30.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:34:30.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:35:00.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:35:00.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:35:30.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:35:30.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:36:00.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:36:00.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:36:30.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:36:30.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:37:00.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:37:00.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:37:30.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:37:30.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:38:00.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:38:00.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:38:30.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:38:31.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:39:01.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:39:01.402 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:39:31.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:39:31.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:40:01.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:40:01.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:40:31.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:40:31.820 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:41:01.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:41:02.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:41:32.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:41:32.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:42:02.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:42:02.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:42:32.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:42:32.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:43:02.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:43:02.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:43:32.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:43:32.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:44:02.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:44:02.644 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:44:32.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:44:32.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:45:02.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:45:02.871 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:45:32.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:45:32.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:46:03.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:46:03.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:46:33.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:46:33.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:46:47.001 INFO:teuthology.orchestra.run.smithi046.stdout:generic/522 3651s 2023-05-21T21:46:47.023 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/522 2023-05-21T21:46:47.023 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:47.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:48.605 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-05-21T21:46:49.374 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:49.446 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:49.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:49.659 INFO:teuthology.orchestra.run.smithi046.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:49.668 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/523 2023-05-21T21:46:49.676 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/523 2023-05-21T21:46:49.676 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:49.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:49.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:49.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-05-21T21:46:50.028 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:50.037 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:50.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:50.285 INFO:teuthology.orchestra.run.smithi046.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:50.293 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/524 2023-05-21T21:46:50.293 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/524 2023-05-21T21:46:50.294 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:50.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:50.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:50.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-05-21T21:46:50.632 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:50.642 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:50.642 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:50.908 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/525 2023-05-21T21:46:50.908 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/525 2023-05-21T21:46:50.908 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:50.915 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:50.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:50.932 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-05-21T21:46:51.260 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:51.269 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:51.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:51.589 INFO:teuthology.orchestra.run.smithi046.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:51.598 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/526 2023-05-21T21:46:51.598 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/526 2023-05-21T21:46:51.599 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:51.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:51.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:51.622 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-05-21T21:46:51.943 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:51.953 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:51.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:52.240 INFO:teuthology.orchestra.run.smithi046.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:52.249 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/527 2023-05-21T21:46:52.249 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/527 2023-05-21T21:46:52.249 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:52.255 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:52.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:52.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-05-21T21:46:52.589 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:52.599 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:52.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:52.930 INFO:teuthology.orchestra.run.smithi046.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-05-21T21:46:52.939 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/528 2023-05-21T21:46:52.940 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/528 2023-05-21T21:46:52.940 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:52.946 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:52.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:52.964 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-05-21T21:46:53.293 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:53.302 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:53.608 INFO:teuthology.orchestra.run.smithi046.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-21T21:46:53.615 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/529 2023-05-21T21:46:53.615 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/529 2023-05-21T21:46:53.615 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:53.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:53.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:53.636 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-05-21T21:46:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:53.972 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:53.973 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:54.229 INFO:teuthology.orchestra.run.smithi046.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:54.238 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/530 2023-05-21T21:46:54.238 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/530 2023-05-21T21:46:54.238 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:54.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:54.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:54.262 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-05-21T21:46:54.577 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:54.586 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:54.586 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:54.840 INFO:teuthology.orchestra.run.smithi046.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:54.848 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/531 2023-05-21T21:46:54.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/531 2023-05-21T21:46:54.849 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:54.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:54.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:54.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-05-21T21:46:55.195 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:55.205 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:55.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:55.562 INFO:teuthology.orchestra.run.smithi046.stdout:generic/532 0s 2023-05-21T21:46:55.576 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/532 2023-05-21T21:46:55.577 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:55.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:55.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:55.601 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-05-21T21:46:55.923 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:55.931 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:55.932 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:56.658 INFO:teuthology.orchestra.run.smithi046.stdout:generic/533 1s 2023-05-21T21:46:56.671 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/533 2023-05-21T21:46:56.671 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:56.676 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:56.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:56.694 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-05-21T21:46:57.020 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:57.028 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:57.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:57.311 INFO:teuthology.orchestra.run.smithi046.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:57.320 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/534 2023-05-21T21:46:57.321 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/534 2023-05-21T21:46:57.321 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:57.327 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:57.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:57.345 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-05-21T21:46:57.673 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:57.682 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:57.976 INFO:teuthology.orchestra.run.smithi046.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:57.986 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/535 2023-05-21T21:46:57.986 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/535 2023-05-21T21:46:57.986 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:57.992 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:58.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:58.011 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-05-21T21:46:58.340 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:58.350 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:58.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:58.612 INFO:teuthology.orchestra.run.smithi046.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:58.620 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/536 2023-05-21T21:46:58.621 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/536 2023-05-21T21:46:58.621 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:58.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:58.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:58.644 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-05-21T21:46:58.978 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:58.988 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:58.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:59.252 INFO:teuthology.orchestra.run.smithi046.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T21:46:59.264 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/537 2023-05-21T21:46:59.264 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/537 2023-05-21T21:46:59.264 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T21:46:59.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:46:59.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T21:46:59.283 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-05-21T21:46:59.617 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T21:46:59.626 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T21:46:59.627 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T21:47:03.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:47:03.267 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:47:33.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:47:33.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:48:03.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:48:03.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:48:33.565 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:48:33.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:49:03.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:49:03.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:49:33.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:49:33.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:50:03.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:50:03.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:50:33.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:50:33.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:51:03.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:51:03.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:51:34.029 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:51:34.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:52:04.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:52:04.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:52:34.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:52:34.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:53:04.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:53:04.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:53:34.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:53:34.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:54:04.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:54:04.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:54:34.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:54:34.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:55:04.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:55:04.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:55:34.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:55:34.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:56:05.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:56:05.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:56:35.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:56:35.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:57:05.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:57:05.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:57:35.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:57:35.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:58:05.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:58:05.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:58:35.964 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:58:36.025 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:59:06.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:59:06.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:59:36.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T21:59:36.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:00:06.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:00:06.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:00:36.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:00:36.342 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:01:06.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:01:06.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:01:36.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:01:36.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:02:06.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:02:06.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:02:36.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:02:36.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:03:06.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:03:06.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:03:37.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:03:37.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:04:07.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:04:07.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:04:37.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:04:37.251 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:05:07.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:05:07.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:05:37.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:05:37.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:06:07.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:06:07.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:06:37.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:06:37.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:07:07.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:07:07.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:07:37.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:07:37.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:08:07.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:08:08.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:08:38.129 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:08:38.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:09:08.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:09:08.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:09:38.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:09:38.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:10:08.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:10:08.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:10:38.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:10:38.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:11:08.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:11:08.780 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:11:38.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:11:38.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:12:09.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:12:09.023 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:12:39.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:12:39.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:13:09.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:13:09.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:13:39.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:13:39.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:14:09.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:14:09.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:14:39.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:14:39.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:15:09.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:15:09.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:15:39.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:15:39.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:16:09.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:16:09.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:16:39.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:16:39.896 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:17:09.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:17:09.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:17:40.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:17:40.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:18:10.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:18:10.196 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:18:40.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:18:40.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:19:10.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:19:10.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:19:40.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:19:40.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:20:10.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:20:10.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:20:40.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:20:40.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:21:10.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:21:10.606 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:21:40.651 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:21:40.690 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:22:10.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:22:10.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:22:40.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:22:40.795 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:23:10.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:23:10.860 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:23:40.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:23:40.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:24:11.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:24:11.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:24:41.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:24:41.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:25:11.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:25:11.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:25:41.304 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:25:41.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:26:11.552 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:26:11.575 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:26:41.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:26:41.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:27:11.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:27:11.708 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:27:41.764 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:27:41.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:28:11.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:28:11.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:28:41.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:28:41.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:29:11.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:29:11.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:29:42.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:29:42.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:30:12.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:30:12.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:30:42.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:30:42.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:31:12.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:31:12.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:31:42.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:31:42.270 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:32:12.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:32:12.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:32:42.366 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:32:42.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:33:12.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:33:12.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:33:42.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:33:42.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:34:12.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:34:12.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:34:42.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:34:42.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:35:12.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:35:12.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:35:42.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:35:42.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:36:12.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:36:12.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:36:43.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:36:43.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:37:13.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:37:13.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:37:43.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:37:43.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:38:13.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:38:13.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:38:43.511 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:38:43.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:39:13.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:39:13.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:39:43.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:39:43.658 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:40:13.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:40:13.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:40:43.764 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:40:43.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:41:13.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:41:13.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:41:43.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:41:43.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:42:13.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:42:13.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:42:43.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:42:43.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:43:14.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:43:14.031 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:43:44.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:43:44.104 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:44:14.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:44:14.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:44:44.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:44:44.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:45:14.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:45:14.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:45:44.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:45:44.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:46:14.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:46:14.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:46:44.802 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:46:44.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:47:14.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:47:14.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:47:44.947 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:47:44.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:48:15.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:48:15.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:48:45.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:48:45.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:49:15.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:49:15.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:49:45.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:49:45.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:50:15.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:50:15.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:50:45.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:50:45.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:51:15.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:51:15.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:51:45.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:51:45.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:52:15.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:52:15.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:52:45.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:52:45.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:53:15.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:53:16.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:53:46.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:53:46.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:54:16.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:54:16.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:54:46.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:54:46.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:55:16.224 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:55:16.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:55:46.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:55:46.297 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:56:16.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:56:16.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:56:46.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:56:46.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:57:16.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:57:16.510 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:57:46.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:57:46.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:58:16.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:58:16.670 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:58:29.797 INFO:teuthology.orchestra.run.smithi046.stdout:generic/538 4290s 2023-05-21T22:58:29.810 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/538 2023-05-21T22:58:29.810 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:29.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:30.140 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-05-21T22:58:30.704 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:30.713 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:34.263 INFO:teuthology.orchestra.run.smithi046.stdout:generic/539 4s 2023-05-21T22:58:34.276 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/539 2023-05-21T22:58:34.277 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:34.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:34.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:34.301 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-05-21T22:58:34.982 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:34.991 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:34.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:35.299 INFO:teuthology.orchestra.run.smithi046.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:35.308 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/540 2023-05-21T22:58:35.308 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/540 2023-05-21T22:58:35.308 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:35.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:35.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:35.338 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-05-21T22:58:35.656 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:35.666 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:35.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:35.931 INFO:teuthology.orchestra.run.smithi046.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:35.938 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/541 2023-05-21T22:58:35.938 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/541 2023-05-21T22:58:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:35.943 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:35.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:35.960 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-05-21T22:58:36.291 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:36.300 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:36.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:36.562 INFO:teuthology.orchestra.run.smithi046.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:36.570 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/542 2023-05-21T22:58:36.570 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/542 2023-05-21T22:58:36.570 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:36.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:36.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:36.593 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-05-21T22:58:36.911 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:36.920 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:36.921 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:37.182 INFO:teuthology.orchestra.run.smithi046.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:37.191 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/543 2023-05-21T22:58:37.191 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/543 2023-05-21T22:58:37.191 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:37.197 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:37.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:37.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-05-21T22:58:37.537 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:37.546 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:37.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:37.811 INFO:teuthology.orchestra.run.smithi046.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:37.819 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/544 2023-05-21T22:58:37.819 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/544 2023-05-21T22:58:37.819 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:37.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:37.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:37.842 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-05-21T22:58:38.162 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:38.170 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:38.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:38.521 INFO:teuthology.orchestra.run.smithi046.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-05-21T22:58:38.527 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/545 2023-05-21T22:58:38.527 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/545 2023-05-21T22:58:38.528 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:38.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:38.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:38.559 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-05-21T22:58:38.886 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:38.895 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:38.895 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:39.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:39.311 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/546 2023-05-21T22:58:39.311 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/546 2023-05-21T22:58:39.311 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:39.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:39.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:39.335 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-05-21T22:58:39.653 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:39.663 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:39.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:39.953 INFO:teuthology.orchestra.run.smithi046.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:39.961 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/547 2023-05-21T22:58:39.961 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/547 2023-05-21T22:58:39.961 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:39.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:39.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:39.985 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-05-21T22:58:40.302 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:40.311 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:40.311 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:40.652 INFO:teuthology.orchestra.run.smithi046.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:40.662 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/548 2023-05-21T22:58:40.662 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/548 2023-05-21T22:58:40.662 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:40.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:40.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:40.685 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-05-21T22:58:41.001 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:41.011 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:41.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:41.338 INFO:teuthology.orchestra.run.smithi046.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:41.348 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/549 2023-05-21T22:58:41.348 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/549 2023-05-21T22:58:41.348 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:41.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:41.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:41.372 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-05-21T22:58:41.691 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:41.701 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:41.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:42.028 INFO:teuthology.orchestra.run.smithi046.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:42.037 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/550 2023-05-21T22:58:42.038 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/550 2023-05-21T22:58:42.038 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:42.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:42.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:42.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-05-21T22:58:42.383 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:42.392 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:42.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:42.662 INFO:teuthology.orchestra.run.smithi046.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:42.671 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/551 2023-05-21T22:58:42.671 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/551 2023-05-21T22:58:42.671 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:42.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:42.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:42.696 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-05-21T22:58:43.013 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:43.022 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:43.022 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:43.308 INFO:teuthology.orchestra.run.smithi046.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:43.317 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/552 2023-05-21T22:58:43.317 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/552 2023-05-21T22:58:43.318 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:43.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:43.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:43.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-05-21T22:58:43.658 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:43.667 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:43.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:44.106 INFO:teuthology.orchestra.run.smithi046.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-05-21T22:58:44.116 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/553 2023-05-21T22:58:44.116 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/553 2023-05-21T22:58:44.116 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:44.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:44.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:44.167 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-05-21T22:58:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:44.849 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:45.108 INFO:teuthology.orchestra.run.smithi046.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/554 2023-05-21T22:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/554 2023-05-21T22:58:45.117 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:45.123 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:45.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:45.142 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-05-21T22:58:45.456 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:45.465 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:45.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:45.871 INFO:teuthology.orchestra.run.smithi046.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-05-21T22:58:45.880 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/555 2023-05-21T22:58:45.880 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/555 2023-05-21T22:58:45.880 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:45.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:45.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:45.914 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-05-21T22:58:46.615 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:46.624 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:46.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:46.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:58:46.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:58:46.909 INFO:teuthology.orchestra.run.smithi046.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/556 2023-05-21T22:58:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/556 2023-05-21T22:58:46.917 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:46.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:46.939 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-05-21T22:58:47.264 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:47.274 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:47.569 INFO:teuthology.orchestra.run.smithi046.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:47.579 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/557 2023-05-21T22:58:47.580 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/557 2023-05-21T22:58:47.580 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:47.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:47.603 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-05-21T22:58:47.922 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:47.931 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:48.207 INFO:teuthology.orchestra.run.smithi046.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:48.216 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/558 2023-05-21T22:58:48.217 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/558 2023-05-21T22:58:48.217 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:48.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:48.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-05-21T22:58:48.567 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:48.576 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:48.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:48.836 INFO:teuthology.orchestra.run.smithi046.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:48.844 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/559 2023-05-21T22:58:48.844 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/559 2023-05-21T22:58:48.844 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:48.849 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:48.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:48.868 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-05-21T22:58:49.193 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:49.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:49.461 INFO:teuthology.orchestra.run.smithi046.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:49.470 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/560 2023-05-21T22:58:49.470 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/560 2023-05-21T22:58:49.470 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:49.475 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:49.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:49.493 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-05-21T22:58:49.811 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:49.821 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:50.079 INFO:teuthology.orchestra.run.smithi046.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:50.086 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/561 2023-05-21T22:58:50.086 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/561 2023-05-21T22:58:50.086 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:50.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:50.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:50.106 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-05-21T22:58:50.409 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:50.419 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:50.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:50.674 INFO:teuthology.orchestra.run.smithi046.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:50.682 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/562 2023-05-21T22:58:50.683 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/562 2023-05-21T22:58:50.683 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:50.689 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:50.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:50.707 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-05-21T22:58:51.025 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:51.035 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:51.035 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:51.330 INFO:teuthology.orchestra.run.smithi046.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:51.340 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/563 2023-05-21T22:58:51.340 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/563 2023-05-21T22:58:51.340 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:51.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:51.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:51.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-05-21T22:58:51.698 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:51.706 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:52.717 INFO:teuthology.orchestra.run.smithi046.stdout:generic/564 1s 2023-05-21T22:58:52.730 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/564 2023-05-21T22:58:52.730 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:52.735 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:52.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:52.752 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-05-21T22:58:53.444 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:53.453 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:53.453 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:53.710 INFO:teuthology.orchestra.run.smithi046.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:53.719 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/565 2023-05-21T22:58:53.719 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/565 2023-05-21T22:58:53.719 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:53.724 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:53.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:53.742 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-05-21T22:58:54.064 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:54.073 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:54.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:54.341 INFO:teuthology.orchestra.run.smithi046.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:54.350 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/566 2023-05-21T22:58:54.351 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/566 2023-05-21T22:58:54.351 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:54.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:54.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:54.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-05-21T22:58:54.696 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:54.705 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:54.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:54.964 INFO:teuthology.orchestra.run.smithi046.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:54.972 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/567 2023-05-21T22:58:54.973 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/567 2023-05-21T22:58:54.973 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:54.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:54.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:54.998 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-05-21T22:58:55.312 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:55.321 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:55.321 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:55.722 INFO:teuthology.orchestra.run.smithi046.stdout:generic/568 0s 2023-05-21T22:58:55.752 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/568 2023-05-21T22:58:55.752 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:55.881 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:56.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:56.060 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-05-21T22:58:56.450 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:56.459 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:56.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:56.817 INFO:teuthology.orchestra.run.smithi046.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:56.826 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/569 2023-05-21T22:58:56.827 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/569 2023-05-21T22:58:56.827 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:56.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:56.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:56.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-05-21T22:58:57.169 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:57.178 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:57.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:57.444 INFO:teuthology.orchestra.run.smithi046.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:58:57.453 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/570 2023-05-21T22:58:57.453 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/570 2023-05-21T22:58:57.453 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:58:57.459 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:58:57.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:58:57.475 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-05-21T22:58:57.807 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:58:57.816 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:58:57.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:04.248 INFO:teuthology.orchestra.run.smithi046.stdout:generic/571 7s 2023-05-21T22:59:04.260 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/571 2023-05-21T22:59:04.260 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:04.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:04.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:04.283 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-05-21T22:59:04.945 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:04.955 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:04.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:05.219 INFO:teuthology.orchestra.run.smithi046.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:05.227 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/572 2023-05-21T22:59:05.228 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/572 2023-05-21T22:59:05.228 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:05.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:05.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:05.273 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-05-21T22:59:05.601 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:05.609 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:05.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:05.887 INFO:teuthology.orchestra.run.smithi046.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:05.894 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/573 2023-05-21T22:59:05.895 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/573 2023-05-21T22:59:05.895 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:05.901 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:05.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:05.918 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-05-21T22:59:06.253 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:06.261 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:06.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:06.512 INFO:teuthology.orchestra.run.smithi046.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/574 2023-05-21T22:59:06.521 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/574 2023-05-21T22:59:06.521 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:06.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:06.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:06.546 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-05-21T22:59:06.873 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:06.882 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:06.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:07.145 INFO:teuthology.orchestra.run.smithi046.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:07.153 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/575 2023-05-21T22:59:07.153 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/575 2023-05-21T22:59:07.153 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:07.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:07.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:07.177 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-05-21T22:59:07.497 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:07.506 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:07.507 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:07.838 INFO:teuthology.orchestra.run.smithi046.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:07.846 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/576 2023-05-21T22:59:07.846 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/576 2023-05-21T22:59:07.846 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:07.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:07.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:07.871 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-05-21T22:59:08.192 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:08.200 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:08.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:08.459 INFO:teuthology.orchestra.run.smithi046.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:08.468 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/577 2023-05-21T22:59:08.468 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/577 2023-05-21T22:59:08.468 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:08.474 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:08.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:08.492 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-05-21T22:59:08.816 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:08.826 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:09.212 INFO:teuthology.orchestra.run.smithi046.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T22:59:09.220 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/578 2023-05-21T22:59:09.220 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/578 2023-05-21T22:59:09.221 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:09.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:09.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:09.243 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-05-21T22:59:09.930 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:09.940 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:09.940 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:10.287 INFO:teuthology.orchestra.run.smithi046.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:10.296 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/579 2023-05-21T22:59:10.296 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/579 2023-05-21T22:59:10.296 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:10.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:10.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:10.319 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-05-21T22:59:10.645 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:10.653 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:10.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:11.009 INFO:teuthology.orchestra.run.smithi046.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:11.018 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/580 2023-05-21T22:59:11.018 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/580 2023-05-21T22:59:11.018 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:11.023 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:11.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:11.041 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-05-21T22:59:11.373 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:11.382 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:11.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:12.247 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/581 2023-05-21T22:59:12.247 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/581 2023-05-21T22:59:12.247 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:12.251 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:12.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:12.267 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-05-21T22:59:12.583 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:12.592 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:12.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:12.923 INFO:teuthology.orchestra.run.smithi046.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:12.931 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/582 2023-05-21T22:59:12.931 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/582 2023-05-21T22:59:12.931 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:12.937 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:12.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:12.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-05-21T22:59:13.282 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:13.292 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:13.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:13.619 INFO:teuthology.orchestra.run.smithi046.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:13.627 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/583 2023-05-21T22:59:13.627 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/583 2023-05-21T22:59:13.627 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:13.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:13.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:13.649 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-05-21T22:59:13.974 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:13.982 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:13.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:14.331 INFO:teuthology.orchestra.run.smithi046.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:14.339 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/584 2023-05-21T22:59:14.340 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/584 2023-05-21T22:59:14.340 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:14.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:14.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:14.365 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-05-21T22:59:14.697 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:14.966 INFO:teuthology.orchestra.run.smithi046.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:14.975 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/585 2023-05-21T22:59:14.976 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/585 2023-05-21T22:59:14.976 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:14.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:14.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:14.999 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-05-21T22:59:15.322 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:15.331 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:15.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:16.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:59:16.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:59:46.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:59:46.867 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T22:59:49.757 INFO:teuthology.orchestra.run.smithi046.stdout:generic/586 34s 2023-05-21T22:59:49.771 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/586 2023-05-21T22:59:49.771 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:49.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:49.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:49.791 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-05-21T22:59:50.492 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:50.500 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:50.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:51.047 INFO:teuthology.orchestra.run.smithi046.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-21T22:59:51.053 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/587 2023-05-21T22:59:51.053 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/587 2023-05-21T22:59:51.053 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:51.057 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:51.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:51.072 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-05-21T22:59:51.383 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:51.392 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:51.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:51.773 INFO:teuthology.orchestra.run.smithi046.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:51.782 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/588 2023-05-21T22:59:51.782 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/588 2023-05-21T22:59:51.783 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:51.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:51.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:51.805 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-05-21T22:59:52.117 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:52.126 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:52.127 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:52.390 INFO:teuthology.orchestra.run.smithi046.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:52.399 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/589 2023-05-21T22:59:52.399 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/589 2023-05-21T22:59:52.399 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:52.405 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:52.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:52.424 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-05-21T22:59:52.746 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:52.756 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:52.756 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:53.018 INFO:teuthology.orchestra.run.smithi046.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:53.027 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/590 2023-05-21T22:59:53.027 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/590 2023-05-21T22:59:53.027 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:53.033 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:53.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:53.052 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-05-21T22:59:53.391 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:53.400 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:53.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:generic/591 0s 2023-05-21T22:59:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/591 2023-05-21T22:59:53.981 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:53.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:54.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:54.006 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-05-21T22:59:54.724 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:54.734 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:54.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:55.063 INFO:teuthology.orchestra.run.smithi046.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:55.072 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/592 2023-05-21T22:59:55.072 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/592 2023-05-21T22:59:55.073 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:55.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:55.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:55.097 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-05-21T22:59:55.418 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:55.427 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:55.427 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:55.762 INFO:teuthology.orchestra.run.smithi046.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:55.770 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/593 2023-05-21T22:59:55.770 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/593 2023-05-21T22:59:55.771 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:55.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:55.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:55.795 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-05-21T22:59:56.109 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:56.118 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:56.118 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:56.379 INFO:teuthology.orchestra.run.smithi046.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:56.387 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/594 2023-05-21T22:59:56.387 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/594 2023-05-21T22:59:56.388 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:56.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:56.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:56.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-05-21T22:59:56.732 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:56.741 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:56.742 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:57.081 INFO:teuthology.orchestra.run.smithi046.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T22:59:57.090 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/595 2023-05-21T22:59:57.090 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/595 2023-05-21T22:59:57.091 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:57.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:57.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:57.115 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-05-21T22:59:57.434 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:57.443 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:57.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:57.706 INFO:teuthology.orchestra.run.smithi046.stdout:generic/596 [not run] accton utility required, skipped this test 2023-05-21T22:59:57.715 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/596 2023-05-21T22:59:57.715 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/596 2023-05-21T22:59:57.715 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T22:59:57.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:57.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T22:59:57.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-05-21T22:59:58.069 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T22:59:58.079 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T22:59:58.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:59.510 INFO:teuthology.orchestra.run.smithi046.stdout:generic/597 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/597.out.bad) 2023-05-21T22:59:59.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T22:59:59.605 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/597.out 2023-05-21 16:55:34.867774419 +0000 2023-05-21T22:59:59.605 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/597.out.bad 2023-05-21 22:59:59.504444819 +0000 2023-05-21T22:59:59.619 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -4,11 +4,11 @@ 2023-05-21T22:59:59.619 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_symlinks = 0 2023-05-21T22:59:59.638 INFO:teuthology.orchestra.run.smithi046.stdout: successfully followed symlink 2023-05-21T22:59:59.638 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_symlinks = 1 2023-05-21T22:59:59.638 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T22:59:59.669 INFO:teuthology.orchestra.run.smithi046.stdout: +successfully followed symlink 2023-05-21T22:59:59.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:59.677 INFO:teuthology.orchestra.run.smithi046.stdout: == Test hardlink create protection when 2023-05-21T22:59:59.677 INFO:teuthology.orchestra.run.smithi046.stdout: == process != target owner and process cannot read target 2023-05-21T22:59:59.677 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_hardlinks = 0 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout: -successfully created hardlink 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout: +Permission denied 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_hardlinks = 1 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout: +Permission denied 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/597 2023-05-21T22:59:59.678 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/597 2023-05-21T22:59:59.679 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T22:59:59.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T22:59:59.679 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T22:59:59.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T22:59:59.778 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-05-21T23:00:00.254 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:00.261 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:00.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:01.168 INFO:teuthology.orchestra.run.smithi046.stdout:generic/598 - output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/598.out.bad) 2023-05-21T23:00:01.180 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/598.out 2023-05-21 16:55:34.867774419 +0000 2023-05-21T23:00:01.180 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/598.out.bad 2023-05-21 23:00:01.164427373 +0000 2023-05-21T23:00:01.180 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -5,13 +5,10 @@ 2023-05-21T23:00:01.180 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2023-05-21T23:00:01.181 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_regular = 1 2023-05-21T23:00:01.194 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2023-05-21T23:00:01.194 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T23:00:01.194 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2023-05-21T23:00:01.194 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_regular = 2 2023-05-21T23:00:01.194 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2023-05-21T23:00:01.195 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T23:00:01.195 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2023-05-21T23:00:01.195 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T23:00:01.195 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:01.195 INFO:teuthology.orchestra.run.smithi046.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-05-21T23:00:01.226 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_fifos = 0 2023-05-21T23:00:01.227 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -19,10 +16,7 @@ 2023-05-21T23:00:01.247 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2023-05-21T23:00:01.247 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_fifos = 1 2023-05-21T23:00:01.273 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2023-05-21T23:00:01.273 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T23:00:01.273 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout: fs.protected_fifos = 2 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout: = group & world writable dir 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout: = only group writable dir 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout: -Permission denied 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/598 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/598 2023-05-21T23:00:01.274 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T23:00:01.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T23:00:01.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:01.294 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T23:00:01.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T23:00:01.295 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-05-21T23:00:01.929 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:01.938 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:01.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:02.229 INFO:teuthology.orchestra.run.smithi046.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:02.238 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/599 2023-05-21T23:00:02.238 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/599 2023-05-21T23:00:02.238 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:02.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:02.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:02.260 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-05-21T23:00:02.582 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:02.592 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:02.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:02.862 INFO:teuthology.orchestra.run.smithi046.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:02.870 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/600 2023-05-21T23:00:02.870 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/600 2023-05-21T23:00:02.871 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:02.876 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:02.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:02.893 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-05-21T23:00:03.207 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:03.216 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:03.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:03.474 INFO:teuthology.orchestra.run.smithi046.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:03.483 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/601 2023-05-21T23:00:03.483 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/601 2023-05-21T23:00:03.483 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:03.488 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:03.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:03.514 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-05-21T23:00:03.837 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:03.847 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:03.847 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:04.183 INFO:teuthology.orchestra.run.smithi046.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:04.191 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/602 2023-05-21T23:00:04.192 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/602 2023-05-21T23:00:04.192 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:04.196 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:04.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:04.215 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-05-21T23:00:04.541 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:04.550 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:04.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:04.819 INFO:teuthology.orchestra.run.smithi046.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:04.828 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/603 2023-05-21T23:00:04.828 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/603 2023-05-21T23:00:04.828 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:04.833 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:04.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:04.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-05-21T23:00:05.163 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:05.172 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:05.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:05.433 INFO:teuthology.orchestra.run.smithi046.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:05.442 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/604 2023-05-21T23:00:05.442 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/604 2023-05-21T23:00:05.442 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:05.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:05.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:05.465 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-05-21T23:00:05.778 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:05.788 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:05.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:06.046 INFO:teuthology.orchestra.run.smithi046.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:06.054 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/605 2023-05-21T23:00:06.054 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/605 2023-05-21T23:00:06.054 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:06.060 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:06.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:06.078 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-05-21T23:00:06.400 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:06.408 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:06.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:06.667 INFO:teuthology.orchestra.run.smithi046.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:06.675 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/606 2023-05-21T23:00:06.675 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/606 2023-05-21T23:00:06.675 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:06.680 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:06.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:06.698 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-05-21T23:00:07.013 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:07.021 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:07.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:07.286 INFO:teuthology.orchestra.run.smithi046.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:07.294 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/607 2023-05-21T23:00:07.295 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/607 2023-05-21T23:00:07.295 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:07.300 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:07.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:07.318 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-05-21T23:00:07.637 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:07.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:07.910 INFO:teuthology.orchestra.run.smithi046.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:07.919 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/608 2023-05-21T23:00:07.919 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/608 2023-05-21T23:00:07.920 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:07.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:07.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:07.943 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-05-21T23:00:08.269 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:08.278 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:08.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:09.074 INFO:teuthology.orchestra.run.smithi046.stdout:generic/609 1s 2023-05-21T23:00:09.087 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/609 2023-05-21T23:00:09.088 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:09.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:09.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:09.112 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-05-21T23:00:09.831 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:09.840 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:09.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:10.100 INFO:teuthology.orchestra.run.smithi046.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:10.107 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/610 2023-05-21T23:00:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/610 2023-05-21T23:00:10.108 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:10.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:10.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:10.131 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-05-21T23:00:10.441 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:10.449 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:10.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:10.705 INFO:teuthology.orchestra.run.smithi046.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/611 2023-05-21T23:00:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/611 2023-05-21T23:00:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:10.717 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:10.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:10.735 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-05-21T23:00:11.038 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:11.047 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:11.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:11.430 INFO:teuthology.orchestra.run.smithi046.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T23:00:11.437 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/612 2023-05-21T23:00:11.438 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/612 2023-05-21T23:00:11.438 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:11.442 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:11.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:11.460 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-05-21T23:00:12.136 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:12.146 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:12.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:12.481 INFO:teuthology.orchestra.run.smithi046.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:12.490 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/613 2023-05-21T23:00:12.490 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/613 2023-05-21T23:00:12.491 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:12.496 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:12.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:12.514 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-05-21T23:00:12.836 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:12.845 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:12.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:13.109 INFO:teuthology.orchestra.run.smithi046.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:13.117 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/614 2023-05-21T23:00:13.118 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/614 2023-05-21T23:00:13.118 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:13.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:13.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:13.142 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-05-21T23:00:13.466 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:13.475 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:13.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:13.735 INFO:teuthology.orchestra.run.smithi046.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:13.743 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/615 2023-05-21T23:00:13.743 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/615 2023-05-21T23:00:13.743 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:13.749 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:13.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:13.768 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-05-21T23:00:14.089 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:14.098 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:14.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:14.366 INFO:teuthology.orchestra.run.smithi046.stdout:generic/616 [not run] kernel does not support IO_URING 2023-05-21T23:00:14.376 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/616 2023-05-21T23:00:14.376 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/616 2023-05-21T23:00:14.377 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:14.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:14.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:14.402 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-05-21T23:00:14.726 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:14.734 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:14.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:15.088 INFO:teuthology.orchestra.run.smithi046.stdout:generic/617 [not run] kernel does not support IO_URING 2023-05-21T23:00:15.095 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/617 2023-05-21T23:00:15.095 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/617 2023-05-21T23:00:15.096 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:15.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:15.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:15.119 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-05-21T23:00:15.444 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:15.452 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:15.452 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:15.711 INFO:teuthology.orchestra.run.smithi046.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:15.720 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/618 2023-05-21T23:00:15.721 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/618 2023-05-21T23:00:15.721 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:15.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:15.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:15.745 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-05-21T23:00:16.228 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:16.236 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:16.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:16.497 INFO:teuthology.orchestra.run.smithi046.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:16.505 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/619 2023-05-21T23:00:16.506 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/619 2023-05-21T23:00:16.506 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:16.512 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:16.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:16.528 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-05-21T23:00:16.836 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:16.844 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:16.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:16.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:00:16.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:00:17.193 INFO:teuthology.orchestra.run.smithi046.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:17.203 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/620 2023-05-21T23:00:17.203 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/620 2023-05-21T23:00:17.203 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:17.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:17.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:17.261 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-05-21T23:00:17.585 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:17.595 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:17.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:17.937 INFO:teuthology.orchestra.run.smithi046.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:17.945 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/621 2023-05-21T23:00:17.946 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/621 2023-05-21T23:00:17.946 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:17.952 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:17.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:17.971 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-05-21T23:00:18.292 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:18.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:18.560 INFO:teuthology.orchestra.run.smithi046.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/622 2023-05-21T23:00:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/622 2023-05-21T23:00:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:18.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:18.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:18.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-05-21T23:00:18.918 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:18.927 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:18.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:19.188 INFO:teuthology.orchestra.run.smithi046.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:19.196 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/623 2023-05-21T23:00:19.197 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/623 2023-05-21T23:00:19.197 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:19.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:19.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:19.216 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-05-21T23:00:19.551 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:19.559 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:19.560 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:19.827 INFO:teuthology.orchestra.run.smithi046.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:19.835 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/624 2023-05-21T23:00:19.836 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/624 2023-05-21T23:00:19.836 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:19.841 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:19.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:19.860 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-05-21T23:00:20.181 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:20.189 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:20.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:20.458 INFO:teuthology.orchestra.run.smithi046.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:20.466 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/625 2023-05-21T23:00:20.467 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/625 2023-05-21T23:00:20.467 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:20.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:20.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:20.490 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-05-21T23:00:20.806 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:20.815 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:20.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:21.090 INFO:teuthology.orchestra.run.smithi046.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:21.099 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/626 2023-05-21T23:00:21.099 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/626 2023-05-21T23:00:21.099 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:21.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:21.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:21.123 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-05-21T23:00:21.440 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:21.449 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:21.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:21.713 INFO:teuthology.orchestra.run.smithi046.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:21.722 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/627 2023-05-21T23:00:21.722 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/627 2023-05-21T23:00:21.722 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:21.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:21.744 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-05-21T23:00:22.065 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:22.074 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:22.379 INFO:teuthology.orchestra.run.smithi046.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:22.388 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/628 2023-05-21T23:00:22.388 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/628 2023-05-21T23:00:22.388 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:22.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:22.410 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-05-21T23:00:22.730 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:22.739 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:22.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:23.027 INFO:teuthology.orchestra.run.smithi046.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:23.036 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/629 2023-05-21T23:00:23.036 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/629 2023-05-21T23:00:23.036 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:23.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:23.064 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-05-21T23:00:23.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:23.398 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:23.398 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:23.651 INFO:teuthology.orchestra.run.smithi046.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:23.660 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/630 2023-05-21T23:00:23.660 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/630 2023-05-21T23:00:23.660 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:23.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:23.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:23.684 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-05-21T23:00:24.008 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:24.017 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:24.274 INFO:teuthology.orchestra.run.smithi046.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/631 2023-05-21T23:00:24.283 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/631 2023-05-21T23:00:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:24.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:24.307 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-05-21T23:00:24.628 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:24.637 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:28.703 INFO:teuthology.orchestra.run.smithi046.stdout:generic/632 4s 2023-05-21T23:00:28.715 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/632 2023-05-21T23:00:28.716 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:28.721 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:28.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:28.737 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-05-21T23:00:29.048 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:29.056 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:29.057 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:29.793 INFO:teuthology.orchestra.run.smithi046.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/633.out.bad) 2023-05-21T23:00:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: --- tests/generic/633.out 2023-05-21 16:55:34.867774419 +0000 2023-05-21T23:00:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: +++ /tmp/tmp.wfxug4os5zxfstests-dev/results//generic/633.out.bad 2023-05-21 23:00:29.756126897 +0000 2023-05-21T23:00:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: @@ -1,2 +1,3 @@ 2023-05-21T23:00:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: QA output created by 633 2023-05-21T23:00:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: Silence is golden 2023-05-21T23:00:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-05-21T23:00:30.039 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/633 2023-05-21T23:00:30.039 INFO:teuthology.orchestra.run.smithi046.stdout:Failures: generic/633 2023-05-21T23:00:30.039 INFO:teuthology.orchestra.run.smithi046.stdout:Failed 1 of 1 tests 2023-05-21T23:00:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:30.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-21T23:00:30.163 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-21T23:00:30.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-21T23:00:30.164 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-05-21T23:00:30.513 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:30.521 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:30.782 INFO:teuthology.orchestra.run.smithi046.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:30.791 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/634 2023-05-21T23:00:30.791 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/634 2023-05-21T23:00:30.791 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:30.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:30.814 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-05-21T23:00:31.140 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:31.149 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:31.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:31.399 INFO:teuthology.orchestra.run.smithi046.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:31.406 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/635 2023-05-21T23:00:31.406 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/635 2023-05-21T23:00:31.407 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:31.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:31.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:31.430 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-05-21T23:00:31.756 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:31.766 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:31.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:32.026 INFO:teuthology.orchestra.run.smithi046.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:32.035 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/636 2023-05-21T23:00:32.035 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/636 2023-05-21T23:00:32.036 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:32.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:32.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:32.062 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-05-21T23:00:32.378 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:32.386 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:32.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:34.633 INFO:teuthology.orchestra.run.smithi046.stdout:generic/637 2s 2023-05-21T23:00:34.646 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/637 2023-05-21T23:00:34.646 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:34.652 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:34.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:34.670 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-05-21T23:00:35.305 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:35.313 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:35.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:35.656 INFO:teuthology.orchestra.run.smithi046.stdout:generic/638 0s 2023-05-21T23:00:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/638 2023-05-21T23:00:35.669 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:35.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:35.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:35.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-05-21T23:00:36.007 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:36.017 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:36.017 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:40.512 INFO:teuthology.orchestra.run.smithi046.stdout:generic/639 4s 2023-05-21T23:00:40.523 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/639 2023-05-21T23:00:40.523 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:40.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:40.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:40.547 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-05-21T23:00:40.871 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:40.879 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:40.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:41.201 INFO:teuthology.orchestra.run.smithi046.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:41.210 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/640 2023-05-21T23:00:41.210 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/640 2023-05-21T23:00:41.210 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:41.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:41.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:41.235 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-05-21T23:00:41.554 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:41.563 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:41.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:41.820 INFO:teuthology.orchestra.run.smithi046.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:41.829 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/641 2023-05-21T23:00:41.829 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/641 2023-05-21T23:00:41.829 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:41.835 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:41.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:41.853 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-05-21T23:00:42.166 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:42.175 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:42.446 INFO:teuthology.orchestra.run.smithi046.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:42.455 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/642 2023-05-21T23:00:42.455 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/642 2023-05-21T23:00:42.455 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:42.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:42.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:42.478 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-05-21T23:00:42.795 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:42.804 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:42.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:43.061 INFO:teuthology.orchestra.run.smithi046.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:43.069 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/643 2023-05-21T23:00:43.070 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/643 2023-05-21T23:00:43.070 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:43.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:43.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-05-21T23:00:43.414 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:43.422 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:43.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:43.689 INFO:teuthology.orchestra.run.smithi046.stdout:generic/644 [not run] kernel does not support mount_setattr syscall 2023-05-21T23:00:43.696 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/644 2023-05-21T23:00:43.697 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/644 2023-05-21T23:00:43.697 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:43.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:43.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:43.721 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-05-21T23:00:44.034 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:44.043 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:44.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:44.308 INFO:teuthology.orchestra.run.smithi046.stdout:generic/645 [not run] kernel does not support mount_setattr syscall 2023-05-21T23:00:44.316 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/645 2023-05-21T23:00:44.316 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/645 2023-05-21T23:00:44.317 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:44.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:44.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:44.340 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-05-21T23:00:44.668 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:44.677 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:44.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:44.931 INFO:teuthology.orchestra.run.smithi046.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:44.939 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/646 2023-05-21T23:00:44.940 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/646 2023-05-21T23:00:44.940 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:44.945 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:44.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:44.963 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-05-21T23:00:45.277 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:45.286 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:45.286 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:generic/647 0s 2023-05-21T23:00:45.872 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/647 2023-05-21T23:00:45.872 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:45.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:45.895 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-05-21T23:00:46.598 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:46.606 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:46.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:46.912 INFO:teuthology.orchestra.run.smithi046.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-05-21T23:00:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/648 2023-05-21T23:00:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/648 2023-05-21T23:00:46.921 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:46.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:46.946 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-05-21T23:00:47.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:00:47.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:00:47.265 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:47.275 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:47.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-21T23:00:47.669 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/649 2023-05-21T23:00:47.669 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/649 2023-05-21T23:00:47.669 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-21T23:00:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:00:47.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-21T23:00:47.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-05-21T23:00:48.404 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-21T23:00:48.414 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-21T23:00:48.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-21T23:01:17.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:01:17.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:01:47.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:01:47.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:02:17.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:02:17.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:02:47.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:02:47.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:03:18.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:03:18.350 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:03:48.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:03:48.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:04:19.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:04:19.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:04:49.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:04:49.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:05:19.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:05:19.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:05:49.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:05:49.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:06:19.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:06:19.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:06:49.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:06:49.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:07:19.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:07:19.684 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:07:50.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:07:50.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:08:20.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:08:20.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:08:50.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:08:50.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:09:20.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:09:20.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:09:51.377 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:09:51.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:09:51.708 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T23:09:51.702+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 443060) UID: 0 2023-05-21T23:09:51.711 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T23:09:51.702+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 443060) UID: 0 2023-05-21T23:14:50.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:14:50.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:15:21.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:15:21.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:15:51.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:15:51.163 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:16:21.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:16:21.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:16:51.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:16:51.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:17:22.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:17:22.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:17:52.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:17:52.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:18:22.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:18:22.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:18:52.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:18:52.644 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:19:22.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:19:22.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:19:52.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:19:52.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:20:22.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:20:22.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:20:53.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:20:53.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:21:23.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:21:23.507 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:21:53.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:21:53.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:22:23.964 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:22:23.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:22:24.008 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T23:22:24.002+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 445850) UID: 0 2023-05-21T23:22:24.009 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T23:22:24.002+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 445850) UID: 0 2023-05-21T23:26:48.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:26:48.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:26:48.685 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T23:26:48.633+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43265) UID: 0 2023-05-21T23:26:48.699 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T23:26:48.637+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43265) UID: 0 2023-05-21T23:26:48.729 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T23:26:48.637+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43265) UID: 0 2023-05-21T23:26:48.730 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T23:26:48.637+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43265) UID: 0 2023-05-21T23:31:22.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:31:23.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:31:53.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:31:53.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:32:23.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:32:23.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:32:53.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:32:53.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:33:24.046 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:33:24.048 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:33:54.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:33:54.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:33:54.298 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T23:33:54.291+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 448601) UID: 0 2023-05-21T23:33:54.301 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T23:33:54.291+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 448601) UID: 0 2023-05-21T23:38:19.425 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:38:19.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:38:49.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:38:49.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:39:19.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:39:19.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:39:50.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:39:50.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:40:20.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:40:20.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:40:51.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:40:51.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:41:21.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:41:21.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:41:51.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:41:51.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:42:22.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:42:22.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:42:22.122 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-21T23:42:22.111+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43355) UID: 0 2023-05-21T23:42:22.123 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-21T23:42:22.111+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43355) UID: 0 2023-05-21T23:42:22.123 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-21T23:42:22.111+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43355) UID: 0 2023-05-21T23:42:22.124 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-21T23:42:22.111+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43355) UID: 0 2023-05-21T23:44:50.425 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:44:50.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:45:20.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:45:20.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:45:50.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:45:50.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:45:50.795 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T23:45:50.787+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 451361) UID: 0 2023-05-21T23:45:50.797 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T23:45:50.787+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 451361) UID: 0 2023-05-21T23:50:15.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:50:15.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:50:45.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:50:45.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:50:45.681 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-21T23:50:45.672+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452626) UID: 0 2023-05-21T23:50:45.681 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-21T23:50:45.672+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452626) UID: 0 2023-05-21T23:50:45.682 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-21T23:50:45.672+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452626) UID: 0 2023-05-21T23:50:45.682 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-21T23:50:45.672+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 452626) UID: 0 2023-05-21T23:55:43.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:55:43.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:56:14.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:56:14.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:56:44.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:56:44.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:57:14.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:57:14.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:57:44.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:57:44.821 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-21T23:57:44.839 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-21T23:57:44.832+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 454213) UID: 0 2023-05-21T23:57:44.840 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-21T23:57:44.832+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 454213) UID: 0 2023-05-22T00:00:04.356 INFO:tasks.ceph.mon.c.smithi142.stderr:2023-05-22T00:00:03.831+0000 7fcb9d2aa700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.381 INFO:tasks.ceph.mon.c.smithi142.stderr:2023-05-22T00:00:03.831+0000 7fcb9d2aa700 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-05-22T00:00:04.500 INFO:tasks.ceph.mon.b.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f66f577f700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.534 INFO:tasks.ceph.mon.b.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f66f577f700 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-05-22T00:00:04.535 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f256c75c700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.535 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f39e6513700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.536 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f2c90627700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.536 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f91b2535700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.635 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-05-22T00:00:03.831+0000 7fe80d400700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.842 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-05-22T00:00:03.831+0000 7f79e3a2a700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 43493) UID: 0 2023-05-22T00:00:04.900 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-22T00:00:03.831+0000 7fd6ef1b6700 -1 Fail to open '/proc/43493/cmdline' error = (2) No such file or directory 2023-05-22T00:00:04.906 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-22T00:00:03.835+0000 7fd6ef1b6700 -1 received signal: Hangup from (PID: 43493) UID: 0 2023-05-22T00:00:04.907 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-05-22T00:00:03.903+0000 7fd6ef1b6700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 43494) UID: 0 2023-05-22T00:00:04.907 INFO:tasks.ceph.mon.b.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f66f577f700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 43494) UID: 0 2023-05-22T00:00:04.907 INFO:tasks.ceph.mon.b.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f66f577f700 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-05-22T00:00:04.907 INFO:tasks.ceph.mon.c.smithi142.stderr:2023-05-22T00:00:03.903+0000 7fcb9d2aa700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 43494) UID: 0 2023-05-22T00:00:04.908 INFO:tasks.ceph.mon.c.smithi142.stderr:2023-05-22T00:00:03.903+0000 7fcb9d2aa700 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-05-22T00:00:04.908 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f2c90627700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 43494) UID: 0 2023-05-22T00:00:04.908 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-05-22T00:00:03.903+0000 7fe80d400700 -1 received signal: Hangup from (PID: 43494) UID: 0 2023-05-22T00:00:04.909 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f91b2535700 -1 received signal: Hangup from (PID: 43494) UID: 0 2023-05-22T00:00:04.909 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f39e6513700 -1 received signal: Hangup from (PID: 43494) UID: 0 2023-05-22T00:00:04.910 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f256c75c700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 43494) UID: 0 2023-05-22T00:00:04.910 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-05-22T00:00:03.903+0000 7f79e3a2a700 -1 received signal: Hangup from (PID: 43494) UID: 0 2023-05-22T00:00:14.781 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-22T00:00:14.774+0000 7fe6a624e700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:14.818 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f0f8e4b5700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:14.818 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f998ecfd700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:14.819 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f4f6a3fe700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:14.819 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f9d862a3700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:14.820 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f818dc38700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:14.970 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f08d6fec700 -1 Fail to open '/proc/454826/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.002 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f08d6fec700 -1 received signal: Hangup from (PID: 454826) UID: 0 2023-05-22T00:00:15.002 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f08d6fec700 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-05-22T00:00:15.003 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-22T00:00:14.774+0000 7f83ef65e700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 454826) UID: 0 2023-05-22T00:00:15.123 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f08d6fec700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 454827) UID: 0 2023-05-22T00:00:15.123 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f08d6fec700 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-05-22T00:00:15.123 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f818dc38700 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 454827) UID: 0 2023-05-22T00:00:15.124 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f0f8e4b5700 -1 Fail to open '/proc/454827/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.124 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f0f8e4b5700 -1 received signal: Hangup from (PID: 454827) UID: 0 2023-05-22T00:00:15.125 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-22T00:00:15.114+0000 7fe6a624e700 -1 Fail to open '/proc/454827/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.125 INFO:tasks.ceph.mgr.y.smithi046.stderr:2023-05-22T00:00:15.114+0000 7fe6a624e700 -1 received signal: Hangup from (PID: 454827) UID: 0 2023-05-22T00:00:15.125 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f83ef65e700 -1 Fail to open '/proc/454827/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.125 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f83ef65e700 -1 received signal: Hangup from (PID: 454827) UID: 0 2023-05-22T00:00:15.126 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f9d862a3700 -1 Fail to open '/proc/454827/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.126 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f9d862a3700 -1 received signal: Hangup from (PID: 454827) UID: 0 2023-05-22T00:00:15.126 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f4f6a3fe700 -1 Fail to open '/proc/454827/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.126 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f4f6a3fe700 -1 received signal: Hangup from (PID: 454827) UID: 0 2023-05-22T00:00:15.134 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-22T00:00:15.114+0000 7f998ecfd700 -1 Fail to open '/proc/454827/cmdline' error = (2) No such file or directory 2023-05-22T00:00:15.134 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-22T00:00:15.126+0000 7f998ecfd700 -1 received signal: Hangup from (PID: 454827) UID: 0 2023-05-22T00:01:22.993 INFO:teuthology.orchestra.run.smithi046.stderr:error: error unlinking log file /var/log/ceph/ceph-mds.c.log.1: No such file or directory 2023-05-22T00:01:55.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:01:55.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:02:25.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:02:25.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:02:55.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:02:55.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:03:25.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:03:25.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:03:55.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:03:55.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:04:25.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:04:25.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:04:56.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:04:56.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:05:26.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:05:26.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:05:57.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:05:57.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:06:27.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:06:27.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:06:57.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:06:57.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:07:28.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:07:28.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:07:58.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:07:58.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:08:29.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:08:29.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:08:59.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:08:59.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:09:29.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:09:29.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:10:00.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:10:00.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:10:30.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:10:30.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:11:00.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:11:00.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:11:30.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:11:30.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:12:00.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:12:00.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:12:31.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:12:31.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:12:31.224 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:12:31.214+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 457726) UID: 0 2023-05-22T00:12:31.224 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:12:31.214+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 457726) UID: 0 2023-05-22T00:16:18.434 INFO:teuthology.orchestra.run.smithi046.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-05-22T00:16:18.457 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: stdin: file size changed while zipping 2023-05-22T00:16:51.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:16:51.104 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:17:21.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:17:21.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:17:51.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:17:51.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:18:21.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:18:22.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:18:52.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:18:52.077 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:19:22.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:19:22.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:19:52.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:19:52.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:20:22.401 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:20:22.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:20:52.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:20:52.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:21:22.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:21:22.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:21:53.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:21:53.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:22:23.134 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:22:23.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:22:53.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:22:53.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:23:23.391 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:23:23.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:23:23.520 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:23:23.512+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 460301) UID: 0 2023-05-22T00:23:23.520 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:23:23.512+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 460301) UID: 0 2023-05-22T00:27:22.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:27:22.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:27:52.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:27:52.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:28:22.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:28:22.818 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:28:53.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:28:53.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:29:23.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:29:23.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:29:53.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:29:53.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:30:23.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:30:23.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:30:53.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:30:53.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:31:24.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:31:24.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:31:54.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:31:54.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:32:24.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:32:24.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:32:54.580 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:32:54.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:33:24.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:33:24.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:33:55.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:33:55.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:34:25.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:34:25.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:34:26.017 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:34:26.009+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 462689) UID: 0 2023-05-22T00:34:26.018 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:34:26.009+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 462689) UID: 0 2023-05-22T00:38:32.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:38:32.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:39:03.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:39:03.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:39:33.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:39:33.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:40:04.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:40:04.084 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:40:34.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:40:34.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:41:04.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:41:04.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:41:34.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:41:34.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:42:05.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:42:05.236 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:42:35.580 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:42:35.585 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:43:05.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:43:05.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:43:35.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:43:35.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:44:05.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:44:05.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:44:36.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:44:36.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:45:06.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:45:06.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:45:06.244 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:45:06.235+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 465376) UID: 0 2023-05-22T00:45:06.260 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:45:06.235+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 465376) UID: 0 2023-05-22T00:48:53.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:48:53.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:49:23.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:49:23.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:49:53.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:49:53.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:50:23.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:50:23.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:50:53.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:50:53.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:51:24.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:51:24.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:51:54.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:51:54.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:52:24.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:52:24.440 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:52:54.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:52:54.509 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:53:25.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:53:25.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:53:55.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:53:55.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:54:25.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:54:25.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:54:55.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:54:55.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:55:25.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:55:25.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:55:55.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:55:55.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:56:25.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:56:25.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:56:25.564 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T00:56:25.552+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 467920) UID: 0 2023-05-22T00:56:25.565 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T00:56:25.552+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 467920) UID: 0 2023-05-22T00:59:48.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T00:59:48.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:00:10.575 INFO:teuthology.orchestra.run.smithi046.stdout:generic/650 7162s 2023-05-22T01:00:10.641 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/650 2023-05-22T01:00:10.643 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:10.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:10.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:11.032 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-05-22T01:00:12.038 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:12.054 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:12.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:12.403 INFO:teuthology.orchestra.run.smithi046.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:12.414 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/651 2023-05-22T01:00:12.414 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/651 2023-05-22T01:00:12.414 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:12.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:12.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:12.438 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-05-22T01:00:12.861 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:12.876 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:12.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:13.164 INFO:teuthology.orchestra.run.smithi046.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:13.168 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/652 2023-05-22T01:00:13.168 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/652 2023-05-22T01:00:13.168 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:13.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:13.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:13.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-05-22T01:00:13.620 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:13.641 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:13.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:13.940 INFO:teuthology.orchestra.run.smithi046.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:13.946 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/653 2023-05-22T01:00:13.946 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/653 2023-05-22T01:00:13.946 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:13.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:13.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:13.970 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-05-22T01:00:14.392 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:14.401 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:14.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:14.987 INFO:teuthology.orchestra.run.smithi046.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:14.992 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/654 2023-05-22T01:00:14.993 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/654 2023-05-22T01:00:14.993 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:15.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:15.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:15.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-05-22T01:00:15.480 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:15.486 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:15.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:15.799 INFO:teuthology.orchestra.run.smithi046.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:15.812 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/655 2023-05-22T01:00:15.812 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/655 2023-05-22T01:00:15.812 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:15.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:15.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:15.837 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-05-22T01:00:16.269 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:16.280 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:16.281 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:16.543 INFO:teuthology.orchestra.run.smithi046.stdout:generic/656 [not run] kernel does not support mount_setattr syscall 2023-05-22T01:00:16.548 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/656 2023-05-22T01:00:16.548 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/656 2023-05-22T01:00:16.548 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:16.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:16.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:16.595 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-05-22T01:00:17.021 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:17.043 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:17.043 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:17.312 INFO:teuthology.orchestra.run.smithi046.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:17.327 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/657 2023-05-22T01:00:17.327 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/657 2023-05-22T01:00:17.328 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:17.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:17.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:17.356 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-05-22T01:00:17.795 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:17.804 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:17.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:18.113 INFO:teuthology.orchestra.run.smithi046.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:18.118 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/658 2023-05-22T01:00:18.118 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/658 2023-05-22T01:00:18.118 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:18.121 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:18.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:18.133 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-05-22T01:00:18.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:00:18.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:00:18.564 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:18.587 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:18.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:18.894 INFO:teuthology.orchestra.run.smithi046.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:18.907 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/659 2023-05-22T01:00:18.908 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/659 2023-05-22T01:00:18.908 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:18.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:18.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:18.942 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-05-22T01:00:19.395 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:19.402 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:19.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:19.728 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/660 2023-05-22T01:00:19.728 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/660 2023-05-22T01:00:19.728 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:19.731 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:19.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:19.756 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-05-22T01:00:20.222 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:20.234 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:20.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:20.533 INFO:teuthology.orchestra.run.smithi046.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:20.552 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/661 2023-05-22T01:00:20.552 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/661 2023-05-22T01:00:20.553 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:20.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:20.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:20.584 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-05-22T01:00:21.000 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:21.036 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:21.036 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:21.301 INFO:teuthology.orchestra.run.smithi046.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:21.309 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/662 2023-05-22T01:00:21.309 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/662 2023-05-22T01:00:21.309 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:21.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:21.341 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-05-22T01:00:21.716 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:21.739 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:22.017 INFO:teuthology.orchestra.run.smithi046.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:22.022 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/663 2023-05-22T01:00:22.022 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/663 2023-05-22T01:00:22.022 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:22.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:22.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:22.054 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-05-22T01:00:22.484 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:22.497 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:22.497 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:22.761 INFO:teuthology.orchestra.run.smithi046.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:22.769 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/664 2023-05-22T01:00:22.770 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/664 2023-05-22T01:00:22.770 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:22.772 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:22.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:22.793 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-05-22T01:00:23.272 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:23.278 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:23.279 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:23.561 INFO:teuthology.orchestra.run.smithi046.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:23.575 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/665 2023-05-22T01:00:23.576 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/665 2023-05-22T01:00:23.576 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:23.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:23.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:23.610 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-05-22T01:00:23.993 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:24.007 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:24.007 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:24.287 INFO:teuthology.orchestra.run.smithi046.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:24.292 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/666 2023-05-22T01:00:24.293 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/666 2023-05-22T01:00:24.293 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:24.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:24.429 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-05-22T01:00:24.907 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:24.931 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:24.932 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:25.212 INFO:teuthology.orchestra.run.smithi046.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:25.228 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/667 2023-05-22T01:00:25.228 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/667 2023-05-22T01:00:25.228 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:25.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:25.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:25.250 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-05-22T01:00:25.665 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:25.670 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:25.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:25.943 INFO:teuthology.orchestra.run.smithi046.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:25.955 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/668 2023-05-22T01:00:25.955 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/668 2023-05-22T01:00:25.955 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:25.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:25.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:25.991 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-05-22T01:00:26.386 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:26.398 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:26.398 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:27.086 INFO:teuthology.orchestra.run.smithi046.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:27.091 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/669 2023-05-22T01:00:27.092 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/669 2023-05-22T01:00:27.092 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:27.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:27.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:27.129 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-05-22T01:00:27.510 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:27.525 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:27.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:27.813 INFO:teuthology.orchestra.run.smithi046.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:27.817 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/670 2023-05-22T01:00:27.818 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/670 2023-05-22T01:00:27.818 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:27.831 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:27.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:27.859 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-05-22T01:00:28.294 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:28.304 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:28.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:28.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:28.665 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/671 2023-05-22T01:00:28.666 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/671 2023-05-22T01:00:28.666 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:28.676 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:28.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:28.697 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-05-22T01:00:29.196 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:29.201 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:29.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/672 2023-05-22T01:00:29.575 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/672 2023-05-22T01:00:29.575 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:29.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:29.596 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-05-22T01:00:30.011 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:30.019 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:30.660 INFO:teuthology.orchestra.run.smithi046.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:30.664 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/673 2023-05-22T01:00:30.664 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/673 2023-05-22T01:00:30.665 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:30.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:30.678 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-05-22T01:00:31.097 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:31.108 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:31.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:31.435 INFO:teuthology.orchestra.run.smithi046.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:31.443 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/674 2023-05-22T01:00:31.443 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/674 2023-05-22T01:00:31.443 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:31.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:31.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:31.462 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-05-22T01:00:31.889 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:31.895 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:31.895 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:32.272 INFO:teuthology.orchestra.run.smithi046.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:00:32.292 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/675 2023-05-22T01:00:32.292 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/675 2023-05-22T01:00:32.292 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:00:32.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:32.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:00:32.326 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-05-22T01:00:32.723 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:00:32.729 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:00:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:00:48.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:00:48.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:01:18.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:01:18.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:01:49.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:01:49.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:02:19.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:02:19.287 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:02:49.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:02:49.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:03:20.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:03:20.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:03:50.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:03:50.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:04:20.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:04:20.758 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:04:20.805 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T01:04:20.795+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 478763) UID: 0 2023-05-22T01:04:20.806 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T01:04:20.795+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 478763) UID: 0 2023-05-22T01:07:26.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:07:26.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:07:56.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:07:56.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:08:27.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:08:27.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:08:57.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:08:57.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:09:27.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:09:27.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:09:57.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:09:57.513 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:10:27.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:10:27.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:10:58.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:10:58.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:11:28.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:11:32.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:12:02.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:12:22.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:12:22.439 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T01:12:22.427+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 478817) UID: 0 2023-05-22T01:12:22.442 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T01:12:22.427+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 478817) UID: 0 2023-05-22T01:18:13.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:18:13.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:18:13.697 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-22T01:18:13.649+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44016) UID: 0 2023-05-22T01:18:13.771 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-22T01:18:13.649+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44016) UID: 0 2023-05-22T01:18:13.784 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-22T01:18:13.649+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44016) UID: 0 2023-05-22T01:18:13.823 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-22T01:18:13.649+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44016) UID: 0 2023-05-22T01:20:59.988 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:21:00.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:21:00.123 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T01:21:00.105+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 478845) UID: 0 2023-05-22T01:21:00.123 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T01:21:00.105+0000 7f9d862a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 478845) UID: 0 2023-05-22T01:27:02.486 INFO:tasks.ceph.osd.2.smithi046.stderr:2023-05-22T01:27:02.414+0000 7f0f8e4b5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478859) UID: 0 2023-05-22T01:27:02.539 INFO:tasks.ceph.osd.0.smithi046.stderr:2023-05-22T01:27:02.414+0000 7f83ef65e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478859) UID: 0 2023-05-22T01:27:02.546 INFO:tasks.ceph.osd.1.smithi046.stderr:2023-05-22T01:27:02.414+0000 7f998ecfd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478859) UID: 0 2023-05-22T01:27:02.550 INFO:tasks.ceph.osd.3.smithi046.stderr:2023-05-22T01:27:02.414+0000 7f4f6a3fe700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478859) UID: 0 2023-05-22T01:31:57.454 INFO:teuthology.orchestra.run.smithi046.stdout:generic/676 1885s 2023-05-22T01:31:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/676 2023-05-22T01:31:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:31:57.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:31:57.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:31:58.027 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-05-22T01:32:01.296 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:01.319 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:01.319 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:03.304 INFO:teuthology.orchestra.run.smithi046.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:03.332 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/677 2023-05-22T01:32:03.349 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/677 2023-05-22T01:32:03.350 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:03.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:03.358 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-05-22T01:32:03.828 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:03.835 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:03.836 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:generic/678 [not run] kernel does not support IO_URING 2023-05-22T01:32:05.093 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/678 2023-05-22T01:32:05.093 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/678 2023-05-22T01:32:05.093 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:05.094 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:05.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:05.120 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-05-22T01:32:05.554 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:05.565 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:05.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:05.841 INFO:teuthology.orchestra.run.smithi046.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:05.849 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/679 2023-05-22T01:32:05.849 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/679 2023-05-22T01:32:05.849 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:05.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:05.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:05.874 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-05-22T01:32:06.339 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:06.342 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:06.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:08.965 INFO:teuthology.orchestra.run.smithi046.stdout:generic/680 2s 2023-05-22T01:32:08.995 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/680 2023-05-22T01:32:08.996 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:08.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:09.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:09.135 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-05-22T01:32:09.977 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:09.987 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:09.987 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:10.431 INFO:teuthology.orchestra.run.smithi046.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-22T01:32:10.446 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/681 2023-05-22T01:32:10.446 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/681 2023-05-22T01:32:10.448 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:10.452 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:10.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:10.485 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-05-22T01:32:10.943 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:10.951 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:11.241 INFO:teuthology.orchestra.run.smithi046.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-22T01:32:11.251 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/682 2023-05-22T01:32:11.251 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/682 2023-05-22T01:32:11.251 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:11.255 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:11.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:11.272 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-05-22T01:32:11.768 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:11.777 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:11.778 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:12.382 INFO:teuthology.orchestra.run.smithi046.stdout:generic/683 [not run] /tmp/tmp.g8r3hAr3OQtest: file alloc unit 4194304 larger than op length 65536 2023-05-22T01:32:12.388 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/683 2023-05-22T01:32:12.388 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/683 2023-05-22T01:32:12.388 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:12.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:12.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:12.413 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-05-22T01:32:12.943 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:12.958 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:12.959 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:14.809 INFO:teuthology.orchestra.run.smithi046.stdout:generic/684 [not run] /tmp/tmp.g8r3hAr3OQtest: file alloc unit 4194304 larger than op length 65536 2023-05-22T01:32:14.821 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/684 2023-05-22T01:32:14.821 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/684 2023-05-22T01:32:14.822 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:14.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:14.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:14.850 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-05-22T01:32:15.380 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:15.398 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:15.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-22T01:32:17.469 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/685 2023-05-22T01:32:17.469 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/685 2023-05-22T01:32:17.470 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:17.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:17.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:17.500 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-05-22T01:32:18.077 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:18.084 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:18.084 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:19.903 INFO:teuthology.orchestra.run.smithi046.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-22T01:32:19.913 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/686 2023-05-22T01:32:19.913 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/686 2023-05-22T01:32:19.913 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:19.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:19.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:19.945 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-05-22T01:32:20.591 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:20.626 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:20.626 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:22.512 INFO:teuthology.orchestra.run.smithi046.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-22T01:32:22.521 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/687 2023-05-22T01:32:22.521 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/687 2023-05-22T01:32:22.521 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:22.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:22.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:22.548 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-05-22T01:32:23.133 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:23.138 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:23.139 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:24.192 INFO:teuthology.orchestra.run.smithi046.stdout:generic/688 [not run] /tmp/tmp.g8r3hAr3OQtest: file alloc unit 4194304 larger than op length 65536 2023-05-22T01:32:24.200 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/688 2023-05-22T01:32:24.201 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/688 2023-05-22T01:32:24.202 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:24.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:24.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-05-22T01:32:24.741 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:24.761 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:24.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:25.174 INFO:teuthology.orchestra.run.smithi046.stdout:generic/689 [not run] kernel does not support mount_setattr syscall 2023-05-22T01:32:25.176 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/689 2023-05-22T01:32:25.179 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/689 2023-05-22T01:32:25.179 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:25.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:25.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:25.226 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-05-22T01:32:25.697 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:25.716 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:25.716 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:26.319 INFO:teuthology.orchestra.run.smithi046.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:26.329 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/690 2023-05-22T01:32:26.330 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/690 2023-05-22T01:32:26.330 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:26.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:26.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:26.367 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-05-22T01:32:26.895 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:26.902 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:26.902 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:27.223 INFO:teuthology.orchestra.run.smithi046.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:27.247 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/691 2023-05-22T01:32:27.247 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/691 2023-05-22T01:32:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:27.251 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:27.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:27.295 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-05-22T01:32:27.832 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:27.849 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:27.849 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:28.209 INFO:teuthology.orchestra.run.smithi046.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:28.219 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/692 2023-05-22T01:32:28.220 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/692 2023-05-22T01:32:28.220 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:28.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:28.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:28.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-05-22T01:32:28.802 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:28.812 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:28.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:29.249 INFO:teuthology.orchestra.run.smithi046.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:29.253 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/693 2023-05-22T01:32:29.257 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/693 2023-05-22T01:32:29.257 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:29.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:29.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:29.298 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-05-22T01:32:29.868 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:29.890 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:31.349 INFO:teuthology.orchestra.run.smithi046.stdout:generic/694 2s 2023-05-22T01:32:31.379 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/694 2023-05-22T01:32:31.379 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:31.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:31.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:31.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-05-22T01:32:31.798 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:31.803 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:31.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:32.149 INFO:teuthology.orchestra.run.smithi046.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:32.156 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/695 2023-05-22T01:32:32.157 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/695 2023-05-22T01:32:32.157 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:32.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:32.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:32.245 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-05-22T01:32:32.660 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:32.672 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:33.027 INFO:teuthology.orchestra.run.smithi046.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:33.036 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/696 2023-05-22T01:32:33.036 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/696 2023-05-22T01:32:33.037 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:33.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:33.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:33.082 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-05-22T01:32:33.501 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:33.507 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:33.902 INFO:teuthology.orchestra.run.smithi046.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-22T01:32:33.903 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/697 2023-05-22T01:32:33.903 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/697 2023-05-22T01:32:33.903 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:33.911 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:33.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:33.929 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-05-22T01:32:34.368 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:34.376 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:34.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:34.696 INFO:teuthology.orchestra.run.smithi046.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:34.705 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/698 2023-05-22T01:32:34.707 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/698 2023-05-22T01:32:34.707 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:34.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:34.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:34.741 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-05-22T01:32:35.196 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:35.216 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:35.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:35.642 INFO:teuthology.orchestra.run.smithi046.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:35.652 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/699 2023-05-22T01:32:35.653 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/699 2023-05-22T01:32:35.653 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:35.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:35.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:35.674 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-05-22T01:32:36.118 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:36.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:36.420 INFO:teuthology.orchestra.run.smithi046.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:36.429 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/700 2023-05-22T01:32:36.434 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/700 2023-05-22T01:32:36.435 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:36.438 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:36.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:36.454 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-05-22T01:32:36.894 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:36.912 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:37.653 INFO:teuthology.orchestra.run.smithi046.stdout:generic/701 1s 2023-05-22T01:32:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/701 2023-05-22T01:32:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:37.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:37.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:37.690 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-05-22T01:32:38.523 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:38.535 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:38.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:38.871 INFO:teuthology.orchestra.run.smithi046.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:38.877 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/702 2023-05-22T01:32:38.877 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/702 2023-05-22T01:32:38.877 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:38.893 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:38.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:38.908 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-05-22T01:32:39.388 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:39.397 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:39.397 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:39.698 INFO:teuthology.orchestra.run.smithi046.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:39.704 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/703 2023-05-22T01:32:39.705 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/703 2023-05-22T01:32:39.705 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:39.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:39.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:39.738 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-05-22T01:32:40.146 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:40.159 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:40.159 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:40.513 INFO:teuthology.orchestra.run.smithi046.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-05-22T01:32:40.523 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/704 2023-05-22T01:32:40.524 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/704 2023-05-22T01:32:40.524 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:40.537 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:40.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:40.554 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-05-22T01:32:41.024 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:41.038 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:41.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:41.340 INFO:teuthology.orchestra.run.smithi046.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:41.345 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/705 2023-05-22T01:32:41.345 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/705 2023-05-22T01:32:41.345 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:41.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:41.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:41.384 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-05-22T01:32:41.753 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:41.772 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:41.772 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:44.307 INFO:teuthology.orchestra.run.smithi046.stdout:generic/706 3s 2023-05-22T01:32:44.324 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/706 2023-05-22T01:32:44.325 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:44.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:44.356 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-05-22T01:32:45.170 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:45.184 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:45.185 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:45.511 INFO:teuthology.orchestra.run.smithi046.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-05-22T01:32:45.526 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/707 2023-05-22T01:32:45.527 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/707 2023-05-22T01:32:45.527 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:45.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:45.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:45.575 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-05-22T01:32:45.944 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:45.959 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:45.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:46.908 INFO:teuthology.orchestra.run.smithi046.stdout:generic/708 1s 2023-05-22T01:32:46.926 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/708 2023-05-22T01:32:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:46.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:46.964 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-05-22T01:32:47.805 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:47.809 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:48.211 INFO:teuthology.orchestra.run.smithi046.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:48.222 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/709 2023-05-22T01:32:48.223 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/709 2023-05-22T01:32:48.223 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:48.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:48.253 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-05-22T01:32:49.055 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:49.061 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:49.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:49.492 INFO:teuthology.orchestra.run.smithi046.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:49.504 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/710 2023-05-22T01:32:49.504 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/710 2023-05-22T01:32:49.504 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:49.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:49.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:49.591 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-05-22T01:32:50.425 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:50.445 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:50.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:50.817 INFO:teuthology.orchestra.run.smithi046.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:50.822 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/711 2023-05-22T01:32:50.822 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/711 2023-05-22T01:32:50.822 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:50.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:50.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:50.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-05-22T01:32:51.732 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:51.745 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:51.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:52.156 INFO:teuthology.orchestra.run.smithi046.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:52.169 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/712 2023-05-22T01:32:52.169 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/712 2023-05-22T01:32:52.170 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:52.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:52.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:52.205 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-05-22T01:32:53.065 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:53.073 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:53.073 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:53.460 INFO:teuthology.orchestra.run.smithi046.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-05-22T01:32:53.485 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/713 2023-05-22T01:32:53.485 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/713 2023-05-22T01:32:53.485 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:53.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:53.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:53.511 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-05-22T01:32:54.363 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:54.376 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:54.376 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:54.774 INFO:teuthology.orchestra.run.smithi046.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:54.795 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/714 2023-05-22T01:32:54.796 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/714 2023-05-22T01:32:54.797 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:54.797 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:54.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:54.810 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-05-22T01:32:55.610 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:55.626 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:55.627 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:56.100 INFO:teuthology.orchestra.run.smithi046.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-05-22T01:32:56.105 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/715 2023-05-22T01:32:56.106 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/715 2023-05-22T01:32:56.106 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:56.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:56.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:56.274 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-05-22T01:32:56.934 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:56.956 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:56.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:57.541 INFO:teuthology.orchestra.run.smithi046.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:57.551 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/716 2023-05-22T01:32:57.551 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/716 2023-05-22T01:32:57.551 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:57.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:57.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:57.568 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-05-22T01:32:58.336 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:58.343 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:58.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:58.749 INFO:teuthology.orchestra.run.smithi046.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:32:58.758 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/717 2023-05-22T01:32:58.758 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/717 2023-05-22T01:32:58.758 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:32:58.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:32:58.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:32:58.797 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-05-22T01:32:59.621 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:32:59.622 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:32:59.622 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:00.023 INFO:teuthology.orchestra.run.smithi046.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:33:00.036 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/718 2023-05-22T01:33:00.036 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/718 2023-05-22T01:33:00.043 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:00.043 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:00.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:00.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-05-22T01:33:00.892 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:00.930 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:00.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:01.327 INFO:teuthology.orchestra.run.smithi046.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:33:01.341 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/719 2023-05-22T01:33:01.349 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/719 2023-05-22T01:33:01.350 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:01.351 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:01.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:01.375 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-05-22T01:33:01.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:33:01.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-22T01:33:01.919 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-05-22T01:33:01.904+0000 7f91b2535700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44056) UID: 0 2023-05-22T01:33:01.919 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-05-22T01:33:01.904+0000 7f39e6513700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44056) UID: 0 2023-05-22T01:33:01.920 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-05-22T01:33:01.904+0000 7f256c75c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44056) UID: 0 2023-05-22T01:33:01.920 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-05-22T01:33:01.904+0000 7f2c90627700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44056) UID: 0 2023-05-22T01:33:01.940 INFO:tasks.ceph.mds.a.smithi046.stderr:2023-05-22T01:33:01.926+0000 7f818dc38700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 497617) UID: 0 2023-05-22T01:33:01.948 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T01:33:01.926+0000 7f9d862a3700 -1 Fail to open '/proc/497617/cmdline' error = (2) No such file or directory 2023-05-22T01:33:01.949 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T01:33:01.926+0000 7f9d862a3700 -1 received signal: Hangup from (PID: 497617) UID: 0 2023-05-22T01:33:02.283 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:02.302 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:02.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:02.771 INFO:teuthology.orchestra.run.smithi046.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:33:02.783 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/720 2023-05-22T01:33:02.783 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/720 2023-05-22T01:33:02.783 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:02.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:02.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:02.820 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-05-22T01:33:03.683 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:03.700 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:03.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-05-22T01:33:04.172 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/721 2023-05-22T01:33:04.173 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/721 2023-05-22T01:33:04.173 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:04.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:04.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:04.189 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-05-22T01:33:04.803 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:04.816 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:04.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:05.203 INFO:teuthology.orchestra.run.smithi046.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-05-22T01:33:05.213 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/722 2023-05-22T01:33:05.214 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/722 2023-05-22T01:33:05.214 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:05.218 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:05.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:05.248 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-05-22T01:33:06.289 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:06.309 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:06.798 INFO:teuthology.orchestra.run.smithi046.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-05-22T01:33:06.813 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/723 2023-05-22T01:33:06.813 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/723 2023-05-22T01:33:06.813 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:06.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:06.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:06.833 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-05-22T01:33:07.935 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:07.961 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:07.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:08.373 INFO:teuthology.orchestra.run.smithi046.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-05-22T01:33:08.390 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/724 2023-05-22T01:33:08.390 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/724 2023-05-22T01:33:08.391 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:08.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:08.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:08.434 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-05-22T01:33:09.449 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:09.463 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:09.463 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:09.988 INFO:teuthology.orchestra.run.smithi046.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-05-22T01:33:09.993 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/725 2023-05-22T01:33:09.993 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/725 2023-05-22T01:33:09.993 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:09.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:10.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:10.147 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-05-22T01:33:11.058 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:11.075 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:11.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:11.731 INFO:teuthology.orchestra.run.smithi046.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-05-22T01:33:11.745 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/726 2023-05-22T01:33:11.745 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/726 2023-05-22T01:33:11.745 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:11.751 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:11.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:11.889 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/tmp.wfxug4os5zxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-05-22T01:33:12.748 INFO:teuthology.orchestra.run.smithi046.stdout:FSTYP -- ceph-fuse 2023-05-22T01:33:12.761 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM -- Linux/x86_64 smithi046 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 2023-05-22T01:33:12.761 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:13.296 INFO:teuthology.orchestra.run.smithi046.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-05-22T01:33:13.315 INFO:teuthology.orchestra.run.smithi046.stdout:Ran: generic/727 2023-05-22T01:33:13.315 INFO:teuthology.orchestra.run.smithi046.stdout:Not run: generic/727 2023-05-22T01:33:13.316 INFO:teuthology.orchestra.run.smithi046.stdout:Passed all 1 tests 2023-05-22T01:33:13.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:13.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-22T01:33:13.385 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 17========================================================= 2023-05-22T01:33:14.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo userdel --force --remove fsgqa 2023-05-22T01:33:14.349 INFO:teuthology.orchestra.run.smithi046.stderr:userdel: user fsgqa is currently used by process 500490 2023-05-22T01:33:14.397 INFO:teuthology.orchestra.run.smithi046.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-05-22T01:33:15.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo userdel --force --remove 123456-fsgqa 2023-05-22T01:33:15.278 INFO:teuthology.orchestra.run.smithi046.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-05-22T01:33:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-05-22T01:33:16.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo groupdel fsgqa 2023-05-22T01:33:16.108 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-05-22T01:33:16.109 INFO:teuthology.orchestra.run.smithi046.stderr:groupdel: group 'fsgqa' does not exist 2023-05-22T01:33:16.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:16.713 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.wfxug4os5zxfstests-dev/results) 2023-05-22T01:33:16.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-22T01:33:16.895 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 0: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-05-22T01:33:16.908 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.wfxug4os5zxfstests-dev 2023-05-22T01:33:16.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf /tmp/tmp.wfxug4os5zxfstests-dev 2023-05-22T01:33:18.283 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-22T01:33:18.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-22T01:33:18.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-22T01:33:19.053 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-22T01:33:19.589 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-22T01:33:19.713 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:19.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355616k,nr_inodes=4088904,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3277328k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 tmpfs /run/user/10101 tmpfs rw,nosuid,nodev,relatime,size=3277328k,mode=700,uid=10101,gid=10101 0 0 2023-05-22T01:33:20.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T01:33:20.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:20.183 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-22T01:33:20.265 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-22T01:33:20.265 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:20.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352476k,nr_inodes=4088119,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20563 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276700k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-05-22T01:33:20.351 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T01:33:20.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:20.352 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-22T01:33:20.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-22T01:33:20.409 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-05-22T01:33:20.410 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-22T01:33:20.410 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:20.417 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355616k,nr_inodes=4088904,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3277328k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 tmpfs /run/user/10101 tmpfs rw,nosuid,nodev,relatime,size=3277328k,mode=700,uid=10101,gid=10101 0 0 2023-05-22T01:33:20.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T01:33:20.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:20.420 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-22T01:33:20.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-22T01:33:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-05-22T01:33:20.474 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-22T01:33:20.474 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:20.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352476k,nr_inodes=4088119,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20563 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276700k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-05-22T01:33:20.503 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T01:33:20.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:20.504 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-22T01:33:20.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-22T01:33:20.557 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-05-22T01:33:21.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-22T01:33:23.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 Processor -- start 2023-05-22T01:33:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- start start 2023-05-22T01:33:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feb9c0e07f0 0x7feb9c051560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb9c00c4b0 0x7feb9c00c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c053510 con 0x7feb9c0530c0 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c00ce70 con 0x7feb9c0e07f0 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c03a500 con 0x7feb9c00c4b0 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb9c00c4b0 0x7feb9c00c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb9c00c4b0 0x7feb9c00c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:56724/0 (socket says 172.21.15.46:56724) 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 -- 172.21.15.46:0/3682082408 learned_addr learned my addr 172.21.15.46:0/3682082408 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 -- 172.21.15.46:0/3682082408 >> v2:172.21.15.46:3300/0 conn(0x7feb9c0e07f0 msgr2=0x7feb9c051560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-22T01:33:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 --2- 172.21.15.46:0/3682082408 >> v2:172.21.15.46:3300/0 conn(0x7feb9c0e07f0 0x7feb9c051560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 -- 172.21.15.46:0/3682082408 >> v1:172.21.15.46:6789/0 conn(0x7feb9c0530c0 legacy=0x7feb9c039df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-22T01:33:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 -- 172.21.15.46:0/3682082408 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c055590 con 0x7feb9c00c4b0 2023-05-22T01:33:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb97fff700 1 --2- 172.21.15.46:0/3682082408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c00c930 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7feb9c035bd0 tx=0x7feb88009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20d53d549c3400b server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:23.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb967fc700 1 -- 172.21.15.46:0/3682082408 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88004230 con 0x7feb9c00c4b0 2023-05-22T01:33:23.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb967fc700 1 -- 172.21.15.46:0/3682082408 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88004390 con 0x7feb9c00c4b0 2023-05-22T01:33:23.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feb967fc700 1 -- 172.21.15.46:0/3682082408 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880036c0 con 0x7feb9c00c4b0 2023-05-22T01:33:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- 172.21.15.46:0/3682082408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 msgr2=0x7feb9c00c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 --2- 172.21.15.46:0/3682082408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c00c930 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7feb9c035bd0 tx=0x7feb88009bf0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- 172.21.15.46:0/3682082408 shutdown_connections 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 --2- 172.21.15.46:0/3682082408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c00c930 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 --2- 172.21.15.46:0/3682082408 >> v2:172.21.15.46:3300/0 conn(0x7feb9c0e07f0 0x7feb9c051560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.530+0000 7feba57f1700 1 -- 172.21.15.46:0/3682082408 >> 172.21.15.46:0/3682082408 conn(0x7feb9c056fa0 msgr2=0x7feb9c0573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.534+0000 7feba57f1700 1 -- 172.21.15.46:0/3682082408 shutdown_connections 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.534+0000 7feba57f1700 1 -- 172.21.15.46:0/3682082408 wait complete. 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 Processor -- start 2023-05-22T01:33:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 -- start start 2023-05-22T01:33:23.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:23.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c036db0 0x7feb9c04dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:23.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 0x7feb9c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:23.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0ccdb0 con 0x7feb9c04e520 2023-05-22T01:33:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0508e0 con 0x7feb9c00c4b0 2023-05-22T01:33:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feba57f1700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c050bc0 con 0x7feb9c036db0 2023-05-22T01:33:23.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 0x7feb9c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb977fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 0x7feb9c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36840/0 (socket says 172.21.15.46:36840) 2023-05-22T01:33:23.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 -- 172.21.15.46:0/2235317636 learned_addr learned my addr 172.21.15.46:0/2235317636 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:23.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb96ffd700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c036db0 0x7feb9c04dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:23.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 -- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c036db0 msgr2=0x7feb9c04dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:23.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c036db0 0x7feb9c04dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 -- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 msgr2=0x7feb9c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 -- 172.21.15.46:0/2235317636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009570 con 0x7feb9c04e520 2023-05-22T01:33:23.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.538+0000 7feb97fff700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 0x7feb9c0cf1e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7feb88004000 tx=0x7feb88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.546+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800b860 con 0x7feb9c04e520 2023-05-22T01:33:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.546+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8800b9c0 con 0x7feb9c04e520 2023-05-22T01:33:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.546+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800bd50 con 0x7feb9c04e520 2023-05-22T01:33:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feba57f1700 1 -- 172.21.15.46:0/2235317636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c055830 con 0x7feb9c04e520 2023-05-22T01:33:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feba57f1700 1 -- 172.21.15.46:0/2235317636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0e0bc0 con 0x7feb9c04e520 2023-05-22T01:33:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb8801b440 con 0x7feb9c04e520 2023-05-22T01:33:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feb7ffff700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb84066340 0x7feb840687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7feb880855f0 con 0x7feb9c04e520 2023-05-22T01:33:23.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feb977fe700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb84066340 0x7feb840687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.550+0000 7feb977fe700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb84066340 0x7feb840687f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0df460 tx=0x7feb8c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.566+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70005310 con 0x7feb9c04e520 2023-05-22T01:33:23.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.574+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feb88052ac0 con 0x7feb9c04e520 2023-05-22T01:33:23.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.894+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb70005b40 con 0x7feb9c04e520 2023-05-22T01:33:23.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.894+0000 7feb7ffff700 1 -- 172.21.15.46:0/2235317636 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7feb8801f070 con 0x7feb9c04e520 2023-05-22T01:33:23.969 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:23.969 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:55:21.293141+0000","modified":"2023-05-21T16:55:24.614864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/2842509941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":2842509941},{"type":"v1","addr":"172.21.15.46:6837","nonce":2842509941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-22T01:33:23.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb84066340 msgr2=0x7feb840687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb84066340 0x7feb840687f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0df460 tx=0x7feb8c009190 comp rx=0 tx=0).stop 2023-05-22T01:33:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 msgr2=0x7feb9c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:23.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 0x7feb9c0cf1e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7feb88004000 tx=0x7feb88004770 comp rx=0 tx=0).stop 2023-05-22T01:33:23.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 shutdown_connections 2023-05-22T01:33:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7feb84066340 0x7feb840687f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb9c04e520 0x7feb9c0cf1e0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb9c036db0 0x7feb9c04dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 --2- 172.21.15.46:0/2235317636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c00c4b0 0x7feb9c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 >> 172.21.15.46:0/2235317636 conn(0x7feb9c056fa0 msgr2=0x7feb9c007d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:24.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 shutdown_connections 2023-05-22T01:33:24.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:23.902+0000 7feb7dffb700 1 -- 172.21.15.46:0/2235317636 wait complete. 2023-05-22T01:33:24.002 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-05-22T01:33:25.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-22T01:33:25.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 Processor -- start 2023-05-22T01:33:25.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 -- start start 2023-05-22T01:33:25.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b9406e780 0x7f4b9406b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:25.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b940cd240 0x7f4b94070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9406a220 con 0x7f4b940ccdc0 2023-05-22T01:33:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9406a500 con 0x7f4b9406e780 2023-05-22T01:33:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b99301700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9406a7e0 con 0x7f4b940cd240 2023-05-22T01:33:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b98b00700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b940cd240 0x7f4b94070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b93fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b9406e780 0x7f4b9406b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b98b00700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4b940cd240 0x7f4b94070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39192/0 (socket says 172.21.15.46:39192) 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b98b00700 1 -- 172.21.15.46:0/1098932818 learned_addr learned my addr 172.21.15.46:0/1098932818 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b93fff700 1 --2- 172.21.15.46:0/1098932818 >> v2:172.21.15.46:3300/0 conn(0x7f4b9406e780 0x7f4b9406b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43430/0 (socket says 172.21.15.46:43430) 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b93fff700 1 -- 172.21.15.46:0/1098932818 >> v2:172.21.15.142:3300/0 conn(0x7f4b940cd240 msgr2=0x7f4b94070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b93fff700 1 --2- 172.21.15.46:0/1098932818 >> v2:172.21.15.142:3300/0 conn(0x7f4b940cd240 0x7f4b94070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b93fff700 1 -- 172.21.15.46:0/1098932818 >> v1:172.21.15.142:6789/0 conn(0x7f4b940ccdc0 legacy=0x7f4b9415cb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-22T01:33:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.286+0000 7f4b93fff700 1 -- 172.21.15.46:0/1098932818 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9406aac0 con 0x7f4b9406e780 2023-05-22T01:33:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.290+0000 7f4b93fff700 1 --2- 172.21.15.46:0/1098932818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9406e780 0x7f4b9406b2c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4b940b0570 tx=0x7f4b84009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfb9543141e849f server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:25.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b937fe700 1 -- 172.21.15.46:0/1098932818 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84004030 con 0x7f4b9406e780 2023-05-22T01:33:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b937fe700 1 -- 172.21.15.46:0/1098932818 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b84004190 con 0x7f4b9406e780 2023-05-22T01:33:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b937fe700 1 -- 172.21.15.46:0/1098932818 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84004500 con 0x7f4b9406e780 2023-05-22T01:33:25.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- 172.21.15.46:0/1098932818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9406e780 msgr2=0x7f4b9406b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:25.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 --2- 172.21.15.46:0/1098932818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9406e780 0x7f4b9406b2c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4b940b0570 tx=0x7f4b84009b30 comp rx=0 tx=0).stop 2023-05-22T01:33:25.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- 172.21.15.46:0/1098932818 shutdown_connections 2023-05-22T01:33:25.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 --2- 172.21.15.46:0/1098932818 >> v2:172.21.15.142:3300/0 conn(0x7f4b940cd240 0x7f4b94070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 --2- 172.21.15.46:0/1098932818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9406e780 0x7f4b9406b2c0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- 172.21.15.46:0/1098932818 >> 172.21.15.46:0/1098932818 conn(0x7f4b940cf720 msgr2=0x7f4b940cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:25.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- 172.21.15.46:0/1098932818 shutdown_connections 2023-05-22T01:33:25.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- 172.21.15.46:0/1098932818 wait complete. 2023-05-22T01:33:25.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 Processor -- start 2023-05-22T01:33:25.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- start start 2023-05-22T01:33:25.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940ccdc0 0x7f4b9414c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:25.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 0x7f4b94157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:25.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9414cf80 0x7f4b941581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:25.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940c4370 con 0x7f4b9414cf80 2023-05-22T01:33:25.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940c70e0 con 0x7f4b940cd240 2023-05-22T01:33:25.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.298+0000 7f4b99301700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940c73c0 con 0x7f4b940ccdc0 2023-05-22T01:33:25.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.302+0000 7f4b8b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 0x7f4b94157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:25.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.302+0000 7f4b8b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 0x7f4b94157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39194/0 (socket says 172.21.15.46:39194) 2023-05-22T01:33:25.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.302+0000 7f4b8b7fe700 1 -- 172.21.15.46:0/3134322372 learned_addr learned my addr 172.21.15.46:0/3134322372 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:25.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.302+0000 7f4b8b7fe700 1 -- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940ccdc0 msgr2=0x7f4b9414c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.302+0000 7f4b8b7fe700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940ccdc0 0x7f4b9414c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.302+0000 7f4b8b7fe700 1 -- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9414cf80 msgr2=0x7f4b941581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b98b00700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9414cf80 0x7f4b941581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b8b7fe700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9414cf80 0x7f4b941581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b8b7fe700 1 -- 172.21.15.46:0/3134322372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840094b0 con 0x7f4b940cd240 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b98b00700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9414cf80 0x7f4b941581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-22T01:33:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b8b7fe700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 0x7f4b94157cb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b520 tx=0x7f4b7c00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:25.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c011830 con 0x7f4b940cd240 2023-05-22T01:33:25.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0119b0 con 0x7f4b940cd240 2023-05-22T01:33:25.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c011d60 con 0x7f4b940cd240 2023-05-22T01:33:25.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9415d220 con 0x7f4b940cd240 2023-05-22T01:33:25.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.306+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9406ada0 con 0x7f4b940cd240 2023-05-22T01:33:25.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.310+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9406b800 con 0x7f4b940cd240 2023-05-22T01:33:25.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.310+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b7c01a410 con 0x7f4b940cd240 2023-05-22T01:33:25.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.310+0000 7f4b917fa700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4b74066320 0x7f4b740687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:25.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.310+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4b7c083810 con 0x7f4b940cd240 2023-05-22T01:33:25.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.310+0000 7f4b93fff700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4b74066320 0x7f4b740687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:25.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.310+0000 7f4b93fff700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4b74066320 0x7f4b740687d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4b94070140 tx=0x7f4b84021000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:25.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.318+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b7c050c70 con 0x7f4b940cd240 2023-05-22T01:33:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.582+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b940733b0 con 0x7f4b940cd240 2023-05-22T01:33:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.590+0000 7f4b917fa700 1 -- 172.21.15.46:0/3134322372 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18344 (secure 0 0 0) 0x7f4b7c054290 con 0x7f4b940cd240 2023-05-22T01:33:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:25.694 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:56:01.633427+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:55:19.482721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-21T16:55:20.275924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-22T01:33:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4b74066320 msgr2=0x7f4b740687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4b74066320 0x7f4b740687d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4b94070140 tx=0x7f4b84021000 comp rx=0 tx=0).stop 2023-05-22T01:33:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 msgr2=0x7f4b94157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 0x7f4b94157cb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b520 tx=0x7f4b7c00b8e0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 shutdown_connections 2023-05-22T01:33:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4b74066320 0x7f4b740687d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b9414cf80 0x7f4b941581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b940cd240 0x7f4b94157cb0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 --2- 172.21.15.46:0/3134322372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b940ccdc0 0x7f4b9414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 >> 172.21.15.46:0/3134322372 conn(0x7f4b940cf720 msgr2=0x7f4b940af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 shutdown_connections 2023-05-22T01:33:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:25.602+0000 7f4b99301700 1 -- 172.21.15.46:0/3134322372 wait complete. 2023-05-22T01:33:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-21T16:54:06.846734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-21T16:54:12.494641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-21T16:55:19.482721+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-05-21T16:55:20.275924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-22T01:33:26.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-22T01:33:26.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 Processor -- start 2023-05-22T01:33:26.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 -- start start 2023-05-22T01:33:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb624158ab0 0x7fb6240c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb624070ed0 0x7fb624071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb624071870 con 0x7fb62415ce70 2023-05-22T01:33:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240cf0e0 con 0x7fb624158ab0 2023-05-22T01:33:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb628fe2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240c50b0 con 0x7fb624070ed0 2023-05-22T01:33:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb624158ab0 0x7fb6240c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb624158ab0 0x7fb6240c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43450/0 (socket says 172.21.15.46:43450) 2023-05-22T01:33:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 -- 172.21.15.46:0/3480468546 learned_addr learned my addr 172.21.15.46:0/3480468546 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:26.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb623fff700 1 --2- 172.21.15.46:0/3480468546 >> v2:172.21.15.142:3300/0 conn(0x7fb624070ed0 0x7fb624071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 -- 172.21.15.46:0/3480468546 >> v2:172.21.15.142:3300/0 conn(0x7fb624070ed0 msgr2=0x7fb624071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 --2- 172.21.15.46:0/3480468546 >> v2:172.21.15.142:3300/0 conn(0x7fb624070ed0 0x7fb624071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 -- 172.21.15.46:0/3480468546 >> v1:172.21.15.142:6789/0 conn(0x7fb62415ce70 legacy=0x7fb6240ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 -- 172.21.15.46:0/3480468546 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240cd600 con 0x7fb624158ab0 2023-05-22T01:33:26.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6237fe700 1 --2- 172.21.15.46:0/3480468546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb624158ab0 0x7fb6240c4ad0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fb614009910 tx=0x7fb614009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b07f8a6c4a2b6a server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6227fc700 1 -- 172.21.15.46:0/3480468546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614011830 con 0x7fb624158ab0 2023-05-22T01:33:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6227fc700 1 -- 172.21.15.46:0/3480468546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614011990 con 0x7fb624158ab0 2023-05-22T01:33:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.210+0000 7fb6227fc700 1 -- 172.21.15.46:0/3480468546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614011d40 con 0x7fb624158ab0 2023-05-22T01:33:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- 172.21.15.46:0/3480468546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb624158ab0 msgr2=0x7fb6240c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3480468546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb624158ab0 0x7fb6240c4ad0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fb614009910 tx=0x7fb614009c20 comp rx=0 tx=0).stop 2023-05-22T01:33:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- 172.21.15.46:0/3480468546 shutdown_connections 2023-05-22T01:33:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3480468546 >> v2:172.21.15.142:3300/0 conn(0x7fb624070ed0 0x7fb624071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3480468546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb624158ab0 0x7fb6240c4ad0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- 172.21.15.46:0/3480468546 >> 172.21.15.46:0/3480468546 conn(0x7fb6240cfeb0 msgr2=0x7fb6240cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:26.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- 172.21.15.46:0/3480468546 shutdown_connections 2023-05-22T01:33:26.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- 172.21.15.46:0/3480468546 wait complete. 2023-05-22T01:33:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 Processor -- start 2023-05-22T01:33:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- start start 2023-05-22T01:33:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 0x7fb6241f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624158ab0 0x7fb62414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 0x7fb62415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624159850 con 0x7fb62415ce70 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62414a650 con 0x7fb624158ab0 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb628fe2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62415bdf0 con 0x7fb624070ed0 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb623fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 0x7fb62415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 0x7fb6241f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb623fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 0x7fb62415b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43452/0 (socket says 172.21.15.46:43452) 2023-05-22T01:33:26.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb623fff700 1 -- 172.21.15.46:0/3915276851 learned_addr learned my addr 172.21.15.46:0/3915276851 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 0x7fb6241f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37572/0 (socket says 172.21.15.46:37572) 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 -- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624158ab0 msgr2=0x7fb62414a110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624158ab0 0x7fb62414a110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 -- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 msgr2=0x7fb62415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 0x7fb62415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb6237fe700 1 -- 172.21.15.46:0/3915276851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614009570 con 0x7fb624070ed0 2023-05-22T01:33:26.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.214+0000 7fb623fff700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 0x7fb62415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb6237fe700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 0x7fb6241f60c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb614016000 tx=0x7fb614004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614004380 con 0x7fb624070ed0 2023-05-22T01:33:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61401f070 con 0x7fb624070ed0 2023-05-22T01:33:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140036c0 con 0x7fb624070ed0 2023-05-22T01:33:26.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6240cdbc0 con 0x7fb624070ed0 2023-05-22T01:33:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240cd8e0 con 0x7fb624070ed0 2023-05-22T01:33:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.218+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6240cd2b0 con 0x7fb624070ed0 2023-05-22T01:33:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.222+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb614021030 con 0x7fb624070ed0 2023-05-22T01:33:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.222+0000 7fb61bfff700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb604066340 0x7fb6040687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.222+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb614085430 con 0x7fb624070ed0 2023-05-22T01:33:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.222+0000 7fb622ffd700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb604066340 0x7fb6040687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.222+0000 7fb622ffd700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb604066340 0x7fb6040687f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb624165610 tx=0x7fb60c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:26.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.226+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb614052a00 con 0x7fb624070ed0 2023-05-22T01:33:26.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.494+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb62415bf30 con 0x7fb624070ed0 2023-05-22T01:33:26.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.494+0000 7fb61bfff700 1 -- 172.21.15.46:0/3915276851 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb614056020 con 0x7fb624070ed0 2023-05-22T01:33:26.510 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-05-22T01:33:26.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb604066340 msgr2=0x7fb6040687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb604066340 0x7fb6040687f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb624165610 tx=0x7fb60c007a80 comp rx=0 tx=0).stop 2023-05-22T01:33:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 msgr2=0x7fb6241f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 0x7fb6241f60c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb614016000 tx=0x7fb614004770 comp rx=0 tx=0).stop 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 shutdown_connections 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb604066340 0x7fb6040687f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb62415ce70 0x7fb62415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb624158ab0 0x7fb62414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 --2- 172.21.15.46:0/3915276851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb624070ed0 0x7fb6241f60c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 >> 172.21.15.46:0/3915276851 conn(0x7fb6240cfeb0 msgr2=0x7fb624069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:26.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 shutdown_connections 2023-05-22T01:33:26.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.498+0000 7fb628fe2700 1 -- 172.21.15.46:0/3915276851 wait complete. 2023-05-22T01:33:26.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-22T01:33:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd807fff700 1 Processor -- start 2023-05-22T01:33:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd807fff700 1 -- start start 2023-05-22T01:33:26.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd807fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8080caf10 0x7fd80815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd807fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80806b2a0 con 0x7fd8080adb50 2023-05-22T01:33:26.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd807fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080ccce0 con 0x7fd808159600 2023-05-22T01:33:26.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd807fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80815e0f0 con 0x7fd8080caf10 2023-05-22T01:33:26.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd8067fc700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd8080adb50 0x7fd8080ca800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35514/0 (socket says 172.21.15.46:35514) 2023-05-22T01:33:26.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd8067fc700 1 -- 172.21.15.46:0/3787227979 learned_addr learned my addr 172.21.15.46:0/3787227979 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd8077fe700 1 --2- 172.21.15.46:0/3787227979 >> v2:172.21.15.142:3300/0 conn(0x7fd8080caf10 0x7fd80815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218559297 0 0) 0x7fd80806b2a0 con 0x7fd8080adb50 2023-05-22T01:33:26.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f00035d0 con 0x7fd8080adb50 2023-05-22T01:33:26.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647343394 0 0) 0x7fd7f00035d0 con 0x7fd8080adb50 2023-05-22T01:33:26.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 >> v2:172.21.15.142:3300/0 conn(0x7fd8080caf10 msgr2=0x7fd80815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:26.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 --2- 172.21.15.46:0/3787227979 >> v2:172.21.15.142:3300/0 conn(0x7fd8080caf10 0x7fd80815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 >> v1:172.21.15.142:6789/0 conn(0x7fd808159600 legacy=0x7fd8080cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80806b4f0 con 0x7fd8080adb50 2023-05-22T01:33:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7fd8000019f0 con 0x7fd8080adb50 2023-05-22T01:33:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 >> v1:172.21.15.46:6789/0 conn(0x7fd8080adb50 legacy=0x7fd8080ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7f0003a20 0x7fd7f0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0004870 0x7fd7f0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7f0005340 0x7fd7f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80815e0f0 con 0x7fd7f0003a20 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f000c200 con 0x7fd7f0004870 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f000c3c0 con 0x7fd7f0005340 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd806ffd700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7f0003a20 0x7fd7f0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.686+0000 7fd8067fc700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0004870 0x7fd7f0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 -- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7f0005340 msgr2=0x7fd7f000ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-22T01:33:26.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7f0005340 0x7fd7f000ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 -- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0004870 msgr2=0x7fd7f0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:26.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0004870 0x7fd7f0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 -- 172.21.15.46:0/3787227979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00035d0 con 0x7fd7f0003a20 2023-05-22T01:33:26.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8077fe700 1 -- 172.21.15.46:0/3787227979 reap_dead start 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8067fc700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0004870 0x7fd7f0004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7f0003a20 0x7fd7f0003e30 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0017e0 tx=0x7fd7f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d24758d94b20498 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0052d0 con 0x7fd7f0003a20 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc005430 con 0x7fd7f0003a20 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd805ffb700 1 -- 172.21.15.46:0/3787227979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0055a0 con 0x7fd7f0003a20 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- 172.21.15.46:0/3787227979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7f0003a20 msgr2=0x7fd7f0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7f0003a20 0x7fd7f0003e30 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0017e0 tx=0x7fd7f00058a0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- 172.21.15.46:0/3787227979 shutdown_connections 2023-05-22T01:33:26.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 --2- 172.21.15.46:0/3787227979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7f0003a20 0x7fd7f0003e30 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- 172.21.15.46:0/3787227979 >> 172.21.15.46:0/3787227979 conn(0x7fd8080cc1a0 msgr2=0x7fd8080b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:26.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- 172.21.15.46:0/3787227979 shutdown_connections 2023-05-22T01:33:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- 172.21.15.46:0/3787227979 wait complete. 2023-05-22T01:33:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 Processor -- start 2023-05-22T01:33:26.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- start start 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0003a20 0x7fd80815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8080c5170 0x7fd8081469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 0x7fd8080cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080ce270 con 0x7fd8080cd8c0 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80815bf20 con 0x7fd7f0003a20 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd807fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd808146ef0 con 0x7fd8080c5170 2023-05-22T01:33:26.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 0x7fd8080cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 0x7fd8080cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43472/0 (socket says 172.21.15.46:43472) 2023-05-22T01:33:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8077fe700 1 -- 172.21.15.46:0/19546994 learned_addr learned my addr 172.21.15.46:0/19546994 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd806ffd700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0003a20 0x7fd80815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8067fc700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8080c5170 0x7fd8081469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8077fe700 1 -- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8080c5170 msgr2=0x7fd8081469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.690+0000 7fd8077fe700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8080c5170 0x7fd8081469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd8077fe700 1 -- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0003a20 msgr2=0x7fd80815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd8077fe700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0003a20 0x7fd80815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd8077fe700 1 -- 172.21.15.46:0/19546994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80806de70 con 0x7fd8080cd8c0 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd8067fc700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8080c5170 0x7fd8081469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd8077fe700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 0x7fd8080cdd30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fd8080cb2e0 tx=0x7fd7f800e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800c070 con 0x7fd8080cd8c0 2023-05-22T01:33:26.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f800ee90 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8004240 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80806b7d0 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80806e150 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8005310 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7f80043a0 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd7effff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7f40662f0 0x7fd7f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd7f8082cb0 con 0x7fd8080cd8c0 2023-05-22T01:33:26.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd806ffd700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7f40662f0 0x7fd7f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.694+0000 7fd806ffd700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7f40662f0 0x7fd7f40687a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc005040 tx=0x7fd7fc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.698+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd7f80501e0 con 0x7fd8080cd8c0 2023-05-22T01:33:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.954+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7e8005b40 con 0x7fd8080cd8c0 2023-05-22T01:33:26.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.954+0000 7fd7effff700 1 -- 172.21.15.46:0/19546994 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7f8053800 con 0x7fd8080cd8c0 2023-05-22T01:33:26.970 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2023-05-22T01:33:26.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.958+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7f40662f0 msgr2=0x7fd7f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.958+0000 7fd807fff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7f40662f0 0x7fd7f40687a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc005040 tx=0x7fd7fc009030 comp rx=0 tx=0).stop 2023-05-22T01:33:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.958+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 msgr2=0x7fd8080cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.958+0000 7fd807fff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 0x7fd8080cdd30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fd8080cb2e0 tx=0x7fd7f800e790 comp rx=0 tx=0).stop 2023-05-22T01:33:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 shutdown_connections 2023-05-22T01:33:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd7f40662f0 0x7fd7f40687a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8080cd8c0 0x7fd8080cdd30 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8080c5170 0x7fd8081469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 --2- 172.21.15.46:0/19546994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f0003a20 0x7fd80815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 >> 172.21.15.46:0/19546994 conn(0x7fd8080cc1a0 msgr2=0x7fd8080affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 shutdown_connections 2023-05-22T01:33:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:26.962+0000 7fd807fff700 1 -- 172.21.15.46:0/19546994 wait complete. 2023-05-22T01:33:27.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-22T01:33:27.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c6807700 1 Processor -- start 2023-05-22T01:33:27.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c6807700 1 -- start start 2023-05-22T01:33:27.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c6807700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0c0143c90 0x7ff0c015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c6807700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c015ed60 con 0x7ff0c00c9870 2023-05-22T01:33:27.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c6807700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00cd6b0 con 0x7ff0c0070ed0 2023-05-22T01:33:27.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c6807700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00cba50 con 0x7ff0c0143c90 2023-05-22T01:33:27.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5004700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff0c00c9870 0x7ff0c0069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35528/0 (socket says 172.21.15.46:35528) 2023-05-22T01:33:27.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5004700 1 -- 172.21.15.46:0/1737978112 learned_addr learned my addr 172.21.15.46:0/1737978112 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:27.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5805700 1 --2- 172.21.15.46:0/1737978112 >> v2:172.21.15.142:3300/0 conn(0x7ff0c0143c90 0x7ff0c015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5805700 1 -- 172.21.15.46:0/1737978112 >> v1:172.21.15.142:6789/0 conn(0x7ff0c0070ed0 legacy=0x7ff0c00712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5805700 1 -- 172.21.15.46:0/1737978112 >> v1:172.21.15.46:6789/0 conn(0x7ff0c00c9870 legacy=0x7ff0c0069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5805700 1 -- 172.21.15.46:0/1737978112 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00c9d00 con 0x7ff0c0143c90 2023-05-22T01:33:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.158+0000 7ff0c5805700 1 --2- 172.21.15.46:0/1737978112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c015e820 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009850 tx=0x7ff0bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a12b02279ac410 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.162+0000 7ff0c4803700 1 -- 172.21.15.46:0/1737978112 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc010790 con 0x7ff0c0143c90 2023-05-22T01:33:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.162+0000 7ff0c4803700 1 -- 172.21.15.46:0/1737978112 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0108f0 con 0x7ff0c0143c90 2023-05-22T01:33:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.162+0000 7ff0c4803700 1 -- 172.21.15.46:0/1737978112 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc010ca0 con 0x7ff0c0143c90 2023-05-22T01:33:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.162+0000 7ff0c6807700 1 -- 172.21.15.46:0/1737978112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 msgr2=0x7ff0c015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.162+0000 7ff0c6807700 1 --2- 172.21.15.46:0/1737978112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c015e820 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009850 tx=0x7ff0bc009b60 comp rx=0 tx=0).stop 2023-05-22T01:33:27.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.166+0000 7ff0c6807700 1 -- 172.21.15.46:0/1737978112 shutdown_connections 2023-05-22T01:33:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.166+0000 7ff0c6807700 1 --2- 172.21.15.46:0/1737978112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c015e820 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.166+0000 7ff0c6807700 1 -- 172.21.15.46:0/1737978112 >> 172.21.15.46:0/1737978112 conn(0x7ff0c00cfeb0 msgr2=0x7ff0c00cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.166+0000 7ff0c6807700 1 -- 172.21.15.46:0/1737978112 shutdown_connections 2023-05-22T01:33:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.166+0000 7ff0c6807700 1 -- 172.21.15.46:0/1737978112 wait complete. 2023-05-22T01:33:27.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 Processor -- start 2023-05-22T01:33:27.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 -- start start 2023-05-22T01:33:27.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0c0070ed0 0x7ff0c01ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0c00c9870 0x7ff0c013a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c01feb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01ebdd0 con 0x7ff0c0070ed0 2023-05-22T01:33:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01eb750 con 0x7ff0c0143c90 2023-05-22T01:33:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6807700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01ff610 con 0x7ff0c00c9870 2023-05-22T01:33:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6006700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c01feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6006700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c01feb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39244/0 (socket says 172.21.15.46:39244) 2023-05-22T01:33:27.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6006700 1 -- 172.21.15.46:0/4287318580 learned_addr learned my addr 172.21.15.46:0/4287318580 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0c0070ed0 0x7ff0c01ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 -- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0c00c9870 msgr2=0x7ff0c013a310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0c00c9870 0x7ff0c013a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 -- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 msgr2=0x7ff0c01feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c01feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 -- 172.21.15.46:0/4287318580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0094b0 con 0x7ff0c0070ed0 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c6006700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c01feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:27.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.170+0000 7ff0c5805700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0c0070ed0 0x7ff0c01ffbd0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc015000 tx=0x7ff0bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:27.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.174+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc004510 con 0x7ff0c0070ed0 2023-05-22T01:33:27.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.174+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc01f070 con 0x7ff0c0070ed0 2023-05-22T01:33:27.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.174+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c00cd340 con 0x7ff0c0070ed0 2023-05-22T01:33:27.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.174+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c00c9fe0 con 0x7ff0c0070ed0 2023-05-22T01:33:27.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.174+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc003900 con 0x7ff0c0070ed0 2023-05-22T01:33:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.178+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0bc003a60 con 0x7ff0c0070ed0 2023-05-22T01:33:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.178+0000 7ff0b67fc700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0a4066340 0x7ff0a40687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.178+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ff0bc021070 con 0x7ff0c0070ed0 2023-05-22T01:33:27.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.178+0000 7ff0c5004700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0a4066340 0x7ff0a40687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.178+0000 7ff0c5004700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0a4066340 0x7ff0a40687f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00c6640 tx=0x7ff0b0007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:27.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.182+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a8005310 con 0x7ff0c0070ed0 2023-05-22T01:33:27.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.190+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff0bc0528e0 con 0x7ff0c0070ed0 2023-05-22T01:33:27.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.446+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0a8005b40 con 0x7ff0c0070ed0 2023-05-22T01:33:27.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.446+0000 7ff0b67fc700 1 -- 172.21.15.46:0/4287318580 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0bc055f00 con 0x7ff0c0070ed0 2023-05-22T01:33:27.462 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-05-22T01:33:27.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0a4066340 msgr2=0x7ff0a40687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0a4066340 0x7ff0a40687f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00c6640 tx=0x7ff0b0007a50 comp rx=0 tx=0).stop 2023-05-22T01:33:27.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0c0070ed0 msgr2=0x7ff0c01ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0c0070ed0 0x7ff0c01ffbd0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc015000 tx=0x7ff0bc004770 comp rx=0 tx=0).stop 2023-05-22T01:33:27.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 shutdown_connections 2023-05-22T01:33:27.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ff0a4066340 0x7ff0a40687f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0c0143c90 0x7ff0c01feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0c00c9870 0x7ff0c013a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 --2- 172.21.15.46:0/4287318580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0c0070ed0 0x7ff0c01ffbd0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 >> 172.21.15.46:0/4287318580 conn(0x7ff0c00cfeb0 msgr2=0x7ff0c00c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:27.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 shutdown_connections 2023-05-22T01:33:27.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.450+0000 7ff0c6807700 1 -- 172.21.15.46:0/4287318580 wait complete. 2023-05-22T01:33:27.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-22T01:33:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 Processor -- start 2023-05-22T01:33:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 -- start start 2023-05-22T01:33:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc2015ed70 0x7fdc20069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2015bab0 con 0x7fdc2015e210 2023-05-22T01:33:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc200ae290 con 0x7fdc2015ed70 2023-05-22T01:33:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc26217700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2006d050 con 0x7fdc200adec0 2023-05-22T01:33:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc24a14700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdc2015e210 0x7fdc2015e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35534/0 (socket says 172.21.15.46:35534) 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc24a14700 1 -- 172.21.15.46:0/2854888205 learned_addr learned my addr 172.21.15.46:0/2854888205 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25a16700 1 --2- 172.21.15.46:0/2854888205 >> v2:172.21.15.142:3300/0 conn(0x7fdc2015ed70 0x7fdc20069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25215700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25a16700 1 -- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 msgr2=0x7fdc200caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25a16700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25a16700 1 -- 172.21.15.46:0/2854888205 >> v1:172.21.15.46:6789/0 conn(0x7fdc2015e210 legacy=0x7fdc2015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25a16700 1 -- 172.21.15.46:0/2854888205 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2006d330 con 0x7fdc2015ed70 2023-05-22T01:33:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25215700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.650+0000 7fdc25a16700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc20069f80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009850 tx=0x7fdc10009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4348e079bf4738 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc17fff700 1 -- 172.21.15.46:0/2854888205 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10004230 con 0x7fdc2015ed70 2023-05-22T01:33:27.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc17fff700 1 -- 172.21.15.46:0/2854888205 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10004390 con 0x7fdc2015ed70 2023-05-22T01:33:27.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc17fff700 1 -- 172.21.15.46:0/2854888205 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100036c0 con 0x7fdc2015ed70 2023-05-22T01:33:27.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc26217700 1 -- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 msgr2=0x7fdc20069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc26217700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc20069f80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009850 tx=0x7fdc10009b60 comp rx=0 tx=0).stop 2023-05-22T01:33:27.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc26217700 1 -- 172.21.15.46:0/2854888205 shutdown_connections 2023-05-22T01:33:27.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc26217700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc20069f80 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc26217700 1 --2- 172.21.15.46:0/2854888205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.654+0000 7fdc26217700 1 -- 172.21.15.46:0/2854888205 >> 172.21.15.46:0/2854888205 conn(0x7fdc200cc1a0 msgr2=0x7fdc200b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:27.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.666+0000 7fdc26217700 1 -- 172.21.15.46:0/2854888205 shutdown_connections 2023-05-22T01:33:27.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.670+0000 7fdc26217700 1 -- 172.21.15.46:0/2854888205 wait complete. 2023-05-22T01:33:27.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 Processor -- start 2023-05-22T01:33:27.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 -- start start 2023-05-22T01:33:27.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 0x7fdc200cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc200ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200ab8f0 con 0x7fdc2015e210 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200abbd0 con 0x7fdc2015ed70 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200abeb0 con 0x7fdc200adec0 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 0x7fdc200cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 0x7fdc200cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43486/0 (socket says 172.21.15.46:43486) 2023-05-22T01:33:27.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 -- 172.21.15.46:0/511094709 learned_addr learned my addr 172.21.15.46:0/511094709 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:27.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc25a16700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc200ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc25215700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 -- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 msgr2=0x7fdc200b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 -- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 msgr2=0x7fdc200ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc200ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 -- 172.21.15.46:0/511094709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0094b0 con 0x7fdc2015e210 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc24a14700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 0x7fdc200cc780 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fdc18002080 tx=0x7fdc1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800ac90 con 0x7fdc2015e210 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1800adf0 con 0x7fdc2015e210 2023-05-22T01:33:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18007310 con 0x7fdc2015e210 2023-05-22T01:33:27.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc100094b0 con 0x7fdc2015e210 2023-05-22T01:33:27.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.674+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc200ca2d0 con 0x7fdc2015e210 2023-05-22T01:33:27.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.678+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc18007470 con 0x7fdc2015e210 2023-05-22T01:33:27.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.678+0000 7fdc15ffb700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc040662f0 0x7fdc040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:27.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.678+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fdc180837c0 con 0x7fdc2015e210 2023-05-22T01:33:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.678+0000 7fdc25215700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc040662f0 0x7fdc040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.678+0000 7fdc25215700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc040662f0 0x7fdc040687a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fdc201f2ce0 tx=0x7fdc1c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:27.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.678+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2006d610 con 0x7fdc2015e210 2023-05-22T01:33:27.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:27.690+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdc18050cb0 con 0x7fdc2015e210 2023-05-22T01:33:28.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.022+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc200ca580 con 0x7fdc2015e210 2023-05-22T01:33:28.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.022+0000 7fdc15ffb700 1 -- 172.21.15.46:0/511094709 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc18018030 con 0x7fdc2015e210 2023-05-22T01:33:28.041 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-05-22T01:33:28.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc040662f0 msgr2=0x7fdc040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc040662f0 0x7fdc040687a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fdc201f2ce0 tx=0x7fdc1c009240 comp rx=0 tx=0).stop 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 msgr2=0x7fdc200cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 0x7fdc200cc780 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fdc18002080 tx=0x7fdc1800a340 comp rx=0 tx=0).stop 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 shutdown_connections 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc040662f0 0x7fdc040687a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc2015ed70 0x7fdc200ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc2015e210 0x7fdc200cc780 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 --2- 172.21.15.46:0/511094709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc200adec0 0x7fdc200b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 >> 172.21.15.46:0/511094709 conn(0x7fdc200cc1a0 msgr2=0x7fdc2015d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 shutdown_connections 2023-05-22T01:33:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.030+0000 7fdc26217700 1 -- 172.21.15.46:0/511094709 wait complete. 2023-05-22T01:33:28.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-22T01:33:28.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 Processor -- start 2023-05-22T01:33:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 -- start start 2023-05-22T01:33:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba8c158b60 0x7fba8c069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 0x7fba8c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba8c0cda20 0x7fba8c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0ce560 con 0x7fba8c158b60 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c158f30 con 0x7fba8c0cda20 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91813700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c06d3e0 con 0x7fba8c06a4c0 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 0x7fba8c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 0x7fba8c0cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37616/0 (socket says 172.21.15.46:37616) 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 -- 172.21.15.46:0/2657292148 learned_addr learned my addr 172.21.15.46:0/2657292148 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91012700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.142:3300/0 conn(0x7fba8c0cda20 0x7fba8c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba90811700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.46:3300/0 conn(0x7fba8c158b60 0x7fba8c069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 -- 172.21.15.46:0/2657292148 >> v2:172.21.15.142:3300/0 conn(0x7fba8c0cda20 msgr2=0x7fba8c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.142:3300/0 conn(0x7fba8c0cda20 0x7fba8c06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 -- 172.21.15.46:0/2657292148 >> v2:172.21.15.46:3300/0 conn(0x7fba8c158b60 msgr2=0x7fba8c069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:28.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.46:3300/0 conn(0x7fba8c158b60 0x7fba8c069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 -- 172.21.15.46:0/2657292148 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c06cdd0 con 0x7fba8c06a4c0 2023-05-22T01:33:28.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba91012700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.142:3300/0 conn(0x7fba8c0cda20 0x7fba8c06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:28.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba90811700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.46:3300/0 conn(0x7fba8c158b60 0x7fba8c069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-22T01:33:28.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.290+0000 7fba8bfff700 1 --2- 172.21.15.46:0/2657292148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 0x7fba8c0cd4e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06c250 tx=0x7fba7c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e0bfb9c1170397 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:28.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.294+0000 7fba8b7fe700 1 -- 172.21.15.46:0/2657292148 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011830 con 0x7fba8c06a4c0 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.294+0000 7fba8b7fe700 1 -- 172.21.15.46:0/2657292148 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c011990 con 0x7fba8c06a4c0 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.294+0000 7fba8b7fe700 1 -- 172.21.15.46:0/2657292148 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011d00 con 0x7fba8c06a4c0 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.298+0000 7fba91813700 1 -- 172.21.15.46:0/2657292148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 msgr2=0x7fba8c0cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.298+0000 7fba91813700 1 --2- 172.21.15.46:0/2657292148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 0x7fba8c0cd4e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06c250 tx=0x7fba7c009c20 comp rx=0 tx=0).stop 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.302+0000 7fba91813700 1 -- 172.21.15.46:0/2657292148 shutdown_connections 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.302+0000 7fba91813700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.142:3300/0 conn(0x7fba8c0cda20 0x7fba8c06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.302+0000 7fba91813700 1 --2- 172.21.15.46:0/2657292148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c06a4c0 0x7fba8c0cd4e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.302+0000 7fba91813700 1 --2- 172.21.15.46:0/2657292148 >> v2:172.21.15.46:3300/0 conn(0x7fba8c158b60 0x7fba8c069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.302+0000 7fba91813700 1 -- 172.21.15.46:0/2657292148 >> 172.21.15.46:0/2657292148 conn(0x7fba8c0cc1a0 msgr2=0x7fba8c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:28.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.326+0000 7fba91813700 1 -- 172.21.15.46:0/2657292148 shutdown_connections 2023-05-22T01:33:28.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.326+0000 7fba91813700 1 -- 172.21.15.46:0/2657292148 wait complete. 2023-05-22T01:33:28.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 Processor -- start 2023-05-22T01:33:28.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 -- start start 2023-05-22T01:33:28.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 0x7fba8c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 0x7fba8c0af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c158b60 0x7fba8c0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c159c80 con 0x7fba8c06a4c0 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c159070 con 0x7fba8c0cda20 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba91813700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c159350 con 0x7fba8c158b60 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba90811700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 0x7fba8c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba8bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 0x7fba8c0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba8bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 0x7fba8c0af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39270/0 (socket says 172.21.15.46:39270) 2023-05-22T01:33:28.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba8bfff700 1 -- 172.21.15.46:0/787341948 learned_addr learned my addr 172.21.15.46:0/787341948 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:28.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba90811700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 0x7fba8c14e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43502/0 (socket says 172.21.15.46:43502) 2023-05-22T01:33:28.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba8bfff700 1 -- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c158b60 msgr2=0x7fba8c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba8bfff700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c158b60 0x7fba8c0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.330+0000 7fba8bfff700 1 -- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 msgr2=0x7fba8c14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba8bfff700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 0x7fba8c14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba8bfff700 1 -- 172.21.15.46:0/787341948 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800094b0 con 0x7fba8c0cda20 2023-05-22T01:33:28.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba90811700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 0x7fba8c14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:28.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba8bfff700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 0x7fba8c0af880 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:28.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c004510 con 0x7fba8c0cda20 2023-05-22T01:33:28.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0036c0 con 0x7fba8c0cda20 2023-05-22T01:33:28.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c009570 con 0x7fba8c0cda20 2023-05-22T01:33:28.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c003a70 con 0x7fba8c0cda20 2023-05-22T01:33:28.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c0ce280 con 0x7fba8c0cda20 2023-05-22T01:33:28.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba7c003bd0 con 0x7fba8c0cda20 2023-05-22T01:33:28.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.334+0000 7fba897fa700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba78066320 0x7fba780687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:28.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.338+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fba7c085140 con 0x7fba8c0cda20 2023-05-22T01:33:28.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.346+0000 7fba90811700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba78066320 0x7fba780687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:28.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.346+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c0cdfa0 con 0x7fba8c0cda20 2023-05-22T01:33:28.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.354+0000 7fba90811700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba78066320 0x7fba780687d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fba8400d7c0 tx=0x7fba84007770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:28.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.358+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fba7c052770 con 0x7fba8c0cda20 2023-05-22T01:33:28.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.670+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba8c06d070 con 0x7fba8c0cda20 2023-05-22T01:33:28.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.670+0000 7fba897fa700 1 -- 172.21.15.46:0/787341948 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fba7c015090 con 0x7fba8c0cda20 2023-05-22T01:33:28.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:28.686 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:55:21.293141+0000","modified":"2023-05-21T16:55:24.614864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/2842509941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":2842509941},{"type":"v1","addr":"172.21.15.46:6837","nonce":2842509941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-22T01:33:28.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba78066320 msgr2=0x7fba780687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba78066320 0x7fba780687d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fba8400d7c0 tx=0x7fba84007770 comp rx=0 tx=0).stop 2023-05-22T01:33:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 msgr2=0x7fba8c0af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 0x7fba8c0af880 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c004770 comp rx=0 tx=0).stop 2023-05-22T01:33:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 shutdown_connections 2023-05-22T01:33:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fba78066320 0x7fba780687d0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba8c158b60 0x7fba8c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba8c0cda20 0x7fba8c0af880 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 --2- 172.21.15.46:0/787341948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba8c06a4c0 0x7fba8c14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:28.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 >> 172.21.15.46:0/787341948 conn(0x7fba8c0cc1a0 msgr2=0x7fba8c152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:28.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 shutdown_connections 2023-05-22T01:33:28.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:28.674+0000 7fba91813700 1 -- 172.21.15.46:0/787341948 wait complete. 2023-05-22T01:33:28.693 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-05-22T01:33:28.844 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-22T01:33:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 Processor -- start 2023-05-22T01:33:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 -- start start 2023-05-22T01:33:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f0816ca90 0x7f1f080710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080715f0 con 0x7f1f0816ce60 2023-05-22T01:33:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080af220 con 0x7f1f0816ca90 2023-05-22T01:33:29.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f0e227700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0816e190 con 0x7f1f080b1130 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f077fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f0816ca90 0x7f1f080710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f077fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f0816ca90 0x7f1f080710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43506/0 (socket says 172.21.15.46:43506) 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f077fe700 1 -- 172.21.15.46:0/776306527 learned_addr learned my addr 172.21.15.46:0/776306527 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.070+0000 7f1f07fff700 1 --2- 172.21.15.46:0/776306527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f067fc700 1 -- 172.21.15.46:0/776306527 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396932335 0 0) 0x7f1f00001490 con 0x7f1f0816ce60 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f067fc700 1 -- 172.21.15.46:0/776306527 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef00035d0 con 0x7f1f0816ce60 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f07fff700 1 -- 172.21.15.46:0/776306527 >> v2:172.21.15.46:3300/0 conn(0x7f1f0816ca90 msgr2=0x7f1f080710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:29.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f07fff700 1 --2- 172.21.15.46:0/776306527 >> v2:172.21.15.46:3300/0 conn(0x7f1f0816ca90 0x7f1f080710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f07fff700 1 -- 172.21.15.46:0/776306527 >> v1:172.21.15.46:6789/0 conn(0x7f1f0816ce60 legacy=0x7f1f080b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:29.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f07fff700 1 -- 172.21.15.46:0/776306527 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0816d2a0 con 0x7f1f080b1130 2023-05-22T01:33:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f07fff700 1 --2- 172.21.15.46:0/776306527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080890f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00ddb0 tx=0x7f1efc00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8496bf7bf7922164 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f067fc700 1 -- 172.21.15.46:0/776306527 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc012070 con 0x7f1f080b1130 2023-05-22T01:33:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f067fc700 1 -- 172.21.15.46:0/776306527 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00d2e0 con 0x7f1f080b1130 2023-05-22T01:33:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.074+0000 7f1f067fc700 1 -- 172.21.15.46:0/776306527 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00fb30 con 0x7f1f080b1130 2023-05-22T01:33:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 -- 172.21.15.46:0/776306527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 msgr2=0x7f1f080890f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:29.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 --2- 172.21.15.46:0/776306527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080890f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00ddb0 tx=0x7f1efc00f330 comp rx=0 tx=0).stop 2023-05-22T01:33:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 -- 172.21.15.46:0/776306527 shutdown_connections 2023-05-22T01:33:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 --2- 172.21.15.46:0/776306527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080890f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 --2- 172.21.15.46:0/776306527 >> v2:172.21.15.46:3300/0 conn(0x7f1f0816ca90 0x7f1f080710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 -- 172.21.15.46:0/776306527 >> 172.21.15.46:0/776306527 conn(0x7f1f080ceca0 msgr2=0x7f1f080cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 -- 172.21.15.46:0/776306527 shutdown_connections 2023-05-22T01:33:29.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.078+0000 7f1f0e227700 1 -- 172.21.15.46:0/776306527 wait complete. 2023-05-22T01:33:29.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.082+0000 7f1f0e227700 1 Processor -- start 2023-05-22T01:33:29.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 -- start start 2023-05-22T01:33:29.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0816ca90 0x7f1f0816abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f0816ce60 0x7f1f080888d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080c7760 con 0x7f1f0816ca90 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080c40a0 con 0x7f1f0816ce60 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080c3b20 con 0x7f1f080b1130 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f06ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0816ca90 0x7f1f0816abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37642/0 (socket says 172.21.15.46:37642) 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 -- 172.21.15.46:0/4176279360 learned_addr learned my addr 172.21.15.46:0/4176279360 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 -- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f0816ce60 msgr2=0x7f1f080888d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f0816ce60 0x7f1f080888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 -- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0816ca90 msgr2=0x7f1f0816abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0816ca90 0x7f1f0816abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 -- 172.21.15.46:0/4176279360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc00da90 con 0x7f1f080b1130 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f06ffd700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0816ca90 0x7f1f0816abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f077fe700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080c54e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800db90 tx=0x7f1ef800dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800ce00 con 0x7f1f080b1130 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8015420 con 0x7f1f080b1130 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0816d860 con 0x7f1f080b1130 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8015790 con 0x7f1f080b1130 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.090+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0816d580 con 0x7f1f080b1130 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.094+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ef80158f0 con 0x7f1f080b1130 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.094+0000 7f1eeffff700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1ef40662f0 0x7f1ef40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.094+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f1ef8083f00 con 0x7f1f080b1130 2023-05-22T01:33:29.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.094+0000 7f1f06ffd700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1ef40662f0 0x7f1ef40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:29.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.094+0000 7f1f06ffd700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1ef40662f0 0x7f1ef40687a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1f000016f0 tx=0x7f1f00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:29.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.098+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0816db40 con 0x7f1f080b1130 2023-05-22T01:33:29.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.106+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1ef80512e0 con 0x7f1f080b1130 2023-05-22T01:33:29.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.378+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f08074200 con 0x7f1f080b1130 2023-05-22T01:33:29.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.378+0000 7f1eeffff700 1 -- 172.21.15.46:0/4176279360 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18344 (secure 0 0 0) 0x7f1ef8054900 con 0x7f1f080b1130 2023-05-22T01:33:29.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:29.402 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:56:01.633427+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:55:19.482721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-21T16:55:20.275924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-22T01:33:29.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1ef40662f0 msgr2=0x7f1ef40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:29.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1ef40662f0 0x7f1ef40687a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1f000016f0 tx=0x7f1f00009040 comp rx=0 tx=0).stop 2023-05-22T01:33:29.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 msgr2=0x7f1f080c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:29.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080c54e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800db90 tx=0x7f1ef800dea0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 shutdown_connections 2023-05-22T01:33:29.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f1ef40662f0 0x7f1ef40687a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f0816ce60 0x7f1f080888d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0816ca90 0x7f1f0816abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 --2- 172.21.15.46:0/4176279360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f080b1130 0x7f1f080c54e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 >> 172.21.15.46:0/4176279360 conn(0x7f1f080ceca0 msgr2=0x7f1f080ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 shutdown_connections 2023-05-22T01:33:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:29.386+0000 7f1f0e227700 1 -- 172.21.15.46:0/4176279360 wait complete. 2023-05-22T01:33:29.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-22T01:33:31.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-22T01:33:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 Processor -- start 2023-05-22T01:33:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 -- start start 2023-05-22T01:33:31.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8474164bf0 0x7f84740c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8474164fc0 0x7f8474160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847406c990 con 0x7f8474164fc0 2023-05-22T01:33:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847406b900 con 0x7f8474164bf0 2023-05-22T01:33:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84797b6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847406b620 con 0x7f8474160d70 2023-05-22T01:33:31.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8474164fc0 0x7f8474160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8474164fc0 0x7f8474160830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43526/0 (socket says 172.21.15.46:43526) 2023-05-22T01:33:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 -- 172.21.15.46:0/2294104293 learned_addr learned my addr 172.21.15.46:0/2294104293 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f8478fb5700 1 --2- 172.21.15.46:0/2294104293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 -- 172.21.15.46:0/2294104293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 msgr2=0x7f84740cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:31.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 --2- 172.21.15.46:0/2294104293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 -- 172.21.15.46:0/2294104293 >> v2:172.21.15.142:3300/0 conn(0x7f8474164bf0 msgr2=0x7f84740c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 --2- 172.21.15.46:0/2294104293 >> v2:172.21.15.142:3300/0 conn(0x7f8474164bf0 0x7f84740c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 -- 172.21.15.46:0/2294104293 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740cc770 con 0x7f8474164fc0 2023-05-22T01:33:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f84737fe700 1 --2- 172.21.15.46:0/2294104293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164fc0 0x7f8474160830 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f847406c030 tx=0x7f846c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bb4d33eaa64600 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f8472ffd700 1 -- 172.21.15.46:0/2294104293 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00e070 con 0x7f8474164fc0 2023-05-22T01:33:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f8472ffd700 1 -- 172.21.15.46:0/2294104293 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00b910 con 0x7f8474164fc0 2023-05-22T01:33:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.562+0000 7f8472ffd700 1 -- 172.21.15.46:0/2294104293 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00bcc0 con 0x7f8474164fc0 2023-05-22T01:33:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- 172.21.15.46:0/2294104293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164fc0 msgr2=0x7f8474160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:31.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- 172.21.15.46:0/2294104293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164fc0 0x7f8474160830 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f847406c030 tx=0x7f846c00b330 comp rx=0 tx=0).stop 2023-05-22T01:33:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- 172.21.15.46:0/2294104293 shutdown_connections 2023-05-22T01:33:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- 172.21.15.46:0/2294104293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- 172.21.15.46:0/2294104293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164fc0 0x7f8474160830 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- 172.21.15.46:0/2294104293 >> v2:172.21.15.142:3300/0 conn(0x7f8474164bf0 0x7f84740c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- 172.21.15.46:0/2294104293 >> 172.21.15.46:0/2294104293 conn(0x7f84740cc1a0 msgr2=0x7f84740b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:31.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- 172.21.15.46:0/2294104293 shutdown_connections 2023-05-22T01:33:31.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- 172.21.15.46:0/2294104293 wait complete. 2023-05-22T01:33:31.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 Processor -- start 2023-05-22T01:33:31.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- start start 2023-05-22T01:33:31.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 0x7f84740b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8474164fc0 0x7f847415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84740c39e0 con 0x7f8474164bf0 2023-05-22T01:33:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84740c49b0 con 0x7f8474164fc0 2023-05-22T01:33:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84797b6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84740c4c50 con 0x7f8474160d70 2023-05-22T01:33:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 0x7f84740b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 0x7f84740b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43536/0 (socket says 172.21.15.46:43536) 2023-05-22T01:33:31.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 -- 172.21.15.46:0/2468780208 learned_addr learned my addr 172.21.15.46:0/2468780208 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:31.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f8478fb5700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8474164fc0 0x7f847415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:31.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f8473fff700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:31.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 -- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 msgr2=0x7f84740b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:31.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 -- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8474164fc0 msgr2=0x7f847415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8474164fc0 0x7f847415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.566+0000 7f84737fe700 1 -- 172.21.15.46:0/2468780208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009b30 con 0x7f8474164bf0 2023-05-22T01:33:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f84737fe700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 0x7f84740b2a70 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f846c000f80 tx=0x7f846c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c004450 con 0x7f8474164bf0 2023-05-22T01:33:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c0045d0 con 0x7f8474164bf0 2023-05-22T01:33:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84740ccd30 con 0x7f8474164bf0 2023-05-22T01:33:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c004980 con 0x7f8474164bf0 2023-05-22T01:33:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84740cca50 con 0x7f8474164bf0 2023-05-22T01:33:31.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.570+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84740ca240 con 0x7f8474164bf0 2023-05-22T01:33:31.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.574+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f846c034400 con 0x7f8474164bf0 2023-05-22T01:33:31.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.574+0000 7f8470ff9700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f84600662f0 0x7f84600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.574+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f846c084d50 con 0x7f8474164bf0 2023-05-22T01:33:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.574+0000 7f8473fff700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f84600662f0 0x7f84600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:31.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.574+0000 7f8473fff700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f84600662f0 0x7f84600687a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8464009ac0 tx=0x7f84640091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:31.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.586+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f846c055df0 con 0x7f8474164bf0 2023-05-22T01:33:31.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.902+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84740c3b90 con 0x7f8474164bf0 2023-05-22T01:33:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.910+0000 7f8470ff9700 1 -- 172.21.15.46:0/2468780208 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f84740c3b90 con 0x7f8474164bf0 2023-05-22T01:33:31.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:31.930 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:55:21.293141+0000","modified":"2023-05-21T16:55:24.614864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/2842509941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":2842509941},{"type":"v1","addr":"172.21.15.46:6837","nonce":2842509941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-22T01:33:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f84600662f0 msgr2=0x7f84600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f84600662f0 0x7f84600687a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f8464009ac0 tx=0x7f84640091c0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 msgr2=0x7f84740b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 0x7f84740b2a70 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f846c000f80 tx=0x7f846c004af0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 shutdown_connections 2023-05-22T01:33:31.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f84600662f0 0x7f84600687a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8474164fc0 0x7f847415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8474164bf0 0x7f84740b2a70 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 --2- 172.21.15.46:0/2468780208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8474160d70 0x7f84740b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 >> 172.21.15.46:0/2468780208 conn(0x7f84740cc1a0 msgr2=0x7f847415a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 shutdown_connections 2023-05-22T01:33:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:31.918+0000 7f84797b6700 1 -- 172.21.15.46:0/2468780208 wait complete. 2023-05-22T01:33:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-05-22T01:33:32.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-22T01:33:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438a980700 1 Processor -- start 2023-05-22T01:33:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438a980700 1 -- start start 2023-05-22T01:33:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438a980700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43840b5ce0 0x7f43840cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438a980700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43840b8ea0 con 0x7f43840b4910 2023-05-22T01:33:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438a980700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43840d09d0 con 0x7f43840b8ad0 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438a980700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43840d0cb0 con 0x7f43840b5ce0 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43840b5ce0 0x7f43840cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f43840b5ce0 0x7f43840cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43550/0 (socket says 172.21.15.46:43550) 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438997e700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f43840b8ad0 0x7f438406a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:55318/0 (socket says 172.21.15.46:55318) 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 -- 172.21.15.46:0/3246990657 learned_addr learned my addr 172.21.15.46:0/3246990657 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438897c700 1 -- 172.21.15.46:0/3246990657 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475506348 0 0) 0x7f43840b8ea0 con 0x7f43840b4910 2023-05-22T01:33:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 -- 172.21.15.46:0/3246990657 >> v1:172.21.15.142:6789/0 conn(0x7f43840b8ad0 legacy=0x7f438406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 -- 172.21.15.46:0/3246990657 >> v1:172.21.15.46:6789/0 conn(0x7f43840b4910 legacy=0x7f43840d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 -- 172.21.15.46:0/3246990657 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43840cd4f0 con 0x7f43840b5ce0 2023-05-22T01:33:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438917d700 1 --2- 172.21.15.46:0/3246990657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f43840cf310 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f4374009910 tx=0x7f4374009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab628ffafa2dcc8b server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438897c700 1 -- 172.21.15.46:0/3246990657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400ba60 con 0x7f43840b5ce0 2023-05-22T01:33:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438897c700 1 -- 172.21.15.46:0/3246990657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400bbc0 con 0x7f43840b5ce0 2023-05-22T01:33:32.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.230+0000 7f438897c700 1 -- 172.21.15.46:0/3246990657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374009e60 con 0x7f43840b5ce0 2023-05-22T01:33:32.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- 172.21.15.46:0/3246990657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 msgr2=0x7f43840cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 --2- 172.21.15.46:0/3246990657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f43840cf310 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f4374009910 tx=0x7f4374009c20 comp rx=0 tx=0).stop 2023-05-22T01:33:32.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- 172.21.15.46:0/3246990657 shutdown_connections 2023-05-22T01:33:32.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 --2- 172.21.15.46:0/3246990657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f43840cf310 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- 172.21.15.46:0/3246990657 >> 172.21.15.46:0/3246990657 conn(0x7f43840d3ae0 msgr2=0x7f43840cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- 172.21.15.46:0/3246990657 shutdown_connections 2023-05-22T01:33:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- 172.21.15.46:0/3246990657 wait complete. 2023-05-22T01:33:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 Processor -- start 2023-05-22T01:33:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- start start 2023-05-22T01:33:32.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43840b4910 0x7f438414ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f438415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43840b8ad0 0x7f438415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438415f580 con 0x7f43840b5ce0 2023-05-22T01:33:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438415e900 con 0x7f43840b8ad0 2023-05-22T01:33:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438a980700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438415ebe0 con 0x7f43840b4910 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f438415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f438415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43552/0 (socket says 172.21.15.46:43552) 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 -- 172.21.15.46:0/1125982229 learned_addr learned my addr 172.21.15.46:0/1125982229 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438997e700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43840b4910 0x7f438414ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 -- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43840b4910 msgr2=0x7f438414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43840b4910 0x7f438414ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 -- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43840b8ad0 msgr2=0x7f438415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43840b8ad0 0x7f438415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 -- 172.21.15.46:0/1125982229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374009570 con 0x7f43840b5ce0 2023-05-22T01:33:32.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.234+0000 7f438917d700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f438415dd90 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f4374009c60 tx=0x7f4374004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374004610 con 0x7f43840b5ce0 2023-05-22T01:33:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437401f070 con 0x7f43840b5ce0 2023-05-22T01:33:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43740038e0 con 0x7f43840b5ce0 2023-05-22T01:33:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43840cda70 con 0x7f43840b5ce0 2023-05-22T01:33:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43840cd790 con 0x7f43840b5ce0 2023-05-22T01:33:32.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4374003a40 con 0x7f43840b5ce0 2023-05-22T01:33:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f437a7fc700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4370066430 0x7f43700688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4368005310 con 0x7f43840b5ce0 2023-05-22T01:33:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.238+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4374021070 con 0x7f43840b5ce0 2023-05-22T01:33:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.242+0000 7f438997e700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4370066430 0x7f43700688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.242+0000 7f438997e700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4370066430 0x7f43700688e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4380000f60 tx=0x7f4380007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:32.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.246+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4374052b20 con 0x7f43840b5ce0 2023-05-22T01:33:32.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.546+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4368005890 con 0x7f43840b5ce0 2023-05-22T01:33:32.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.546+0000 7f437a7fc700 1 -- 172.21.15.46:0/1125982229 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f4374015070 con 0x7f43840b5ce0 2023-05-22T01:33:32.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:32.563 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-21T16:55:21.293141+0000","modified":"2023-05-21T16:55:24.614864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6837/2842509941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":2842509941},{"type":"v1","addr":"172.21.15.46:6837","nonce":2842509941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-22T01:33:32.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4370066430 msgr2=0x7f43700688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4370066430 0x7f43700688e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4380000f60 tx=0x7f4380007ef0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 msgr2=0x7f438415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f438415dd90 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f4374009c60 tx=0x7f4374004770 comp rx=0 tx=0).stop 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 shutdown_connections 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f4370066430 0x7f43700688e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43840b8ad0 0x7f438415e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43840b5ce0 0x7f438415dd90 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 --2- 172.21.15.46:0/1125982229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43840b4910 0x7f438414ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 >> 172.21.15.46:0/1125982229 conn(0x7f43840d3ae0 msgr2=0x7f43840b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 shutdown_connections 2023-05-22T01:33:32.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.550+0000 7f438a980700 1 -- 172.21.15.46:0/1125982229 wait complete. 2023-05-22T01:33:32.566 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 15 2023-05-22T01:33:32.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-22T01:33:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.710+0000 7f95b0d2a700 1 Processor -- start 2023-05-22T01:33:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.710+0000 7f95b0d2a700 1 -- start start 2023-05-22T01:33:32.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95ac15dd40 0x7f95ac0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac15d8b0 con 0x7f95ac0cd170 2023-05-22T01:33:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac1574e0 con 0x7f95ac06c760 2023-05-22T01:33:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac0cdf00 con 0x7f95ac15dd40 2023-05-22T01:33:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95ab7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f95ac06c760 0x7f95ac06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:55330/0 (socket says 172.21.15.46:55330) 2023-05-22T01:33:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95abfff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95ac0cd170 0x7f95ac159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35564/0 (socket says 172.21.15.46:35564) 2023-05-22T01:33:32.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95ab7fe700 1 -- 172.21.15.46:0/892139127 learned_addr learned my addr 172.21.15.46:0/892139127 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:32.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aaffd700 1 --2- 172.21.15.46:0/892139127 >> v2:172.21.15.142:3300/0 conn(0x7f95ac15dd40 0x7f95ac0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192715532 0 0) 0x7f95ac15d8b0 con 0x7f95ac0cd170 2023-05-22T01:33:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95940035d0 con 0x7f95ac0cd170 2023-05-22T01:33:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481859166 0 0) 0x7f95ac1574e0 con 0x7f95ac06c760 2023-05-22T01:33:32.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ac15d8b0 con 0x7f95ac06c760 2023-05-22T01:33:32.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aaffd700 1 -- 172.21.15.46:0/892139127 >> v1:172.21.15.142:6789/0 conn(0x7f95ac06c760 legacy=0x7f95ac06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aaffd700 1 -- 172.21.15.46:0/892139127 >> v1:172.21.15.46:6789/0 conn(0x7f95ac0cd170 legacy=0x7f95ac159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aaffd700 1 -- 172.21.15.46:0/892139127 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0ce1e0 con 0x7f95ac15dd40 2023-05-22T01:33:32.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aaffd700 1 --2- 172.21.15.46:0/892139127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac15dd40 0x7f95ac0cd6b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f959c009850 tx=0x7f959c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb73e08dfb6b671c server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:32.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c011830 con 0x7f95ac15dd40 2023-05-22T01:33:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c011990 con 0x7f95ac15dd40 2023-05-22T01:33:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95aa7fc700 1 -- 172.21.15.46:0/892139127 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c011d00 con 0x7f95ac15dd40 2023-05-22T01:33:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 -- 172.21.15.46:0/892139127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac15dd40 msgr2=0x7f95ac0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/892139127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac15dd40 0x7f95ac0cd6b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f959c009850 tx=0x7f959c009b60 comp rx=0 tx=0).stop 2023-05-22T01:33:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 -- 172.21.15.46:0/892139127 shutdown_connections 2023-05-22T01:33:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/892139127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac15dd40 0x7f95ac0cd6b0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.714+0000 7f95b0d2a700 1 -- 172.21.15.46:0/892139127 >> 172.21.15.46:0/892139127 conn(0x7f95ac0cf720 msgr2=0x7f95ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.722+0000 7f95b0d2a700 1 -- 172.21.15.46:0/892139127 shutdown_connections 2023-05-22T01:33:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.730+0000 7f95b0d2a700 1 -- 172.21.15.46:0/892139127 wait complete. 2023-05-22T01:33:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.730+0000 7f95b0d2a700 1 Processor -- start 2023-05-22T01:33:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.730+0000 7f95b0d2a700 1 -- start start 2023-05-22T01:33:32.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.730+0000 7f95b0d2a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac06c760 0x7f95ac0b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95ac0cd170 0x7f95ac0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 0x7f95ac0c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac0c39b0 con 0x7f95ac15dd40 2023-05-22T01:33:32.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac0b2d50 con 0x7f95ac06c760 2023-05-22T01:33:32.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac0c26b0 con 0x7f95ac0cd170 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 0x7f95ac0c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac06c760 0x7f95ac0b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95aaffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95ac0cd170 0x7f95ac0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 0x7f95ac0c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43568/0 (socket says 172.21.15.46:43568) 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac06c760 0x7f95ac0b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39318/0 (socket says 172.21.15.46:39318) 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95aaffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95ac0cd170 0x7f95ac0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37678/0 (socket says 172.21.15.46:37678) 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 -- 172.21.15.46:0/4125651436 learned_addr learned my addr 172.21.15.46:0/4125651436 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:32.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 -- 172.21.15.46:0/4125651436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95ac0cd170 msgr2=0x7f95ac0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95ac0cd170 0x7f95ac0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 -- 172.21.15.46:0/4125651436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac06c760 msgr2=0x7f95ac0b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac06c760 0x7f95ac0b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 -- 172.21.15.46:0/4125651436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0094b0 con 0x7f95ac15dd40 2023-05-22T01:33:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95abfff700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 0x7f95ac0c3470 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f95a4002230 tx=0x7f95a400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a400aaa0 con 0x7f95ac15dd40 2023-05-22T01:33:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a400ac20 con 0x7f95ac15dd40 2023-05-22T01:33:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac15d540 con 0x7f95ac15dd40 2023-05-22T01:33:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4007070 con 0x7f95ac15dd40 2023-05-22T01:33:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.734+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac15d260 con 0x7f95ac15dd40 2023-05-22T01:33:32.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.738+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95a40071d0 con 0x7f95ac15dd40 2023-05-22T01:33:32.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.738+0000 7f9593fff700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9598066320 0x7f95980687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.738+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f95a4083a10 con 0x7f95ac15dd40 2023-05-22T01:33:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.738+0000 7f95ab7fe700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9598066320 0x7f95980687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.738+0000 7f95ab7fe700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9598066320 0x7f95980687d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f95a0005930 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:32.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.738+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac0cdbf0 con 0x7f95ac15dd40 2023-05-22T01:33:32.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.746+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f95a4050f00 con 0x7f95ac15dd40 2023-05-22T01:33:33.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.990+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95ac0733b0 con 0x7f95ac15dd40 2023-05-22T01:33:33.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.990+0000 7f9593fff700 1 -- 172.21.15.46:0/4125651436 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18344 (secure 0 0 0) 0x7f95a4054520 con 0x7f95ac15dd40 2023-05-22T01:33:33.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:33:33.010 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-21T16:56:01.633427+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-21T16:55:19.482721+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-21T16:55:20.275924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-22T01:33:33.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9598066320 msgr2=0x7f95980687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:33.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9598066320 0x7f95980687d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f95a0005930 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2023-05-22T01:33:33.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 msgr2=0x7f95ac0c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:33.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 0x7f95ac0c3470 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f95a4002230 tx=0x7f95a400cf00 comp rx=0 tx=0).stop 2023-05-22T01:33:33.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 shutdown_connections 2023-05-22T01:33:33.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9598066320 0x7f95980687d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac15dd40 0x7f95ac0c3470 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95ac0cd170 0x7f95ac0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 --2- 172.21.15.46:0/4125651436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95ac06c760 0x7f95ac0b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 >> 172.21.15.46:0/4125651436 conn(0x7f95ac0cf720 msgr2=0x7f95ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:33.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 shutdown_connections 2023-05-22T01:33:33.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:32.998+0000 7f95b0d2a700 1 -- 172.21.15.46:0/4125651436 wait complete. 2023-05-22T01:33:33.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-22T01:33:33.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 Processor -- start 2023-05-22T01:33:33.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- start start 2023-05-22T01:33:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b38c0 0x7f9c5806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9c5806d250 0x7f9c58070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c580b3c90 con 0x7f9c580b1b10 2023-05-22T01:33:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5815ac70 con 0x7f9c5806d250 2023-05-22T01:33:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b4560 con 0x7f9c580b38c0 2023-05-22T01:33:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c57fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9c5806d250 0x7f9c58070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c56ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9c580b1b10 0x7f9c5806cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35578/0 (socket says 172.21.15.46:35578) 2023-05-22T01:33:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c56ffd700 1 -- 172.21.15.46:0/3746498350 learned_addr learned my addr 172.21.15.46:0/3746498350 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c577fe700 1 --2- 172.21.15.46:0/3746498350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b38c0 0x7f9c5806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c57fff700 1 -- 172.21.15.46:0/3746498350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b38c0 msgr2=0x7f9c5806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c57fff700 1 --2- 172.21.15.46:0/3746498350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b38c0 0x7f9c5806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c57fff700 1 -- 172.21.15.46:0/3746498350 >> v1:172.21.15.46:6789/0 conn(0x7f9c580b1b10 legacy=0x7f9c5806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:33.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c57fff700 1 -- 172.21.15.46:0/3746498350 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580b4840 con 0x7f9c5806d250 2023-05-22T01:33:33.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c57fff700 1 --2- 172.21.15.46:0/3746498350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 0x7f9c58070ec0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009850 tx=0x7f9c4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42be11428dfa57e server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:33.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c567fc700 1 -- 172.21.15.46:0/3746498350 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011830 con 0x7f9c5806d250 2023-05-22T01:33:33.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c567fc700 1 -- 172.21.15.46:0/3746498350 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c011990 con 0x7f9c5806d250 2023-05-22T01:33:33.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c567fc700 1 -- 172.21.15.46:0/3746498350 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011d20 con 0x7f9c5806d250 2023-05-22T01:33:33.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- 172.21.15.46:0/3746498350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 msgr2=0x7f9c58070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:33.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/3746498350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 0x7f9c58070ec0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009850 tx=0x7f9c4c009b60 comp rx=0 tx=0).stop 2023-05-22T01:33:33.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- 172.21.15.46:0/3746498350 shutdown_connections 2023-05-22T01:33:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/3746498350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 0x7f9c58070ec0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/3746498350 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b38c0 0x7f9c5806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.190+0000 7f9c5e24c700 1 -- 172.21.15.46:0/3746498350 >> 172.21.15.46:0/3746498350 conn(0x7f9c580cf030 msgr2=0x7f9c580cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 -- 172.21.15.46:0/3746498350 shutdown_connections 2023-05-22T01:33:33.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 -- 172.21.15.46:0/3746498350 wait complete. 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 Processor -- start 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 -- start start 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 0x7f9c581501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 0x7f9c580c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 0x7f9c580ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580c5c80 con 0x7f9c5806d250 2023-05-22T01:33:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58150730 con 0x7f9c580b38c0 2023-05-22T01:33:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c5e24c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580c9b00 con 0x7f9c580b1b10 2023-05-22T01:33:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c56ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 0x7f9c580c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c57fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 0x7f9c580ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:33.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c57fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 0x7f9c580ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:39330/0 (socket says 172.21.15.46:39330) 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c57fff700 1 -- 172.21.15.46:0/593641479 learned_addr learned my addr 172.21.15.46:0/593641479 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.194+0000 7f9c56ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 0x7f9c580c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:37708/0 (socket says 172.21.15.46:37708) 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c56ffd700 1 -- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 msgr2=0x7f9c580ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c56ffd700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 0x7f9c580ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c56ffd700 1 -- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 msgr2=0x7f9c581501f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c56ffd700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 0x7f9c581501f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:33.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c56ffd700 1 -- 172.21.15.46:0/593641479 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0094b0 con 0x7f9c580b1b10 2023-05-22T01:33:33.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c57fff700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 0x7f9c580ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:33.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.198+0000 7f9c56ffd700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 0x7f9c580c9200 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c48001c30 tx=0x7f9c4800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.202+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800ada0 con 0x7f9c580b1b10 2023-05-22T01:33:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.202+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48005960 con 0x7f9c580b1b10 2023-05-22T01:33:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.202+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48005cf0 con 0x7f9c580b1b10 2023-05-22T01:33:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.206+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c580706c0 con 0x7f9c580b1b10 2023-05-22T01:33:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.206+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c580b4b20 con 0x7f9c580b1b10 2023-05-22T01:33:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.206+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c580709a0 con 0x7f9c580b1b10 2023-05-22T01:33:33.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.214+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c480138e0 con 0x7f9c580b1b10 2023-05-22T01:33:33.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.214+0000 7f9c3ffff700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9c44066340 0x7f9c440687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:33.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.214+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9c4808c160 con 0x7f9c580b1b10 2023-05-22T01:33:33.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.218+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9c48059730 con 0x7f9c580b1b10 2023-05-22T01:33:33.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.226+0000 7f9c577fe700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9c44066340 0x7f9c440687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:33.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.226+0000 7f9c577fe700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9c44066340 0x7f9c440687f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9c58159570 tx=0x7f9c50009790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:33.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:33.534+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9c58073ae0 con 0x7f9c580b1b10 2023-05-22T01:33:33.571 INFO:tasks.ceph.mds.c.smithi046.stderr:2023-05-22T01:33:33.558+0000 7f9d7fa96700 -1 mds.0.11 we have been blocklisted (fenced), respawning... 2023-05-22T01:33:33.587 INFO:tasks.ceph.mds.c.smithi046.stderr: -1> 2023-05-22T01:33:33.558+0000 7f9d7fa96700 -1 mds.0.11 we have been blocklisted (fenced), respawning... 2023-05-22T01:33:33.966 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2023-05-22T01:33:34.514 INFO:tasks.ceph.mon.a.smithi046.stderr:2023-05-22T01:33:34.462+0000 7f08d3fe6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-22T01:33:34.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.486+0000 7f9c3ffff700 1 -- 172.21.15.46:0/593641479 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9c4805cd50 con 0x7f9c580b1b10 2023-05-22T01:33:34.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9c44066340 msgr2=0x7f9c440687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:34.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9c44066340 0x7f9c440687f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9c58159570 tx=0x7f9c50009790 comp rx=0 tx=0).stop 2023-05-22T01:33:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 msgr2=0x7f9c580c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 0x7f9c580c9200 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c48001c30 tx=0x7f9c4800a340 comp rx=0 tx=0).stop 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 shutdown_connections 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9c44066340 0x7f9c440687f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c580b38c0 0x7f9c580ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c580b1b10 0x7f9c580c9200 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 --2- 172.21.15.46:0/593641479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c5806d250 0x7f9c581501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 >> 172.21.15.46:0/593641479 conn(0x7f9c580cf030 msgr2=0x7f9c580b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 shutdown_connections 2023-05-22T01:33:34.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.490+0000 7f9c5e24c700 1 -- 172.21.15.46:0/593641479 wait complete. 2023-05-22T01:33:34.527 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-22T01:33:34.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-22T01:33:34.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 Processor -- start 2023-05-22T01:33:34.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 -- start start 2023-05-22T01:33:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa37c160f30 0x7fa37c0aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa37c0cb110 0x7fa37c0ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:34.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0ce2a0 con 0x7fa37c1649f0 2023-05-22T01:33:34.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c161300 con 0x7fa37c0cb110 2023-05-22T01:33:34.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37b59e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c164ef0 con 0x7fa37c160f30 2023-05-22T01:33:34.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa37c0cb110 0x7fa37c0ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:34.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37ad9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa37c0cb110 0x7fa37c0ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52550/0 (socket says 172.21.15.46:52550) 2023-05-22T01:33:34.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.914+0000 7fa37ad9d700 1 -- 172.21.15.46:0/3061092853 learned_addr learned my addr 172.21.15.46:0/3061092853 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:34.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37a59c700 1 --2- 172.21.15.46:0/3061092853 >> v2:172.21.15.142:3300/0 conn(0x7fa37c160f30 0x7fa37c0aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:34.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37ad9d700 1 -- 172.21.15.46:0/3061092853 >> v2:172.21.15.142:3300/0 conn(0x7fa37c160f30 msgr2=0x7fa37c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37ad9d700 1 --2- 172.21.15.46:0/3061092853 >> v2:172.21.15.142:3300/0 conn(0x7fa37c160f30 0x7fa37c0aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37ad9d700 1 -- 172.21.15.46:0/3061092853 >> v1:172.21.15.142:6789/0 conn(0x7fa37c1649f0 legacy=0x7fa37c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37ad9d700 1 -- 172.21.15.46:0/3061092853 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c1651d0 con 0x7fa37c0cb110 2023-05-22T01:33:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37ad9d700 1 --2- 172.21.15.46:0/3061092853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cb110 0x7fa37c0ce730 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fa37c071580 tx=0x7fa37400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c30c7b45c68d30 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37959a700 1 -- 172.21.15.46:0/3061092853 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400e070 con 0x7fa37c0cb110 2023-05-22T01:33:34.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37959a700 1 -- 172.21.15.46:0/3061092853 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400b9c0 con 0x7fa37c0cb110 2023-05-22T01:33:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37959a700 1 -- 172.21.15.46:0/3061092853 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400bd70 con 0x7fa37c0cb110 2023-05-22T01:33:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 -- 172.21.15.46:0/3061092853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cb110 msgr2=0x7fa37c0ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 --2- 172.21.15.46:0/3061092853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cb110 0x7fa37c0ce730 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fa37c071580 tx=0x7fa37400b330 comp rx=0 tx=0).stop 2023-05-22T01:33:34.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 -- 172.21.15.46:0/3061092853 shutdown_connections 2023-05-22T01:33:34.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 --2- 172.21.15.46:0/3061092853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c0cb110 0x7fa37c0ce730 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 --2- 172.21.15.46:0/3061092853 >> v2:172.21.15.142:3300/0 conn(0x7fa37c160f30 0x7fa37c0aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 -- 172.21.15.46:0/3061092853 >> 172.21.15.46:0/3061092853 conn(0x7fa37c06d930 msgr2=0x7fa37c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:34.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 -- 172.21.15.46:0/3061092853 shutdown_connections 2023-05-22T01:33:34.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 -- 172.21.15.46:0/3061092853 wait complete. 2023-05-22T01:33:34.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 Processor -- start 2023-05-22T01:33:34.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.918+0000 7fa37b59e700 1 -- start start 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cb110 0x7fa37c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c160f30 0x7fa37c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 0x7fa37c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0b4a20 con 0x7fa37c1649f0 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0c7230 con 0x7fa37c160f30 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0c7510 con 0x7fa37c0cb110 2023-05-22T01:33:34.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 0x7fa37c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:34.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 0x7fa37c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52558/0 (socket says 172.21.15.46:52558) 2023-05-22T01:33:34.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 -- 172.21.15.46:0/2514147654 learned_addr learned my addr 172.21.15.46:0/2514147654 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa379d9b700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c160f30 0x7fa37c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37a59c700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cb110 0x7fa37c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 -- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cb110 msgr2=0x7fa37c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cb110 0x7fa37c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 -- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c160f30 msgr2=0x7fa37c0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c160f30 0x7fa37c0c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:34.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 -- 172.21.15.46:0/2514147654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa374009b30 con 0x7fa37c1649f0 2023-05-22T01:33:34.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37ad9d700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 0x7fa37c0b44e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fa374012000 tx=0x7fa374004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:34.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374004880 con 0x7fa37c1649f0 2023-05-22T01:33:34.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3740099b0 con 0x7fa37c1649f0 2023-05-22T01:33:34.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c165790 con 0x7fa37c1649f0 2023-05-22T01:33:34.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37401c680 con 0x7fa37c1649f0 2023-05-22T01:33:34.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.922+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c1654b0 con 0x7fa37c1649f0 2023-05-22T01:33:34.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.926+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c06ad60 con 0x7fa37c1649f0 2023-05-22T01:33:34.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.926+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa37401c7e0 con 0x7fa37c1649f0 2023-05-22T01:33:34.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.926+0000 7fa36affd700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa35c0662f0 0x7fa35c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:34.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.926+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa3740856d0 con 0x7fa37c1649f0 2023-05-22T01:33:34.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.926+0000 7fa37a59c700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa35c0662f0 0x7fa35c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:34.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.926+0000 7fa37a59c700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa35c0662f0 0x7fa35c0687a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa37c163930 tx=0x7fa36c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:34.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:34.934+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa374052a40 con 0x7fa37c1649f0 2023-05-22T01:33:35.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.134+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa37c0b5820 con 0x7fa37c1649f0 2023-05-22T01:33:35.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.550+0000 7fa36affd700 1 -- 172.21.15.46:0/2514147654 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa374056060 con 0x7fa37c1649f0 2023-05-22T01:33:35.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa35c0662f0 msgr2=0x7fa35c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:35.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa35c0662f0 0x7fa35c0687a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa37c163930 tx=0x7fa36c008040 comp rx=0 tx=0).stop 2023-05-22T01:33:35.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 msgr2=0x7fa37c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:35.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 0x7fa37c0b44e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fa374012000 tx=0x7fa374004af0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 shutdown_connections 2023-05-22T01:33:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa35c0662f0 0x7fa35c0687a0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa37c1649f0 0x7fa37c0b44e0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa37c160f30 0x7fa37c0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 --2- 172.21.15.46:0/2514147654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa37c0cb110 0x7fa37c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 >> 172.21.15.46:0/2514147654 conn(0x7fa37c06d930 msgr2=0x7fa37c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 shutdown_connections 2023-05-22T01:33:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.554+0000 7fa37b59e700 1 -- 172.21.15.46:0/2514147654 wait complete. 2023-05-22T01:33:35.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-22T01:33:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.738+0000 7f525ffff700 1 Processor -- start 2023-05-22T01:33:35.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.738+0000 7f525ffff700 1 -- start start 2023-05-22T01:33:35.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5260142c60 0x7f52600ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:35.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526006eac0 0x7f52600c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:35.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52600cac10 con 0x7f52600cd800 2023-05-22T01:33:35.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600cdff0 con 0x7f5260142c60 2023-05-22T01:33:35.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600ce200 con 0x7f526006eac0 2023-05-22T01:33:35.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526006eac0 0x7f52600c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:35.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5260142c60 0x7f52600ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:35.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5260142c60 0x7f52600ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:48642/0 (socket says 172.21.15.46:48642) 2023-05-22T01:33:35.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 -- 172.21.15.46:0/3796468076 learned_addr learned my addr 172.21.15.46:0/3796468076 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:35.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 -- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526006eac0 msgr2=0x7f52600c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:35.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 --2- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526006eac0 0x7f52600c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 -- 172.21.15.46:0/3796468076 >> v1:172.21.15.142:6789/0 conn(0x7f52600cd800 legacy=0x7f526006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:35.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 -- 172.21.15.46:0/3796468076 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600ce4e0 con 0x7f5260142c60 2023-05-22T01:33:35.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525effd700 1 --2- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f52600ca6d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f525000b9c0 tx=0x7f525000bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3f22ad2d025386 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525dffb700 1 -- 172.21.15.46:0/3796468076 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000cc60 con 0x7f5260142c60 2023-05-22T01:33:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525dffb700 1 -- 172.21.15.46:0/3796468076 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000cdc0 con 0x7f5260142c60 2023-05-22T01:33:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525dffb700 1 -- 172.21.15.46:0/3796468076 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000f680 con 0x7f5260142c60 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 msgr2=0x7f52600ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 --2- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f52600ca6d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f525000b9c0 tx=0x7f525000bcd0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- 172.21.15.46:0/3796468076 shutdown_connections 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 --2- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f526006eac0 0x7f52600c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 --2- 172.21.15.46:0/3796468076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f52600ca6d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- 172.21.15.46:0/3796468076 >> 172.21.15.46:0/3796468076 conn(0x7f52600cfeb0 msgr2=0x7f52600cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.742+0000 7f525ffff700 1 -- 172.21.15.46:0/3796468076 shutdown_connections 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.746+0000 7f525ffff700 1 -- 172.21.15.46:0/3796468076 wait complete. 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.746+0000 7f525ffff700 1 Processor -- start 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.746+0000 7f525ffff700 1 -- start start 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.746+0000 7f525ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 0x7f52601ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600cd800 0x7f52600c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f526014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600c8b20 con 0x7f526006eac0 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52601ed820 con 0x7f5260142c60 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600c70e0 con 0x7f52600cd800 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 0x7f52601ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 0x7f52601ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52564/0 (socket says 172.21.15.46:52564) 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 -- 172.21.15.46:0/3226211781 learned_addr learned my addr 172.21.15.46:0/3226211781 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525e7fc700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600cd800 0x7f52600c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:35.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525f7fe700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f526014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 -- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600cd800 msgr2=0x7f52600c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600cd800 0x7f52600c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 -- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 msgr2=0x7f526014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:35.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f526014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:35.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 -- 172.21.15.46:0/3226211781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525000b620 con 0x7f526006eac0 2023-05-22T01:33:35.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525f7fe700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f526014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:33:35.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525effd700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 0x7f52601ed2e0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f5260072260 tx=0x7f5250004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:35.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525001b040 con 0x7f526006eac0 2023-05-22T01:33:35.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000fa50 con 0x7f526006eac0 2023-05-22T01:33:35.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52600c4160 con 0x7f526006eac0 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000fe00 con 0x7f526006eac0 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52600ce7c0 con 0x7f526006eac0 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.750+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52500036c0 con 0x7f526006eac0 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.754+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52600ceaa0 con 0x7f526006eac0 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.754+0000 7f5247fff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f524c0662f0 0x7f524c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.754+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5250085ef0 con 0x7f526006eac0 2023-05-22T01:33:35.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.754+0000 7f525e7fc700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f524c0662f0 0x7f524c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:35.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.754+0000 7f525e7fc700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f524c0662f0 0x7f524c0687a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f526014eac0 tx=0x7f5254009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:35.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.762+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5250053400 con 0x7f526006eac0 2023-05-22T01:33:35.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:35.926+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5260073cb0 con 0x7f526006eac0 2023-05-22T01:33:36.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.562+0000 7f5247fff700 1 -- 172.21.15.46:0/3226211781 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5250056a20 con 0x7f526006eac0 2023-05-22T01:33:36.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.562+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f524c0662f0 msgr2=0x7f524c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.562+0000 7f525ffff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f524c0662f0 0x7f524c0687a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f526014eac0 tx=0x7f5254009040 comp rx=0 tx=0).stop 2023-05-22T01:33:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 msgr2=0x7f52601ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 0x7f52601ed2e0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f5260072260 tx=0x7f5250004770 comp rx=0 tx=0).stop 2023-05-22T01:33:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 shutdown_connections 2023-05-22T01:33:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f524c0662f0 0x7f524c0687a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5260142c60 0x7f526014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52600cd800 0x7f52600c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 --2- 172.21.15.46:0/3226211781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f526006eac0 0x7f52601ed2e0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 >> 172.21.15.46:0/3226211781 conn(0x7f52600cfeb0 msgr2=0x7f5260070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:36.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 shutdown_connections 2023-05-22T01:33:36.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.566+0000 7f525ffff700 1 -- 172.21.15.46:0/3226211781 wait complete. 2023-05-22T01:33:36.582 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-05-22T01:33:36.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-22T01:33:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.726+0000 7f5160f85700 1 Processor -- start 2023-05-22T01:33:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.726+0000 7f5160f85700 1 -- start start 2023-05-22T01:33:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 0x7f515c0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c145c10 con 0x7f515c0715e0 2023-05-22T01:33:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c160240 con 0x7f515c145380 2023-05-22T01:33:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c161000 con 0x7f515c145750 2023-05-22T01:33:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515affd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f515c0715e0 0x7f515c0c45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38428/0 (socket says 172.21.15.46:38428) 2023-05-22T01:33:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515affd700 1 -- 172.21.15.46:0/576594660 learned_addr learned my addr 172.21.15.46:0/576594660 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 0x7f515c0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178336927 0 0) 0x7f515c145c10 con 0x7f515c0715e0 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51440035d0 con 0x7f515c0715e0 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3772380041 0 0) 0x7f51440035d0 con 0x7f515c0715e0 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 msgr2=0x7f515c0c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 0x7f515c0c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 >> v1:172.21.15.142:6789/0 conn(0x7f515c145380 legacy=0x7f515c070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c160520 con 0x7f515c0715e0 2023-05-22T01:33:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f5150001670 con 0x7f515c0715e0 2023-05-22T01:33:36.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 >> v1:172.21.15.46:6789/0 conn(0x7f515c0715e0 legacy=0x7f515c0c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 0x7f5144003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5144004040 0x7f5144004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f5144005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c161000 con 0x7f5144004db0 2023-05-22T01:33:36.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514400bbc0 con 0x7f5144004040 2023-05-22T01:33:36.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514400bd80 con 0x7f515c145750 2023-05-22T01:33:36.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f5144005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515affd700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5144004040 0x7f5144004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 -- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 msgr2=0x7f5144003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:36.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c145750 0x7f5144003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 -- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5144004040 msgr2=0x7f5144004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:36.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5144004040 0x7f5144004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 -- 172.21.15.46:0/576594660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440035d0 con 0x7f5144004db0 2023-05-22T01:33:36.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f5144005220 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f5154007360 tx=0x7f51440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90354552f20ec2f server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:36.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154007e80 con 0x7f5144004db0 2023-05-22T01:33:36.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154003a40 con 0x7f5144004db0 2023-05-22T01:33:36.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515a7fc700 1 -- 172.21.15.46:0/576594660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154003df0 con 0x7f5144004db0 2023-05-22T01:33:36.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- 172.21.15.46:0/576594660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 msgr2=0x7f5144005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 --2- 172.21.15.46:0/576594660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f5144005220 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f5154007360 tx=0x7f51440058a0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f515bfff700 1 -- 172.21.15.46:0/576594660 reap_dead start 2023-05-22T01:33:36.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- 172.21.15.46:0/576594660 shutdown_connections 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- 172.21.15.46:0/576594660 >> 172.21.15.46:0/576594660 conn(0x7f515c0cfeb0 msgr2=0x7f515c0cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- 172.21.15.46:0/576594660 shutdown_connections 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.730+0000 7f5160f85700 1 -- 172.21.15.46:0/576594660 wait complete. 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 Processor -- start 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 -- start start 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f515c13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c1435c0 0x7f515c0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f515c142970 0x7f515c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c143350 con 0x7f5144004db0 2023-05-22T01:33:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1f6270 con 0x7f515c142970 2023-05-22T01:33:36.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.734+0000 7f5160f85700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1f2180 con 0x7f515c1435c0 2023-05-22T01:33:36.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f515c13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f515c142970 0x7f515c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f515c13e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52580/0 (socket says 172.21.15.46:52580) 2023-05-22T01:33:36.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 -- 172.21.15.46:0/96180947 learned_addr learned my addr 172.21.15.46:0/96180947 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:36.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515affd700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c1435c0 0x7f515c0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 -- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c1435c0 msgr2=0x7f515c0c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c1435c0 0x7f515c0c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 -- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f515c142970 msgr2=0x7f515c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f515c142970 0x7f515c142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 -- 172.21.15.46:0/96180947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c160ae0 con 0x7f5144004db0 2023-05-22T01:33:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f515b7fe700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f515c13e590 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c750 tx=0x7f514c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0054e0 con 0x7f5144004db0 2023-05-22T01:33:36.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c0036a0 con 0x7f5144004db0 2023-05-22T01:33:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c160800 con 0x7f5144004db0 2023-05-22T01:33:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c003a10 con 0x7f5144004db0 2023-05-22T01:33:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c0c40c0 con 0x7f5144004db0 2023-05-22T01:33:36.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c073cb0 con 0x7f5144004db0 2023-05-22T01:33:36.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.738+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f514c003b70 con 0x7f5144004db0 2023-05-22T01:33:36.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.742+0000 7f5143fff700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5148066320 0x7f51480687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:36.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.742+0000 7f515affd700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5148066320 0x7f51480687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.742+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f514c082fb0 con 0x7f5144004db0 2023-05-22T01:33:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.742+0000 7f515affd700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5148066320 0x7f51480687d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f515c0b0a70 tx=0x7f5150000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.746+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f514c0b36f0 con 0x7f5144004db0 2023-05-22T01:33:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:36.910+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f515c0cd020 con 0x7f5144004db0 2023-05-22T01:33:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.578+0000 7f5143fff700 1 -- 172.21.15.46:0/96180947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f514c0170d0 con 0x7f5144004db0 2023-05-22T01:33:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5148066320 msgr2=0x7f51480687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:37.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5148066320 0x7f51480687d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f515c0b0a70 tx=0x7f5150000f80 comp rx=0 tx=0).stop 2023-05-22T01:33:37.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 msgr2=0x7f515c13e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:37.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f515c13e590 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c750 tx=0x7f514c00ca60 comp rx=0 tx=0).stop 2023-05-22T01:33:37.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 shutdown_connections 2023-05-22T01:33:37.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f5148066320 0x7f51480687d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f515c142970 0x7f515c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f515c1435c0 0x7f515c0c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 --2- 172.21.15.46:0/96180947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5144004db0 0x7f515c13e590 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 >> 172.21.15.46:0/96180947 conn(0x7f515c0cfeb0 msgr2=0x7f515c0c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:37.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 shutdown_connections 2023-05-22T01:33:37.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.586+0000 7f5160f85700 1 -- 172.21.15.46:0/96180947 wait complete. 2023-05-22T01:33:37.602 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-05-22T01:33:37.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-05-22T01:33:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 Processor -- start 2023-05-22T01:33:37.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 -- start start 2023-05-22T01:33:37.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 0x7f20fc069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:37.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20fc06a4c0 0x7f20fc0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc06d3e0 con 0x7f20fc0cda20 2023-05-22T01:33:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0ce560 con 0x7f20fc158b60 2023-05-22T01:33:37.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2104232700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc158f30 con 0x7f20fc06a4c0 2023-05-22T01:33:37.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2101fce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 0x7f20fc069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:37.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21027cf700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f20fc0cda20 0x7f20fc06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38442/0 (socket says 172.21.15.46:38442) 2023-05-22T01:33:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2101fce700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 0x7f20fc069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52588/0 (socket says 172.21.15.46:52588) 2023-05-22T01:33:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21027cf700 1 -- 172.21.15.46:0/968652300 learned_addr learned my addr 172.21.15.46:0/968652300 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21017cd700 1 --2- 172.21.15.46:0/968652300 >> v2:172.21.15.142:3300/0 conn(0x7f20fc06a4c0 0x7f20fc0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21017cd700 1 -- 172.21.15.46:0/968652300 >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 msgr2=0x7f20fc069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:33:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21017cd700 1 --2- 172.21.15.46:0/968652300 >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 0x7f20fc069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21017cd700 1 -- 172.21.15.46:0/968652300 >> v1:172.21.15.46:6789/0 conn(0x7f20fc0cda20 legacy=0x7f20fc06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21017cd700 1 -- 172.21.15.46:0/968652300 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc06cdd0 con 0x7f20fc06a4c0 2023-05-22T01:33:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2101fce700 1 --2- 172.21.15.46:0/968652300 >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 0x7f20fc069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f21017cd700 1 --2- 172.21.15.46:0/968652300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc0cd4e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0cd430 tx=0x7f20f8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290903b3798099c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2100fcc700 1 -- 172.21.15.46:0/968652300 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8004230 con 0x7f20fc06a4c0 2023-05-22T01:33:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.886+0000 7f2100fcc700 1 -- 172.21.15.46:0/968652300 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f8004390 con 0x7f20fc06a4c0 2023-05-22T01:33:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.890+0000 7f2104232700 1 -- 172.21.15.46:0/968652300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 msgr2=0x7f20fc0cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.890+0000 7f2104232700 1 --2- 172.21.15.46:0/968652300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc0cd4e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0cd430 tx=0x7f20f8009b30 comp rx=0 tx=0).stop 2023-05-22T01:33:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.894+0000 7f2104232700 1 -- 172.21.15.46:0/968652300 shutdown_connections 2023-05-22T01:33:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.894+0000 7f2104232700 1 --2- 172.21.15.46:0/968652300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc0cd4e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.894+0000 7f2104232700 1 --2- 172.21.15.46:0/968652300 >> v2:172.21.15.46:3300/0 conn(0x7f20fc158b60 0x7f20fc069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.894+0000 7f2104232700 1 -- 172.21.15.46:0/968652300 >> 172.21.15.46:0/968652300 conn(0x7f20fc0cc1a0 msgr2=0x7f20fc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.894+0000 7f2104232700 1 -- 172.21.15.46:0/968652300 shutdown_connections 2023-05-22T01:33:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.894+0000 7f2104232700 1 -- 172.21.15.46:0/968652300 wait complete. 2023-05-22T01:33:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 Processor -- start 2023-05-22T01:33:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 -- start start 2023-05-22T01:33:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:37.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 0x7f20fc15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:37.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20fc158b60 0x7f20fc14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc14d240 con 0x7f20fc0cda20 2023-05-22T01:33:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c76b0 con 0x7f20fc06a4c0 2023-05-22T01:33:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2104232700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c7990 con 0x7f20fc158b60 2023-05-22T01:33:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 0x7f20fc15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 0x7f20fc15c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52590/0 (socket says 172.21.15.46:52590) 2023-05-22T01:33:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 -- 172.21.15.46:0/1509311748 learned_addr learned my addr 172.21.15.46:0/1509311748 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2101fce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:37.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 -- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20fc158b60 msgr2=0x7f20fc14dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20fc158b60 0x7f20fc14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 -- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 msgr2=0x7f20fc15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 -- 172.21.15.46:0/1509311748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009a70 con 0x7f20fc0cda20 2023-05-22T01:33:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f2101fce700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:33:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.898+0000 7f21017cd700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 0x7f20fc15c7b0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f20f80090b0 tx=0x7f20f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011a40 con 0x7f20fc0cda20 2023-05-22T01:33:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f2104232700 1 -- 172.21.15.46:0/1509311748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f80094b0 con 0x7f20fc0cda20 2023-05-22T01:33:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f2104232700 1 -- 172.21.15.46:0/1509311748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc0ce280 con 0x7f20fc0cda20 2023-05-22T01:33:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f801f070 con 0x7f20fc0cda20 2023-05-22T01:33:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011de0 con 0x7f20fc0cda20 2023-05-22T01:33:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20f8026480 con 0x7f20fc0cda20 2023-05-22T01:33:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f20f27fc700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f20e0066340 0x7f20e00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f2101fce700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f20e0066340 0x7f20e00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f2101fce700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f20e0066340 0x7f20e00687f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009fd0 tx=0x7f20f400d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.910+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f20f8021070 con 0x7f20fc0cda20 2023-05-22T01:33:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.926+0000 7f2104232700 1 -- 172.21.15.46:0/1509311748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4005310 con 0x7f20fc0cda20 2023-05-22T01:33:37.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:37.934+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f20f8052c60 con 0x7f20fc0cda20 2023-05-22T01:33:39.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.066+0000 7f2104232700 1 -- 172.21.15.46:0/1509311748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f20e4005b40 con 0x7f20fc0cda20 2023-05-22T01:33:39.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.074+0000 7f20f27fc700 1 -- 172.21.15.46:0/1509311748 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f20f8056240 con 0x7f20fc0cda20 2023-05-22T01:33:39.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.110+0000 7f20dffff700 1 -- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f20e0066340 msgr2=0x7f20e00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:39.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.110+0000 7f20dffff700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f20e0066340 0x7f20e00687f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009fd0 tx=0x7f20f400d040 comp rx=0 tx=0).stop 2023-05-22T01:33:39.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 -- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 msgr2=0x7f20fc15c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 0x7f20fc15c7b0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f20f80090b0 tx=0x7f20f8004770 comp rx=0 tx=0).stop 2023-05-22T01:33:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 -- 172.21.15.46:0/1509311748 shutdown_connections 2023-05-22T01:33:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f20e0066340 0x7f20e00687f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20fc158b60 0x7f20fc14dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0cda20 0x7f20fc15c7b0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 --2- 172.21.15.46:0/1509311748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc06a4c0 0x7f20fc15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 -- 172.21.15.46:0/1509311748 >> 172.21.15.46:0/1509311748 conn(0x7f20fc0cc1a0 msgr2=0x7f20fc0ad640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:39.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 -- 172.21.15.46:0/1509311748 shutdown_connections 2023-05-22T01:33:39.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.118+0000 7f20dffff700 1 -- 172.21.15.46:0/1509311748 wait complete. 2023-05-22T01:33:39.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-22T01:33:39.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 Processor -- start 2023-05-22T01:33:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 -- start start 2023-05-22T01:33:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a0069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1a006d870 0x7fd1a006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:39.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a006d3e0 con 0x7fd1a006a4c0 2023-05-22T01:33:39.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a00ce560 con 0x7fd1a006d870 2023-05-22T01:33:39.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.794+0000 7fd1a4fbe700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0158f30 con 0x7fd1a0158b60 2023-05-22T01:33:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.798+0000 7fd19dd9b700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd1a006a4c0 0x7fd1a00cd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38454/0 (socket says 172.21.15.46:38454) 2023-05-22T01:33:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.798+0000 7fd19dd9b700 1 -- 172.21.15.46:0/2745002626 learned_addr learned my addr 172.21.15.46:0/2745002626 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:33:39.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.798+0000 7fd19e59c700 1 --2- 172.21.15.46:0/2745002626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a0069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.802+0000 7fd19e59c700 1 -- 172.21.15.46:0/2745002626 >> v2:172.21.15.142:3300/0 conn(0x7fd1a006d870 msgr2=0x7fd1a006dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-22T01:33:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.802+0000 7fd19e59c700 1 --2- 172.21.15.46:0/2745002626 >> v2:172.21.15.142:3300/0 conn(0x7fd1a006d870 0x7fd1a006dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.802+0000 7fd19e59c700 1 -- 172.21.15.46:0/2745002626 >> v1:172.21.15.46:6789/0 conn(0x7fd1a006a4c0 legacy=0x7fd1a00cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.802+0000 7fd19e59c700 1 -- 172.21.15.46:0/2745002626 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a006e1f0 con 0x7fd1a0158b60 2023-05-22T01:33:39.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.810+0000 7fd19e59c700 1 --2- 172.21.15.46:0/2745002626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a0069f80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd188007360 tx=0x7fd188007670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb43d4f117d3ddb server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:39.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.818+0000 7fd19d59a700 1 -- 172.21.15.46:0/2745002626 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800f070 con 0x7fd1a0158b60 2023-05-22T01:33:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.818+0000 7fd19d59a700 1 -- 172.21.15.46:0/2745002626 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188008bf0 con 0x7fd1a0158b60 2023-05-22T01:33:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/2745002626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 msgr2=0x7fd1a0069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/2745002626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a0069f80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd188007360 tx=0x7fd188007670 comp rx=0 tx=0).stop 2023-05-22T01:33:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/2745002626 shutdown_connections 2023-05-22T01:33:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/2745002626 >> v2:172.21.15.142:3300/0 conn(0x7fd1a006d870 0x7fd1a006dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/2745002626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a0069f80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/2745002626 >> 172.21.15.46:0/2745002626 conn(0x7fd1a00cc1a0 msgr2=0x7fd1a00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/2745002626 shutdown_connections 2023-05-22T01:33:39.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.822+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/2745002626 wait complete. 2023-05-22T01:33:39.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 Processor -- start 2023-05-22T01:33:39.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 -- start start 2023-05-22T01:33:39.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a006a4c0 0x7fd1a00b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:39.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1a006d870 0x7fd1a00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:39.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd19dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1a006d870 0x7fd1a00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:39.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd19dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1a006d870 0x7fd1a00b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52592/0 (socket says 172.21.15.46:52592) 2023-05-22T01:33:39.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd19e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a006a4c0 0x7fd1a00b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:39.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd19e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a006a4c0 0x7fd1a00b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:48714/0 (socket says 172.21.15.46:48714) 2023-05-22T01:33:39.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:39.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a00c4cb0 con 0x7fd1a006d870 2023-05-22T01:33:39.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a00b1c50 con 0x7fd1a006a4c0 2023-05-22T01:33:39.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd1a4fbe700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a00b3930 con 0x7fd1a0158b60 2023-05-22T01:33:39.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd19e59c700 1 -- 172.21.15.46:0/3039757919 learned_addr learned my addr 172.21.15.46:0/3039757919 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:33:39.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.826+0000 7fd19ed9d700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:39.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.830+0000 7fd19ed9d700 1 -- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a006a4c0 msgr2=0x7fd1a00b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:39.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.830+0000 7fd19ed9d700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a006a4c0 0x7fd1a00b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.830+0000 7fd19ed9d700 1 -- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1a006d870 msgr2=0x7fd1a00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:39.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.830+0000 7fd19ed9d700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1a006d870 0x7fd1a00b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:39.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.830+0000 7fd19ed9d700 1 -- 172.21.15.46:0/3039757919 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188007040 con 0x7fd1a0158b60 2023-05-22T01:33:39.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.830+0000 7fd19ed9d700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a006e5f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd19800be20 tx=0x7fd198009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.846+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800cbb0 con 0x7fd1a0158b60 2023-05-22T01:33:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.846+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19800cd50 con 0x7fd1a0158b60 2023-05-22T01:33:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.846+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a00cdfa0 con 0x7fd1a0158b60 2023-05-22T01:33:39.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.846+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198014680 con 0x7fd1a0158b60 2023-05-22T01:33:39.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.846+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a006cdd0 con 0x7fd1a0158b60 2023-05-22T01:33:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.846+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1980147e0 con 0x7fd1a0158b60 2023-05-22T01:33:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.850+0000 7fd196ffd700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd1800663c0 0x7fd180068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:33:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.850+0000 7fd19e59c700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd1800663c0 0x7fd180068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:33:39.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.850+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd198083770 con 0x7fd1a0158b60 2023-05-22T01:33:39.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.850+0000 7fd19e59c700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd1800663c0 0x7fd180068870 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd188008d30 tx=0x7fd18800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:33:39.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.886+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a00ce280 con 0x7fd1a0158b60 2023-05-22T01:33:39.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:39.894+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd198050fa0 con 0x7fd1a0158b60 2023-05-22T01:33:40.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:40.622+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fd1a00b1dc0 con 0x7fd1a0158b60 2023-05-22T01:33:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.594+0000 7fd196ffd700 1 -- 172.21.15.46:0/3039757919 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v15675) v1 ==== 144+0+0 (secure 0 0 0) 0x7fd198019070 con 0x7fd1a0158b60 2023-05-22T01:33:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd1800663c0 msgr2=0x7fd180068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd1800663c0 0x7fd180068870 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd188008d30 tx=0x7fd18800a000 comp rx=0 tx=0).stop 2023-05-22T01:33:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 msgr2=0x7fd1a006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:33:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a006e5f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd19800be20 tx=0x7fd198009ef0 comp rx=0 tx=0).stop 2023-05-22T01:33:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 shutdown_connections 2023-05-22T01:33:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fd1800663c0 0x7fd180068870 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a0158b60 0x7fd1a006e5f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1a006d870 0x7fd1a00b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:41.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 --2- 172.21.15.46:0/3039757919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a006a4c0 0x7fd1a00b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:33:41.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 >> 172.21.15.46:0/3039757919 conn(0x7fd1a00cc1a0 msgr2=0x7fd1a0158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:33:41.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 shutdown_connections 2023-05-22T01:33:41.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:33:41.614+0000 7fd1a4fbe700 1 -- 172.21.15.46:0/3039757919 wait complete. 2023-05-22T01:33:41.961 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-05-22T01:33:42.510 INFO:tasks.cephfs_test_runner: 2023-05-22T01:33:42.525 INFO:tasks.cephfs_test_runner:====================================================================== 2023-05-22T01:33:42.551 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-22T01:33:42.564 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-05-22T01:33:42.569 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-05-22T01:33:42.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-05-22T01:33:42.570 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-05-22T01:33:42.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs/xfstests_dev.py", line 385, in run_generic_tests 2023-05-22T01:33:42.570 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-05-22T01:33:42.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs/xfstests_dev.py", line 377, in run_testdir 2023-05-22T01:33:42.571 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-05-22T01:33:42.571 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2023-05-22T01:33:42.571 INFO:tasks.cephfs_test_runner: 2023-05-22T01:33:42.572 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-05-22T01:33:42.593 INFO:tasks.cephfs_test_runner:Ran 1 test in 31133.746s 2023-05-22T01:33:42.593 INFO:tasks.cephfs_test_runner: 2023-05-22T01:33:42.613 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-05-22T01:33:42.613 INFO:tasks.cephfs_test_runner: 2023-05-22T01:33:42.629 INFO:tasks.cephfs_test_runner:====================================================================== 2023-05-22T01:33:42.630 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-22T01:33:42.630 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-05-22T01:33:42.630 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-05-22T01:33:42.630 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-05-22T01:33:42.631 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-05-22T01:33:42.631 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs/xfstests_dev.py", line 385, in run_generic_tests 2023-05-22T01:33:42.631 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-05-22T01:33:42.631 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs/xfstests_dev.py", line 377, in run_testdir 2023-05-22T01:33:42.631 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-05-22T01:33:42.631 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2023-05-22T01:33:42.632 INFO:tasks.cephfs_test_runner: 2023-05-22T01:33:43.160 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_01abd1ed90624b09fd81d9cb3a79e2834351f0ca/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-22T01:33:56.587 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7c09d0b86e6c49a2b486d74d557ad59b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_01abd1ed90624b09fd81d9cb3a79e2834351f0ca/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_5ca1fdcfd7e6cec340f637cba9f0087e6db9c2c1/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-22T01:33:56.713 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-05-22T01:33:57.167 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-05-22T01:33:57.244 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-05-22T01:33:57.251 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-22T01:33:57.252 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:59.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355616k,nr_inodes=4088904,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3277328k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-05-22T01:33:59.044 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-05-22T01:33:59.046 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:59.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355616k,nr_inodes=4088904,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=271 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3277328k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3277332k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-05-22T01:33:59.119 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-22T01:33:59.119 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:59.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352476k,nr_inodes=4088119,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20563 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276700k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-05-22T01:33:59.140 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-05-22T01:33:59.141 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-22T01:33:59.194 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352476k,nr_inodes=4088119,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20563 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276700k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276704k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-05-22T01:33:59.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.282 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-05-22T01:33:59.304 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-22T01:33:59.305 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-22T01:33:59.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-22T01:33:59.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-22T01:33:59.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-05-22T01:33:59.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.584 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-05-22T01:33:59.610 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-05-22T01:33:59.615 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-22T01:33:59.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-22T01:33:59.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-22T01:33:59.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-22T01:33:59.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-05-22T01:33:59.854 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-05-22T01:33:59.911 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-22T01:33:59.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-22T01:34:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 Processor -- start 2023-05-22T01:34:00.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 -- start start 2023-05-22T01:34:00.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00b85b0 0x7f55e00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55e01600c0 0x7f55e00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f55e00b2140 0x7f55e00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e006afd0 con 0x7f55e01600c0 2023-05-22T01:34:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e00cd6b0 con 0x7f55e00b2140 2023-05-22T01:34:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55e4e3e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00cd990 con 0x7f55e00b85b0 2023-05-22T01:34:00.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55e01600c0 0x7f55e00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55e01600c0 0x7f55e00b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43080/0 (socket says 172.21.15.46:43080) 2023-05-22T01:34:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 -- 172.21.15.46:0/2888631166 learned_addr learned my addr 172.21.15.46:0/2888631166 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55dffff700 1 --2- 172.21.15.46:0/2888631166 >> v2:172.21.15.142:3300/0 conn(0x7f55e00b2140 0x7f55e00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55df7fe700 1 --2- 172.21.15.46:0/2888631166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00b85b0 0x7f55e00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 -- 172.21.15.46:0/2888631166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00b85b0 msgr2=0x7f55e00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 --2- 172.21.15.46:0/2888631166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00b85b0 0x7f55e00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 -- 172.21.15.46:0/2888631166 >> v2:172.21.15.142:3300/0 conn(0x7f55e00b2140 msgr2=0x7f55e00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:00.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 --2- 172.21.15.46:0/2888631166 >> v2:172.21.15.142:3300/0 conn(0x7f55e00b2140 0x7f55e00b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 -- 172.21.15.46:0/2888631166 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e006b220 con 0x7f55e01600c0 2023-05-22T01:34:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55deffd700 1 --2- 172.21.15.46:0/2888631166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00b4940 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f55e00b1b30 tx=0x7f55d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b898eec31e65d98e server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55de7fc700 1 -- 172.21.15.46:0/2888631166 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4011830 con 0x7f55e01600c0 2023-05-22T01:34:00.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55de7fc700 1 -- 172.21.15.46:0/2888631166 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d4011990 con 0x7f55e01600c0 2023-05-22T01:34:00.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.074+0000 7f55de7fc700 1 -- 172.21.15.46:0/2888631166 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4011d20 con 0x7f55e01600c0 2023-05-22T01:34:00.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2888631166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 msgr2=0x7f55e00b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- 172.21.15.46:0/2888631166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00b4940 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f55e00b1b30 tx=0x7f55d4009bf0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2888631166 shutdown_connections 2023-05-22T01:34:00.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- 172.21.15.46:0/2888631166 >> v2:172.21.15.142:3300/0 conn(0x7f55e00b2140 0x7f55e00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- 172.21.15.46:0/2888631166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00b4940 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- 172.21.15.46:0/2888631166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e00b85b0 0x7f55e00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2888631166 >> 172.21.15.46:0/2888631166 conn(0x7f55e006cc00 msgr2=0x7f55e00cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:00.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2888631166 shutdown_connections 2023-05-22T01:34:00.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2888631166 wait complete. 2023-05-22T01:34:00.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 Processor -- start 2023-05-22T01:34:00.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- start start 2023-05-22T01:34:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e00b85b0 0x7f55e015d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e015e8a0 0x7f55e00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0151680 con 0x7f55e01600c0 2023-05-22T01:34:00.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e01f14a0 con 0x7f55e00b85b0 2023-05-22T01:34:00.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55e4e3e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e00b2980 con 0x7f55e015e8a0 2023-05-22T01:34:00.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55deffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55df7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e00b85b0 0x7f55e015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55deffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43096/0 (socket says 172.21.15.46:43096) 2023-05-22T01:34:00.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55deffd700 1 -- 172.21.15.46:0/2812280174 learned_addr learned my addr 172.21.15.46:0/2812280174 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:00.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.078+0000 7f55dffff700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e015e8a0 0x7f55e00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55deffd700 1 -- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e015e8a0 msgr2=0x7f55e00ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55deffd700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e015e8a0 0x7f55e00ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55deffd700 1 -- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e00b85b0 msgr2=0x7f55e015d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55deffd700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e00b85b0 0x7f55e015d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55deffd700 1 -- 172.21.15.46:0/2812280174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4009570 con 0x7f55e01600c0 2023-05-22T01:34:00.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55df7fe700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e00b85b0 0x7f55e015d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:00.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55deffd700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00c9f90 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f55e0072480 tx=0x7f55d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:00.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4004460 con 0x7f55e01600c0 2023-05-22T01:34:00.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d401e070 con 0x7f55e01600c0 2023-05-22T01:34:00.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2812280174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e00b8980 con 0x7f55e01600c0 2023-05-22T01:34:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4003900 con 0x7f55e01600c0 2023-05-22T01:34:00.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55e4e3e700 1 -- 172.21.15.46:0/2812280174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e006b500 con 0x7f55e01600c0 2023-05-22T01:34:00.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55d4003a60 con 0x7f55e01600c0 2023-05-22T01:34:00.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e00cf5b0 con 0x7f55e01600c0 2023-05-22T01:34:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c7fff700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f55cc0662f0 0x7f55cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.082+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f55d4020070 con 0x7f55e01600c0 2023-05-22T01:34:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.086+0000 7f55df7fe700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f55cc0662f0 0x7f55cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.086+0000 7f55df7fe700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f55cc0662f0 0x7f55cc0687a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009d70 tx=0x7f55d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:00.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.090+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f55d4052500 con 0x7f55e01600c0 2023-05-22T01:34:00.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.246+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55e0067ac0 con 0x7f55cc0662f0 2023-05-22T01:34:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c7fff700 1 -- 172.21.15.46:0/2812280174 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71111 (secure 0 0 0) 0x7f55e0067ac0 con 0x7f55cc0662f0 2023-05-22T01:34:00.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:00.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f55cc0662f0 msgr2=0x7f55cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f55cc0662f0 0x7f55cc0687a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009d70 tx=0x7f55d0008040 comp rx=0 tx=0).stop 2023-05-22T01:34:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 msgr2=0x7f55e00c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00c9f90 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f55e0072480 tx=0x7f55d4004770 comp rx=0 tx=0).stop 2023-05-22T01:34:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 shutdown_connections 2023-05-22T01:34:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f55cc0662f0 0x7f55cc0687a0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55e015e8a0 0x7f55e00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55e01600c0 0x7f55e00c9f90 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 --2- 172.21.15.46:0/2812280174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e00b85b0 0x7f55e015d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 >> 172.21.15.46:0/2812280174 conn(0x7f55e00b2140 msgr2=0x7f55e00b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 shutdown_connections 2023-05-22T01:34:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.254+0000 7f55c5ffb700 1 -- 172.21.15.46:0/2812280174 wait complete. 2023-05-22T01:34:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-22T01:34:00.316 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":15628,"stamp":"2023-05-22T01:34:00.013816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8141864,"kb_used_data":5096,"kb_used_omap":47479,"kb_used_meta":8089224,"kb_avail":746832856,"statfs":{"total":773094113280,"available":764756844544,"internally_reserved":0,"allocated":5218304,"data_stored":2873120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48619470,"internal_metadata":8283365426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"1.0","version":"40'161","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945351+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-22T01:33:38.945351+0000","last_peered":"2023-05-22T01:33:38.945351+0000","last_clean":"2023-05-22T01:33:38.945351+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-22T01:33:38.945351+0000","last_undegraded":"2023-05-22T01:33:38.945351+0000","last_fullsized":"2023-05-22T01:33:38.945351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:51:17.569979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.073441+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-22T01:33:38.073441+0000","last_peered":"2023-05-22T01:33:38.073441+0000","last_clean":"2023-05-22T01:33:38.073441+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-22T01:33:38.073441+0000","last_undegraded":"2023-05-22T01:33:38.073441+0000","last_fullsized":"2023-05-22T01:33:38.073441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:26:33.334567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.942345+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-22T01:33:38.942345+0000","last_peered":"2023-05-22T01:33:38.942345+0000","last_clean":"2023-05-22T01:33:38.942345+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-22T01:33:38.942345+0000","last_undegraded":"2023-05-22T01:33:38.942345+0000","last_fullsized":"2023-05-22T01:33:38.942345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:15:27.801927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":299,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.573891+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-22T01:33:37.573891+0000","last_peered":"2023-05-22T01:33:37.573891+0000","last_clean":"2023-05-22T01:33:37.573891+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-22T01:33:37.573891+0000","last_undegraded":"2023-05-22T01:33:37.573891+0000","last_fullsized":"2023-05-22T01:33:37.573891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:31:00.057381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.653638+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-22T01:33:37.653638+0000","last_peered":"2023-05-22T01:33:37.653638+0000","last_clean":"2023-05-22T01:33:37.653638+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-22T01:33:37.653638+0000","last_undegraded":"2023-05-22T01:33:37.653638+0000","last_fullsized":"2023-05-22T01:33:37.653638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:54:43.079830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":301,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.006672+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-22T01:33:38.006672+0000","last_peered":"2023-05-22T01:33:38.006672+0000","last_clean":"2023-05-22T01:33:38.006672+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-22T01:33:38.006672+0000","last_undegraded":"2023-05-22T01:33:38.006672+0000","last_fullsized":"2023-05-22T01:33:38.006672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:37:00.564053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945172+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-22T01:33:38.945172+0000","last_peered":"2023-05-22T01:33:38.945172+0000","last_clean":"2023-05-22T01:33:38.945172+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-22T01:33:38.945172+0000","last_undegraded":"2023-05-22T01:33:38.945172+0000","last_fullsized":"2023-05-22T01:33:38.945172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:25:24.904929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":293,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.009841+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-22T01:33:38.009841+0000","last_peered":"2023-05-22T01:33:38.009841+0000","last_clean":"2023-05-22T01:33:38.009841+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-22T01:33:38.009841+0000","last_undegraded":"2023-05-22T01:33:38.009841+0000","last_fullsized":"2023-05-22T01:33:38.009841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:49:30.801377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.742907+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-22T01:33:38.742907+0000","last_peered":"2023-05-22T01:33:38.742907+0000","last_clean":"2023-05-22T01:33:38.742907+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-22T01:33:38.742907+0000","last_undegraded":"2023-05-22T01:33:38.742907+0000","last_fullsized":"2023-05-22T01:33:38.742907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:00:13.169152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581088,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119864,"kb_used_data":1072,"kb_used_omap":3881,"kb_used_meta":1114902,"kb_avail":93251976,"statfs":{"total":96636764160,"available":95490023424,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3974582,"internal_metadata":1141660234},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.85899999999999999,"15min":0.95799999999999996},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":5.9900000000000002,"5min":5.9900000000000002,"15min":8.157},"last":0.745},{"interface":"front","average":{"1min":1.288,"5min":0.81899999999999995,"15min":0.872},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":6.1230000000000002,"5min":6.6349999999999998,"15min":6.7430000000000003},"last":0.80700000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":0.94999999999999996,"15min":0.95699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28899999999999998},"max":{"1min":14.869,"5min":14.869,"15min":14.869},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.8109999999999999,"5min":1.274,"15min":1.21},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":14.644,"5min":14.644,"15min":14.644},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1910000000000001,"15min":1.1899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30599999999999999},"max":{"1min":4.0519999999999996,"5min":9.8300000000000001,"15min":9.8300000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.139,"15min":1.095},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":6.1660000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":1.01}]},{"osd":3,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0980000000000001,"15min":1.145},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.32900000000000001},"max":{"1min":3.1150000000000002,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.766,"5min":1.159,"15min":1.3120000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":8.9600000000000009,"5min":8.9600000000000009,"15min":10.041},"last":1.0449999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.78700000000000003,"15min":0.873},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":6.0330000000000004,"5min":6.5339999999999998,"15min":8.5380000000000003},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.202,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.318},"max":{"1min":6.1059999999999999,"5min":6.7610000000000001,"15min":6.7610000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.96699999999999997,"15min":0.96099999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":4.1340000000000003,"5min":6.2670000000000003,"15min":7.931},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.1739999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.91200000000000003,"15min":1.0109999999999999},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.36499999999999999},"max":{"1min":6.133,"5min":6.6600000000000001,"15min":6.8179999999999996},"last":1.2929999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":2.9180000000000001,"5min":6.8090000000000002,"15min":8.0760000000000005},"last":1.1120000000000001}]}]},{"osd":6,"up_from":13,"seq":55834581088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838900,"kb_used_data":492,"kb_used_omap":4141,"kb_used_meta":834258,"kb_avail":93532940,"statfs":{"total":96636764160,"available":95777730560,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4241217,"internal_metadata":854280383},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.633,"15min":1.048},"min":{"1min":0.27700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.721,"5min":54.807000000000002,"15min":54.807000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":2.661,"5min":1.9219999999999999,"15min":1.3029999999999999},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":13.321999999999999,"5min":54.838999999999999,"15min":54.838999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.1699999999999999,"15min":1.105},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":6.6050000000000004,"5min":8.7699999999999996,"15min":8.7699999999999996},"last":0.623},{"interface":"front","average":{"1min":2.6349999999999998,"5min":1.468,"15min":1.2869999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":31.484999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":0.99099999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.369,"15min":1.3069999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":14.484,"5min":14.484,"15min":14.484},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.238,"15min":1.218},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":6.6360000000000001,"5min":8.8719999999999999,"15min":9.3499999999999996},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":2.1299999999999999,"15min":1.5940000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":5.7649999999999997,"5min":55.756999999999998,"15min":55.756999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.7110000000000001,"15min":1.3240000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.319,"5min":54.451999999999998,"15min":54.451999999999998},"last":0.749}]},{"osd":4,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0920000000000001,"15min":1.0129999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0920000000000005,"5min":9.8879999999999999,"15min":9.8879999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.0289999999999999,"5min":1.246,"15min":1.095},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.92800000000000005,"15min":0.99299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":3.7570000000000001,"5min":5.601,"15min":7.6219999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.135,"15min":1.1950000000000001},"min":{"1min":0.48299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":9.7249999999999996,"5min":9.7249999999999996,"15min":9.7249999999999996},"last":0.92300000000000004}]},{"osd":7,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.171,"15min":1.0529999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36899999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":1.103},{"interface":"front","average":{"1min":1.248,"5min":1.1279999999999999,"15min":1.0609999999999999},"min":{"1min":0.46600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.1920000000000002,"5min":7.1920000000000002,"15min":7.1920000000000002},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834581089,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1168180,"kb_used_data":492,"kb_used_omap":7161,"kb_used_meta":1160518,"kb_avail":93203660,"statfs":{"total":96636764160,"available":95440547840,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7333659,"internal_metadata":1188370661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.2210000000000001,"15min":1.0309999999999999},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.23599999999999999},"max":{"1min":26.170999999999999,"5min":26.170999999999999,"15min":26.170999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":2.359,"5min":1.23,"15min":1.1120000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":25.670000000000002,"5min":25.670000000000002,"15min":25.670000000000002},"last":0.76500000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.145,"15min":1.23},"min":{"1min":0.33400000000000002,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":2.677,"5min":6.5579999999999998,"15min":11.092000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.2609999999999999,"15min":1.2250000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.2300000000000004,"5min":7.6230000000000002,"15min":7.6230000000000002},"last":0.86399999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.198,"15min":1.3460000000000001},"min":{"1min":0.39500000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4050000000000002,"5min":6.6420000000000003,"15min":8.6769999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.244},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.313},"max":{"1min":5.7220000000000004,"5min":6.7610000000000001,"15min":8.7870000000000008},"last":0.91300000000000003}]},{"osd":3,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.1519999999999999,"15min":1.1910000000000001},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.9989999999999997,"5min":7.5339999999999998,"15min":7.5339999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2170000000000001,"15min":1.353},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":4.2759999999999998,"5min":7.843,"15min":9.3379999999999992},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66500000000000004,"15min":0.80200000000000005},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.27200000000000002},"max":{"1min":1.603,"5min":4.4539999999999997,"15min":8.7579999999999991},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.85799999999999998,"15min":0.90100000000000002},"min":{"1min":0.35299999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.7450000000000001,"5min":8.2370000000000001,"15min":8.6430000000000007},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.91500000000000004,"15min":1.022},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.1849999999999996,"5min":5.1870000000000003,"15min":16.861999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.81299999999999994,"15min":0.995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.34100000000000003},"max":{"1min":3.9329999999999998,"5min":4.8479999999999999,"15min":8.7200000000000006},"last":0.83199999999999996}]},{"osd":7,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.97799999999999998,"15min":1.046},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":4.0700000000000003,"5min":5.5490000000000004,"15min":7.1909999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.339,"5min":1.0389999999999999,"15min":1.1040000000000001},"min":{"1min":0.443,"5min":0.37,"15min":0.37},"max":{"1min":4.2549999999999999,"5min":5.508,"15min":6.7629999999999999},"last":1.079}]}]},{"osd":4,"up_from":13,"seq":55834581089,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1140916,"kb_used_data":492,"kb_used_omap":10283,"kb_used_meta":1130132,"kb_avail":93230924,"statfs":{"total":96636764160,"available":95468466176,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10530010,"internal_metadata":1157255974},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":5.2889999999999997,"5min":6.4199999999999999,"15min":11.731},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1,"15min":0.997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.4930000000000003,"5min":10.221,"15min":10.221},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.94599999999999995,"15min":1.9179999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29699999999999999},"max":{"1min":10.135999999999999,"5min":10.135999999999999,"15min":227.46199999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.25,"15min":2.0510000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":227.56100000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":1.3819999999999999,"15min":1.351},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32000000000000001},"max":{"1min":12.827999999999999,"5min":12.827999999999999,"15min":13.026999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.24},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":5.9160000000000004,"5min":7.0830000000000002,"15min":8.8719999999999999},"last":0.874}]},{"osd":3,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2669999999999999,"15min":1.1779999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33100000000000002},"max":{"1min":4.5899999999999999,"5min":10.183999999999999,"15min":10.183999999999999},"last":0.504},{"interface":"front","average":{"1min":1.524,"5min":1.282,"15min":1.321},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":10.173,"5min":10.173,"15min":10.677},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":6.944},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":0.97899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.8120000000000003,"5min":10.256,"15min":10.256},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1200000000000001,"15min":1.052},"min":{"1min":0.47999999999999998,"5min":0.38800000000000001,"15min":0.28399999999999997},"max":{"1min":10.023,"5min":10.023,"15min":10.023},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.88},"min":{"1min":0.375,"5min":0.375,"15min":0.35699999999999998},"max":{"1min":1.931,"5min":3.3940000000000001,"15min":7.0350000000000001},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.1990000000000001,"15min":1.1339999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.7970000000000006,"5min":10.286,"15min":10.286},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.1240000000000001,"15min":1.0469999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33200000000000002},"max":{"1min":10.106,"5min":10.106,"15min":10.106},"last":0.97899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834581077,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1113076,"kb_used_data":492,"kb_used_omap":6752,"kb_used_meta":1105823,"kb_avail":93258764,"statfs":{"total":96636764160,"available":95496974336,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6914506,"internal_metadata":1132363318},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.4430000000000001,"15min":1.296},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.266,"5min":16.087,"15min":16.087},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2,"15min":1.2090000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.22700000000000001},"max":{"1min":10.127000000000001,"5min":10.127000000000001,"15min":12.468999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"max":{"1min":2.169,"5min":8.1029999999999998,"15min":10.978999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.3720000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":6.7290000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":0.96599999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.357,"15min":1.3100000000000001},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.27100000000000002},"max":{"1min":3.1850000000000001,"5min":8.5549999999999997,"15min":17.588999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":3.0710000000000002,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.28399999999999997},"max":{"1min":25.882999999999999,"5min":25.882999999999999,"15min":25.882999999999999},"last":1.0609999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.258,"15min":1.1970000000000001},"min":{"1min":0.42899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.3890000000000002,"5min":9.0340000000000007,"15min":12.401999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":3.0329999999999999,"5min":1.5569999999999999,"15min":1.3029999999999999},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":38.222000000000001,"5min":38.222000000000001,"15min":38.222000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":1.5189999999999999,"15min":1.401},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.35499999999999998},"max":{"1min":25.931000000000001,"5min":25.931000000000001,"15min":25.931000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.6160000000000001,"15min":1.524},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.214,"5min":28.010000000000002,"15min":28.010000000000002},"last":1.4059999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":1.772,"15min":1.498},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36599999999999999},"max":{"1min":48.582000000000001,"5min":48.582000000000001,"15min":48.582000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":5.3490000000000002,"5min":2.0459999999999998,"15min":1.657},"min":{"1min":0.624,"5min":0.501,"15min":0.40799999999999997},"max":{"1min":68.367000000000004,"5min":68.367000000000004,"15min":68.367000000000004},"last":1.363}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.72,"15min":1.552},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5630000000000002,"5min":8.9730000000000008,"15min":12.48},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.29,"15min":1.4330000000000001},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.4279999999999999,"5min":8.25,"15min":13.292999999999999},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834581079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1011444,"kb_used_data":492,"kb_used_omap":3682,"kb_used_meta":1007261,"kb_avail":93360396,"statfs":{"total":96636764160,"available":95601045504,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3770422,"internal_metadata":1031436234},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.75900000000000001,"15min":1.1299999999999999},"min":{"1min":0.26900000000000002,"5min":0.218,"15min":0.216},"max":{"1min":0.93999999999999995,"5min":8.5359999999999996,"15min":42.659999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.7689999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.7300000000000004,"5min":14.984999999999999,"15min":41.613999999999997},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.998,"15min":1.3120000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.8029999999999999,"5min":8.859,"15min":11.391},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.4199999999999999,"15min":1.5649999999999999},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.8970000000000002,"5min":14.401999999999999,"15min":14.401999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.819,"5min":1.5960000000000001,"15min":1.5660000000000001},"min":{"1min":0.35599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7270000000000003,"5min":17.779,"15min":41.917000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.306,"5min":1.05,"15min":1.4350000000000001},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":7.4039999999999999,"5min":7.4039999999999999,"15min":42.578000000000003},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97799999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":5.9790000000000001,"5min":6.5069999999999997,"15min":7.9699999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.999,"5min":1.1819999999999999,"15min":1.391},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.8179999999999996,"5min":7.0430000000000001,"15min":10.009},"last":1.123}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.2929999999999999,"15min":1.298},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":6.0069999999999997,"5min":10.605,"15min":10.605},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1439999999999999,"15min":1.179},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33000000000000002},"max":{"1min":5.7939999999999996,"5min":6.5449999999999999,"15min":7.9160000000000004},"last":1.0269999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.264,"15min":1.4730000000000001},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"max":{"1min":6.8520000000000003,"5min":7.1609999999999996,"15min":9.9819999999999993},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.806,"5min":1.373,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.35,"5min":10.645,"15min":13.244999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.4650000000000001,"15min":1.5149999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":14.59,"5min":14.59,"15min":14.59},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.599,"5min":1.4350000000000001,"15min":1.4630000000000001},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.438},"max":{"1min":5.9560000000000004,"5min":11.401,"15min":11.401},"last":1.2090000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581082,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088756,"kb_used_data":492,"kb_used_omap":6199,"kb_used_meta":1082056,"kb_avail":93283084,"statfs":{"total":96636764160,"available":95521878016,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6348278,"internal_metadata":1108025866},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.0800000000000001,"15min":0.88900000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":11.808999999999999,"5min":11.808999999999999,"15min":14.096},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.202,"15min":1.5580000000000001},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.073,"5min":7.468,"15min":14.414999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":1.492,"15min":1.2030000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":2.5070000000000001,"5min":1.6759999999999999,"15min":1.552},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":0.84599999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:30 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":1.0389999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":1.806,"15min":1.589},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.27500000000000002},"max":{"1min":11.835000000000001,"5min":11.835000000000001,"15min":15.206},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.228,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.08,"5min":12.08,"15min":12.08},"last":0.90200000000000002},{"interface":"front","average":{"1min":4.1189999999999998,"5min":1.853,"15min":1.5680000000000001},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":40.874000000000002,"5min":40.874000000000002,"15min":40.874000000000002},"last":1.2390000000000001}]},{"osd":5,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.6759999999999999,"15min":1.452},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.901,"5min":11.901,"15min":15.260999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":2.5259999999999998,"5min":1.6020000000000001,"15min":1.2989999999999999},"min":{"1min":0.61199999999999999,"5min":0.45700000000000002,"15min":0.375},"max":{"1min":14.613,"5min":14.613,"15min":14.613},"last":1.0069999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":1.8919999999999999,"15min":1.7},"min":{"1min":0.46000000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":11.968999999999999,"5min":11.968999999999999,"15min":15.295999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.581,"15min":1.298},"min":{"1min":0.627,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":12.144,"5min":12.144,"15min":12.144},"last":1.0649999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.631,"15min":1.627},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.9890000000000001,"5min":1.839,"15min":1.7370000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.936999999999999,"5min":12.363,"15min":15.33},"last":0.92400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834581078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660728,"kb_used_data":1072,"kb_used_omap":5377,"kb_used_meta":654270,"kb_avail":93711112,"statfs":{"total":96636764160,"available":95960178688,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5506796,"internal_metadata":669972756},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":2.2549999999999999,"5min":15.766999999999999,"15min":15.766999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.91300000000000003,"15min":1.0980000000000001},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":1.548,"5min":15.926,"15min":15.926},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.087,"15min":1.129},"min":{"1min":0.26500000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":10.250999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.137,"15min":1.2869999999999999},"min":{"1min":0.28699999999999998,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":3.0640000000000001,"5min":10.025,"15min":12.134},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":1.3799999999999999,"15min":1.5820000000000001},"min":{"1min":0.32900000000000001,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":2.4630000000000001,"5min":9.8330000000000002,"15min":30.591999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.3049999999999999,"15min":1.5649999999999999},"min":{"1min":0.32400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.056,"5min":15.707000000000001,"15min":32.085000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":1.111,"15min":1.1890000000000001},"min":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.508,"5min":6.2999999999999998,"15min":18.071000000000002},"last":1.095},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.879,"15min":1.0349999999999999},"min":{"1min":0.40799999999999997,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":6.2359999999999998,"15min":8.8149999999999995},"last":1.079}]},{"osd":5,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.99199999999999999,"15min":1.238},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":3.2890000000000001,"5min":7.7690000000000001,"15min":8.8580000000000005},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.208,"15min":1.319},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":4.819,"5min":6.3419999999999996,"15min":17.975999999999999},"last":0.995}]},{"osd":6,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.214,"15min":1.246},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.35299999999999998},"max":{"1min":5.4989999999999997,"5min":10.324999999999999,"15min":10.324999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.2609999999999999,"15min":1.339},"min":{"1min":0.433,"5min":0.41599999999999998,"15min":0.39200000000000002},"max":{"1min":4.7800000000000002,"5min":10.792,"15min":13.109},"last":1.135}]},{"osd":7,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.282,"15min":1.391},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":2.02,"5min":7.8440000000000003,"15min":8.8309999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.173,"5min":1.45,"15min":1.403},"min":{"1min":0.52000000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":4.9939999999999998,"5min":6.3769999999999998,"15min":18.039000000000001},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-22T01:34:00.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-22T01:34:00.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.594+0000 7f32cda76700 1 Processor -- start 2023-05-22T01:34:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.594+0000 7f32cda76700 1 -- start start 2023-05-22T01:34:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c00385e0 0x7f32c0053850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32c003c050 0x7f32c003c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c0056dd0 con 0x7f32c0006dc0 2023-05-22T01:34:00.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c003ca10 con 0x7f32c003c050 2023-05-22T01:34:00.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0057670 con 0x7f32c00385e0 2023-05-22T01:34:00.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c7fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f32c0006dc0 0x7f32c0057b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49204/0 (socket says 172.21.15.46:49204) 2023-05-22T01:34:00.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c7fff700 1 -- 172.21.15.46:0/63645724 learned_addr learned my addr 172.21.15.46:0/63645724 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:00.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cca74700 1 --2- 172.21.15.46:0/63645724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c00385e0 0x7f32c0053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cd275700 1 --2- 172.21.15.46:0/63645724 >> v2:172.21.15.142:3300/0 conn(0x7f32c003c050 0x7f32c003c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c77fe700 1 -- 172.21.15.46:0/63645724 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727562382 0 0) 0x7f32c0056dd0 con 0x7f32c0006dc0 2023-05-22T01:34:00.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c77fe700 1 -- 172.21.15.46:0/63645724 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b80035d0 con 0x7f32c0006dc0 2023-05-22T01:34:00.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cca74700 1 -- 172.21.15.46:0/63645724 >> v2:172.21.15.142:3300/0 conn(0x7f32c003c050 msgr2=0x7f32c003c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:00.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cca74700 1 --2- 172.21.15.46:0/63645724 >> v2:172.21.15.142:3300/0 conn(0x7f32c003c050 0x7f32c003c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cca74700 1 -- 172.21.15.46:0/63645724 >> v1:172.21.15.46:6789/0 conn(0x7f32c0006dc0 legacy=0x7f32c0057b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cca74700 1 -- 172.21.15.46:0/63645724 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0053ea0 con 0x7f32c00385e0 2023-05-22T01:34:00.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cca74700 1 --2- 172.21.15.46:0/63645724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c00385e0 0x7f32c0053850 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009850 tx=0x7f32bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8f62e521144bc server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:00.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c77fe700 1 -- 172.21.15.46:0/63645724 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc011830 con 0x7f32c00385e0 2023-05-22T01:34:00.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c77fe700 1 -- 172.21.15.46:0/63645724 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc011990 con 0x7f32c00385e0 2023-05-22T01:34:00.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32c77fe700 1 -- 172.21.15.46:0/63645724 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc011d00 con 0x7f32c00385e0 2023-05-22T01:34:00.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- 172.21.15.46:0/63645724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c00385e0 msgr2=0x7f32c0053850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 --2- 172.21.15.46:0/63645724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c00385e0 0x7f32c0053850 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009850 tx=0x7f32bc009b60 comp rx=0 tx=0).stop 2023-05-22T01:34:00.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- 172.21.15.46:0/63645724 shutdown_connections 2023-05-22T01:34:00.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 --2- 172.21.15.46:0/63645724 >> v2:172.21.15.142:3300/0 conn(0x7f32c003c050 0x7f32c003c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 --2- 172.21.15.46:0/63645724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c00385e0 0x7f32c0053850 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- 172.21.15.46:0/63645724 >> 172.21.15.46:0/63645724 conn(0x7f32c0055c80 msgr2=0x7f32c0056050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:00.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- 172.21.15.46:0/63645724 shutdown_connections 2023-05-22T01:34:00.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.598+0000 7f32cda76700 1 -- 172.21.15.46:0/63645724 wait complete. 2023-05-22T01:34:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 Processor -- start 2023-05-22T01:34:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 -- start start 2023-05-22T01:34:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 0x7f32c00e2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32c00385e0 0x7f32c004deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c003c050 0x7f32c00e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00d2000 con 0x7f32c0006dc0 2023-05-22T01:34:00.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00e47d0 con 0x7f32c00385e0 2023-05-22T01:34:00.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00e4ab0 con 0x7f32c003c050 2023-05-22T01:34:00.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 0x7f32c00e2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 0x7f32c00e2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43108/0 (socket says 172.21.15.46:43108) 2023-05-22T01:34:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 -- 172.21.15.46:0/24330025 learned_addr learned my addr 172.21.15.46:0/24330025 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32c7fff700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32c00385e0 0x7f32c004deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cd275700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c003c050 0x7f32c00e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 -- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c003c050 msgr2=0x7f32c00e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c003c050 0x7f32c00e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 -- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32c00385e0 msgr2=0x7f32c004deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32c00385e0 0x7f32c004deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 -- 172.21.15.46:0/24330025 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0094b0 con 0x7f32c0006dc0 2023-05-22T01:34:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32c7fff700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32c00385e0 0x7f32c004deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cca74700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 0x7f32c00e2790 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0090b0 tx=0x7f32bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc004610 con 0x7f32c0006dc0 2023-05-22T01:34:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc01f070 con 0x7f32c0006dc0 2023-05-22T01:34:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c0057300 con 0x7f32c0006dc0 2023-05-22T01:34:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0038c0 con 0x7f32c0006dc0 2023-05-22T01:34:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.602+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c0057020 con 0x7f32c0006dc0 2023-05-22T01:34:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.606+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0007210 con 0x7f32c0006dc0 2023-05-22T01:34:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.606+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32bc003a20 con 0x7f32c0006dc0 2023-05-22T01:34:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.606+0000 7f32c57fa700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32ac0662f0 0x7f32ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.606+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f32bc021070 con 0x7f32c0006dc0 2023-05-22T01:34:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.606+0000 7f32c7fff700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32ac0662f0 0x7f32ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.606+0000 7f32c7fff700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32ac0662f0 0x7f32ac0687a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f32c00e00f0 tx=0x7f32b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.610+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f32bc052af0 con 0x7f32c0006dc0 2023-05-22T01:34:00.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.774+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32c00059c0 con 0x7f32ac0662f0 2023-05-22T01:34:00.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.778+0000 7f32c57fa700 1 -- 172.21.15.46:0/24330025 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71111 (secure 0 0 0) 0x7f32c00059c0 con 0x7f32ac0662f0 2023-05-22T01:34:00.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:00.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32ac0662f0 msgr2=0x7f32ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32ac0662f0 0x7f32ac0687a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f32c00e00f0 tx=0x7f32b4009040 comp rx=0 tx=0).stop 2023-05-22T01:34:00.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 msgr2=0x7f32c00e2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:00.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 0x7f32c00e2790 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0090b0 tx=0x7f32bc004770 comp rx=0 tx=0).stop 2023-05-22T01:34:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 shutdown_connections 2023-05-22T01:34:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f32ac0662f0 0x7f32ac0687a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32c003c050 0x7f32c00e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32c00385e0 0x7f32c004deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 --2- 172.21.15.46:0/24330025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c0006dc0 0x7f32c00e2790 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 >> 172.21.15.46:0/24330025 conn(0x7f32c0055c80 msgr2=0x7f32c003dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 shutdown_connections 2023-05-22T01:34:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:00.782+0000 7f32cda76700 1 -- 172.21.15.46:0/24330025 wait complete. 2023-05-22T01:34:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-22T01:34:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":15628,"stamp":"2023-05-22T01:34:00.013816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8141864,"kb_used_data":5096,"kb_used_omap":47479,"kb_used_meta":8089224,"kb_avail":746832856,"statfs":{"total":773094113280,"available":764756844544,"internally_reserved":0,"allocated":5218304,"data_stored":2873120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48619470,"internal_metadata":8283365426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"1.0","version":"40'161","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945351+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-22T01:33:38.945351+0000","last_peered":"2023-05-22T01:33:38.945351+0000","last_clean":"2023-05-22T01:33:38.945351+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-22T01:33:38.945351+0000","last_undegraded":"2023-05-22T01:33:38.945351+0000","last_fullsized":"2023-05-22T01:33:38.945351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:51:17.569979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.073441+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-22T01:33:38.073441+0000","last_peered":"2023-05-22T01:33:38.073441+0000","last_clean":"2023-05-22T01:33:38.073441+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-22T01:33:38.073441+0000","last_undegraded":"2023-05-22T01:33:38.073441+0000","last_fullsized":"2023-05-22T01:33:38.073441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:26:33.334567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.942345+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-22T01:33:38.942345+0000","last_peered":"2023-05-22T01:33:38.942345+0000","last_clean":"2023-05-22T01:33:38.942345+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-22T01:33:38.942345+0000","last_undegraded":"2023-05-22T01:33:38.942345+0000","last_fullsized":"2023-05-22T01:33:38.942345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:15:27.801927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":299,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.573891+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-22T01:33:37.573891+0000","last_peered":"2023-05-22T01:33:37.573891+0000","last_clean":"2023-05-22T01:33:37.573891+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-22T01:33:37.573891+0000","last_undegraded":"2023-05-22T01:33:37.573891+0000","last_fullsized":"2023-05-22T01:33:37.573891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:31:00.057381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.653638+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-22T01:33:37.653638+0000","last_peered":"2023-05-22T01:33:37.653638+0000","last_clean":"2023-05-22T01:33:37.653638+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-22T01:33:37.653638+0000","last_undegraded":"2023-05-22T01:33:37.653638+0000","last_fullsized":"2023-05-22T01:33:37.653638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:54:43.079830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":301,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.006672+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-22T01:33:38.006672+0000","last_peered":"2023-05-22T01:33:38.006672+0000","last_clean":"2023-05-22T01:33:38.006672+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-22T01:33:38.006672+0000","last_undegraded":"2023-05-22T01:33:38.006672+0000","last_fullsized":"2023-05-22T01:33:38.006672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:37:00.564053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945172+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-22T01:33:38.945172+0000","last_peered":"2023-05-22T01:33:38.945172+0000","last_clean":"2023-05-22T01:33:38.945172+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-22T01:33:38.945172+0000","last_undegraded":"2023-05-22T01:33:38.945172+0000","last_fullsized":"2023-05-22T01:33:38.945172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:25:24.904929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":293,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.009841+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-22T01:33:38.009841+0000","last_peered":"2023-05-22T01:33:38.009841+0000","last_clean":"2023-05-22T01:33:38.009841+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-22T01:33:38.009841+0000","last_undegraded":"2023-05-22T01:33:38.009841+0000","last_fullsized":"2023-05-22T01:33:38.009841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:49:30.801377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.742907+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-22T01:33:38.742907+0000","last_peered":"2023-05-22T01:33:38.742907+0000","last_clean":"2023-05-22T01:33:38.742907+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-22T01:33:38.742907+0000","last_undegraded":"2023-05-22T01:33:38.742907+0000","last_fullsized":"2023-05-22T01:33:38.742907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:00:13.169152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581088,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119864,"kb_used_data":1072,"kb_used_omap":3881,"kb_used_meta":1114902,"kb_avail":93251976,"statfs":{"total":96636764160,"available":95490023424,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3974582,"internal_metadata":1141660234},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.85899999999999999,"15min":0.95799999999999996},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":5.9900000000000002,"5min":5.9900000000000002,"15min":8.157},"last":0.745},{"interface":"front","average":{"1min":1.288,"5min":0.81899999999999995,"15min":0.872},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":6.1230000000000002,"5min":6.6349999999999998,"15min":6.7430000000000003},"last":0.80700000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":0.94999999999999996,"15min":0.95699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28899999999999998},"max":{"1min":14.869,"5min":14.869,"15min":14.869},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.8109999999999999,"5min":1.274,"15min":1.21},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":14.644,"5min":14.644,"15min":14.644},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1910000000000001,"15min":1.1899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30599999999999999},"max":{"1min":4.0519999999999996,"5min":9.8300000000000001,"15min":9.8300000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.139,"15min":1.095},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":6.1660000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":1.01}]},{"osd":3,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0980000000000001,"15min":1.145},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.32900000000000001},"max":{"1min":3.1150000000000002,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.766,"5min":1.159,"15min":1.3120000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":8.9600000000000009,"5min":8.9600000000000009,"15min":10.041},"last":1.0449999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.78700000000000003,"15min":0.873},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":6.0330000000000004,"5min":6.5339999999999998,"15min":8.5380000000000003},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.202,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.318},"max":{"1min":6.1059999999999999,"5min":6.7610000000000001,"15min":6.7610000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.96699999999999997,"15min":0.96099999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":4.1340000000000003,"5min":6.2670000000000003,"15min":7.931},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.1739999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.91200000000000003,"15min":1.0109999999999999},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.36499999999999999},"max":{"1min":6.133,"5min":6.6600000000000001,"15min":6.8179999999999996},"last":1.2929999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":2.9180000000000001,"5min":6.8090000000000002,"15min":8.0760000000000005},"last":1.1120000000000001}]}]},{"osd":6,"up_from":13,"seq":55834581088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838900,"kb_used_data":492,"kb_used_omap":4141,"kb_used_meta":834258,"kb_avail":93532940,"statfs":{"total":96636764160,"available":95777730560,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4241217,"internal_metadata":854280383},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.633,"15min":1.048},"min":{"1min":0.27700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.721,"5min":54.807000000000002,"15min":54.807000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":2.661,"5min":1.9219999999999999,"15min":1.3029999999999999},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":13.321999999999999,"5min":54.838999999999999,"15min":54.838999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.1699999999999999,"15min":1.105},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":6.6050000000000004,"5min":8.7699999999999996,"15min":8.7699999999999996},"last":0.623},{"interface":"front","average":{"1min":2.6349999999999998,"5min":1.468,"15min":1.2869999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":31.484999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":0.99099999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.369,"15min":1.3069999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":14.484,"5min":14.484,"15min":14.484},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.238,"15min":1.218},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":6.6360000000000001,"5min":8.8719999999999999,"15min":9.3499999999999996},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":2.1299999999999999,"15min":1.5940000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":5.7649999999999997,"5min":55.756999999999998,"15min":55.756999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.7110000000000001,"15min":1.3240000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.319,"5min":54.451999999999998,"15min":54.451999999999998},"last":0.749}]},{"osd":4,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0920000000000001,"15min":1.0129999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0920000000000005,"5min":9.8879999999999999,"15min":9.8879999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.0289999999999999,"5min":1.246,"15min":1.095},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.92800000000000005,"15min":0.99299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":3.7570000000000001,"5min":5.601,"15min":7.6219999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.135,"15min":1.1950000000000001},"min":{"1min":0.48299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":9.7249999999999996,"5min":9.7249999999999996,"15min":9.7249999999999996},"last":0.92300000000000004}]},{"osd":7,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.171,"15min":1.0529999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36899999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":1.103},{"interface":"front","average":{"1min":1.248,"5min":1.1279999999999999,"15min":1.0609999999999999},"min":{"1min":0.46600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.1920000000000002,"5min":7.1920000000000002,"15min":7.1920000000000002},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834581089,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1168180,"kb_used_data":492,"kb_used_omap":7161,"kb_used_meta":1160518,"kb_avail":93203660,"statfs":{"total":96636764160,"available":95440547840,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7333659,"internal_metadata":1188370661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.2210000000000001,"15min":1.0309999999999999},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.23599999999999999},"max":{"1min":26.170999999999999,"5min":26.170999999999999,"15min":26.170999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":2.359,"5min":1.23,"15min":1.1120000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":25.670000000000002,"5min":25.670000000000002,"15min":25.670000000000002},"last":0.76500000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.145,"15min":1.23},"min":{"1min":0.33400000000000002,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":2.677,"5min":6.5579999999999998,"15min":11.092000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.2609999999999999,"15min":1.2250000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.2300000000000004,"5min":7.6230000000000002,"15min":7.6230000000000002},"last":0.86399999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.198,"15min":1.3460000000000001},"min":{"1min":0.39500000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4050000000000002,"5min":6.6420000000000003,"15min":8.6769999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.244},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.313},"max":{"1min":5.7220000000000004,"5min":6.7610000000000001,"15min":8.7870000000000008},"last":0.91300000000000003}]},{"osd":3,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.1519999999999999,"15min":1.1910000000000001},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.9989999999999997,"5min":7.5339999999999998,"15min":7.5339999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2170000000000001,"15min":1.353},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":4.2759999999999998,"5min":7.843,"15min":9.3379999999999992},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66500000000000004,"15min":0.80200000000000005},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.27200000000000002},"max":{"1min":1.603,"5min":4.4539999999999997,"15min":8.7579999999999991},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.85799999999999998,"15min":0.90100000000000002},"min":{"1min":0.35299999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.7450000000000001,"5min":8.2370000000000001,"15min":8.6430000000000007},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.91500000000000004,"15min":1.022},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.1849999999999996,"5min":5.1870000000000003,"15min":16.861999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.81299999999999994,"15min":0.995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.34100000000000003},"max":{"1min":3.9329999999999998,"5min":4.8479999999999999,"15min":8.7200000000000006},"last":0.83199999999999996}]},{"osd":7,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.97799999999999998,"15min":1.046},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":4.0700000000000003,"5min":5.5490000000000004,"15min":7.1909999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.339,"5min":1.0389999999999999,"15min":1.1040000000000001},"min":{"1min":0.443,"5min":0.37,"15min":0.37},"max":{"1min":4.2549999999999999,"5min":5.508,"15min":6.7629999999999999},"last":1.079}]}]},{"osd":4,"up_from":13,"seq":55834581089,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1140916,"kb_used_data":492,"kb_used_omap":10283,"kb_used_meta":1130132,"kb_avail":93230924,"statfs":{"total":96636764160,"available":95468466176,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10530010,"internal_metadata":1157255974},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":5.2889999999999997,"5min":6.4199999999999999,"15min":11.731},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1,"15min":0.997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.4930000000000003,"5min":10.221,"15min":10.221},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.94599999999999995,"15min":1.9179999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29699999999999999},"max":{"1min":10.135999999999999,"5min":10.135999999999999,"15min":227.46199999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.25,"15min":2.0510000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":227.56100000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":1.3819999999999999,"15min":1.351},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32000000000000001},"max":{"1min":12.827999999999999,"5min":12.827999999999999,"15min":13.026999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.24},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":5.9160000000000004,"5min":7.0830000000000002,"15min":8.8719999999999999},"last":0.874}]},{"osd":3,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2669999999999999,"15min":1.1779999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33100000000000002},"max":{"1min":4.5899999999999999,"5min":10.183999999999999,"15min":10.183999999999999},"last":0.504},{"interface":"front","average":{"1min":1.524,"5min":1.282,"15min":1.321},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":10.173,"5min":10.173,"15min":10.677},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":6.944},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":0.97899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.8120000000000003,"5min":10.256,"15min":10.256},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1200000000000001,"15min":1.052},"min":{"1min":0.47999999999999998,"5min":0.38800000000000001,"15min":0.28399999999999997},"max":{"1min":10.023,"5min":10.023,"15min":10.023},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.88},"min":{"1min":0.375,"5min":0.375,"15min":0.35699999999999998},"max":{"1min":1.931,"5min":3.3940000000000001,"15min":7.0350000000000001},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.1990000000000001,"15min":1.1339999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.7970000000000006,"5min":10.286,"15min":10.286},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.1240000000000001,"15min":1.0469999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33200000000000002},"max":{"1min":10.106,"5min":10.106,"15min":10.106},"last":0.97899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834581077,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1113076,"kb_used_data":492,"kb_used_omap":6752,"kb_used_meta":1105823,"kb_avail":93258764,"statfs":{"total":96636764160,"available":95496974336,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6914506,"internal_metadata":1132363318},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.4430000000000001,"15min":1.296},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.266,"5min":16.087,"15min":16.087},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2,"15min":1.2090000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.22700000000000001},"max":{"1min":10.127000000000001,"5min":10.127000000000001,"15min":12.468999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"max":{"1min":2.169,"5min":8.1029999999999998,"15min":10.978999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.3720000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":6.7290000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":0.96599999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.357,"15min":1.3100000000000001},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.27100000000000002},"max":{"1min":3.1850000000000001,"5min":8.5549999999999997,"15min":17.588999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":3.0710000000000002,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.28399999999999997},"max":{"1min":25.882999999999999,"5min":25.882999999999999,"15min":25.882999999999999},"last":1.0609999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.258,"15min":1.1970000000000001},"min":{"1min":0.42899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.3890000000000002,"5min":9.0340000000000007,"15min":12.401999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":3.0329999999999999,"5min":1.5569999999999999,"15min":1.3029999999999999},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":38.222000000000001,"5min":38.222000000000001,"15min":38.222000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":1.5189999999999999,"15min":1.401},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.35499999999999998},"max":{"1min":25.931000000000001,"5min":25.931000000000001,"15min":25.931000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.6160000000000001,"15min":1.524},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.214,"5min":28.010000000000002,"15min":28.010000000000002},"last":1.4059999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":1.772,"15min":1.498},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36599999999999999},"max":{"1min":48.582000000000001,"5min":48.582000000000001,"15min":48.582000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":5.3490000000000002,"5min":2.0459999999999998,"15min":1.657},"min":{"1min":0.624,"5min":0.501,"15min":0.40799999999999997},"max":{"1min":68.367000000000004,"5min":68.367000000000004,"15min":68.367000000000004},"last":1.363}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.72,"15min":1.552},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5630000000000002,"5min":8.9730000000000008,"15min":12.48},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.29,"15min":1.4330000000000001},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.4279999999999999,"5min":8.25,"15min":13.292999999999999},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834581079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1011444,"kb_used_data":492,"kb_used_omap":3682,"kb_used_meta":1007261,"kb_avail":93360396,"statfs":{"total":96636764160,"available":95601045504,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3770422,"internal_metadata":1031436234},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.75900000000000001,"15min":1.1299999999999999},"min":{"1min":0.26900000000000002,"5min":0.218,"15min":0.216},"max":{"1min":0.93999999999999995,"5min":8.5359999999999996,"15min":42.659999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.7689999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.7300000000000004,"5min":14.984999999999999,"15min":41.613999999999997},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.998,"15min":1.3120000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.8029999999999999,"5min":8.859,"15min":11.391},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.4199999999999999,"15min":1.5649999999999999},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.8970000000000002,"5min":14.401999999999999,"15min":14.401999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.819,"5min":1.5960000000000001,"15min":1.5660000000000001},"min":{"1min":0.35599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7270000000000003,"5min":17.779,"15min":41.917000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.306,"5min":1.05,"15min":1.4350000000000001},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":7.4039999999999999,"5min":7.4039999999999999,"15min":42.578000000000003},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97799999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":5.9790000000000001,"5min":6.5069999999999997,"15min":7.9699999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.999,"5min":1.1819999999999999,"15min":1.391},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.8179999999999996,"5min":7.0430000000000001,"15min":10.009},"last":1.123}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.2929999999999999,"15min":1.298},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":6.0069999999999997,"5min":10.605,"15min":10.605},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1439999999999999,"15min":1.179},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33000000000000002},"max":{"1min":5.7939999999999996,"5min":6.5449999999999999,"15min":7.9160000000000004},"last":1.0269999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.264,"15min":1.4730000000000001},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"max":{"1min":6.8520000000000003,"5min":7.1609999999999996,"15min":9.9819999999999993},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.806,"5min":1.373,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.35,"5min":10.645,"15min":13.244999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.4650000000000001,"15min":1.5149999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":14.59,"5min":14.59,"15min":14.59},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.599,"5min":1.4350000000000001,"15min":1.4630000000000001},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.438},"max":{"1min":5.9560000000000004,"5min":11.401,"15min":11.401},"last":1.2090000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581082,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088756,"kb_used_data":492,"kb_used_omap":6199,"kb_used_meta":1082056,"kb_avail":93283084,"statfs":{"total":96636764160,"available":95521878016,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6348278,"internal_metadata":1108025866},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.0800000000000001,"15min":0.88900000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":11.808999999999999,"5min":11.808999999999999,"15min":14.096},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.202,"15min":1.5580000000000001},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.073,"5min":7.468,"15min":14.414999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":1.492,"15min":1.2030000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":2.5070000000000001,"5min":1.6759999999999999,"15min":1.552},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":0.84599999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:30 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":1.0389999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":1.806,"15min":1.589},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.27500000000000002},"max":{"1min":11.835000000000001,"5min":11.835000000000001,"15min":15.206},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.228,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.08,"5min":12.08,"15min":12.08},"last":0.90200000000000002},{"interface":"front","average":{"1min":4.1189999999999998,"5min":1.853,"15min":1.5680000000000001},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":40.874000000000002,"5min":40.874000000000002,"15min":40.874000000000002},"last":1.2390000000000001}]},{"osd":5,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.6759999999999999,"15min":1.452},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.901,"5min":11.901,"15min":15.260999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":2.5259999999999998,"5min":1.6020000000000001,"15min":1.2989999999999999},"min":{"1min":0.61199999999999999,"5min":0.45700000000000002,"15min":0.375},"max":{"1min":14.613,"5min":14.613,"15min":14.613},"last":1.0069999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":1.8919999999999999,"15min":1.7},"min":{"1min":0.46000000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":11.968999999999999,"5min":11.968999999999999,"15min":15.295999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.581,"15min":1.298},"min":{"1min":0.627,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":12.144,"5min":12.144,"15min":12.144},"last":1.0649999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.631,"15min":1.627},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.9890000000000001,"5min":1.839,"15min":1.7370000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.936999999999999,"5min":12.363,"15min":15.33},"last":0.92400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834581078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660728,"kb_used_data":1072,"kb_used_omap":5377,"kb_used_meta":654270,"kb_avail":93711112,"statfs":{"total":96636764160,"available":95960178688,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5506796,"internal_metadata":669972756},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":2.2549999999999999,"5min":15.766999999999999,"15min":15.766999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.91300000000000003,"15min":1.0980000000000001},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":1.548,"5min":15.926,"15min":15.926},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.087,"15min":1.129},"min":{"1min":0.26500000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":10.250999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.137,"15min":1.2869999999999999},"min":{"1min":0.28699999999999998,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":3.0640000000000001,"5min":10.025,"15min":12.134},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":1.3799999999999999,"15min":1.5820000000000001},"min":{"1min":0.32900000000000001,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":2.4630000000000001,"5min":9.8330000000000002,"15min":30.591999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.3049999999999999,"15min":1.5649999999999999},"min":{"1min":0.32400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.056,"5min":15.707000000000001,"15min":32.085000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":1.111,"15min":1.1890000000000001},"min":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.508,"5min":6.2999999999999998,"15min":18.071000000000002},"last":1.095},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.879,"15min":1.0349999999999999},"min":{"1min":0.40799999999999997,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":6.2359999999999998,"15min":8.8149999999999995},"last":1.079}]},{"osd":5,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.99199999999999999,"15min":1.238},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":3.2890000000000001,"5min":7.7690000000000001,"15min":8.8580000000000005},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.208,"15min":1.319},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":4.819,"5min":6.3419999999999996,"15min":17.975999999999999},"last":0.995}]},{"osd":6,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.214,"15min":1.246},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.35299999999999998},"max":{"1min":5.4989999999999997,"5min":10.324999999999999,"15min":10.324999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.2609999999999999,"15min":1.339},"min":{"1min":0.433,"5min":0.41599999999999998,"15min":0.39200000000000002},"max":{"1min":4.7800000000000002,"5min":10.792,"15min":13.109},"last":1.135}]},{"osd":7,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.282,"15min":1.391},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":2.02,"5min":7.8440000000000003,"15min":8.8309999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.173,"5min":1.45,"15min":1.403},"min":{"1min":0.52000000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":4.9939999999999998,"5min":6.3769999999999998,"15min":18.039000000000001},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-22T01:34:00.908 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-22T01:34:00.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-22T01:34:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 Processor -- start 2023-05-22T01:34:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 -- start start 2023-05-22T01:34:01.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40cf240 con 0x7f50a4070a60 2023-05-22T01:34:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40cb450 con 0x7f50a40d06a0 2023-05-22T01:34:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40cd4d0 con 0x7f50a40b6230 2023-05-22T01:34:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a37fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f50a4070a60 0x7f50a40b00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49220/0 (socket says 172.21.15.46:49220) 2023-05-22T01:34:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a37fe700 1 -- 172.21.15.46:0/966335952 learned_addr learned my addr 172.21.15.46:0/966335952 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a2ffd700 1 --2- 172.21.15.46:0/966335952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a1ffb700 1 -- 172.21.15.46:0/966335952 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247325439 0 0) 0x7f50a40cf240 con 0x7f50a4070a60 2023-05-22T01:34:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a1ffb700 1 -- 172.21.15.46:0/966335952 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f508c0035d0 con 0x7f50a4070a60 2023-05-22T01:34:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a2ffd700 1 -- 172.21.15.46:0/966335952 >> v1:172.21.15.142:6789/0 conn(0x7f50a40d06a0 legacy=0x7f50a4070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a2ffd700 1 -- 172.21.15.46:0/966335952 >> v1:172.21.15.46:6789/0 conn(0x7f50a4070a60 legacy=0x7f50a40b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a2ffd700 1 -- 172.21.15.46:0/966335952 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40cb730 con 0x7f50a40b6230 2023-05-22T01:34:01.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a2ffd700 1 --2- 172.21.15.46:0/966335952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40ccda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5094009880 tx=0x7f5094009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a54b820feb647f5e server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:01.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a1ffb700 1 -- 172.21.15.46:0/966335952 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094011830 con 0x7f50a40b6230 2023-05-22T01:34:01.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a1ffb700 1 -- 172.21.15.46:0/966335952 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094011990 con 0x7f50a40b6230 2023-05-22T01:34:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a1ffb700 1 -- 172.21.15.46:0/966335952 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094011d00 con 0x7f50a40b6230 2023-05-22T01:34:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 -- 172.21.15.46:0/966335952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 msgr2=0x7f50a40ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.058+0000 7f50a3fff700 1 --2- 172.21.15.46:0/966335952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40ccda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5094009880 tx=0x7f5094009b90 comp rx=0 tx=0).stop 2023-05-22T01:34:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- 172.21.15.46:0/966335952 shutdown_connections 2023-05-22T01:34:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 --2- 172.21.15.46:0/966335952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40ccda0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- 172.21.15.46:0/966335952 >> 172.21.15.46:0/966335952 conn(0x7f50a40d0c60 msgr2=0x7f50a40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- 172.21.15.46:0/966335952 shutdown_connections 2023-05-22T01:34:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- 172.21.15.46:0/966335952 wait complete. 2023-05-22T01:34:01.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 Processor -- start 2023-05-22T01:34:01.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- start start 2023-05-22T01:34:01.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 0x7f50a4152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50a40d06a0 0x7f50a41e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c8eb0 con 0x7f50a4070a60 2023-05-22T01:34:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c9190 con 0x7f50a40d06a0 2023-05-22T01:34:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a3fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c9470 con 0x7f50a40b6230 2023-05-22T01:34:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 0x7f50a4152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 0x7f50a4152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43112/0 (socket says 172.21.15.46:43112) 2023-05-22T01:34:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 -- 172.21.15.46:0/151111794 learned_addr learned my addr 172.21.15.46:0/151111794 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a27fc700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a37fe700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50a40d06a0 0x7f50a41e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 -- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 msgr2=0x7f50a40c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 -- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50a40d06a0 msgr2=0x7f50a41e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50a40d06a0 0x7f50a41e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 -- 172.21.15.46:0/151111794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940094b0 con 0x7f50a4070a60 2023-05-22T01:34:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a37fe700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50a40d06a0 0x7f50a41e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.062+0000 7f50a2ffd700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 0x7f50a4152c40 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f5094013040 tx=0x7f5094004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940036c0 con 0x7f50a4070a60 2023-05-22T01:34:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094003820 con 0x7f50a4070a60 2023-05-22T01:34:01.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a40b24f0 con 0x7f50a4070a60 2023-05-22T01:34:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094003bd0 con 0x7f50a4070a60 2023-05-22T01:34:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a40cf490 con 0x7f50a4070a60 2023-05-22T01:34:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a40b6600 con 0x7f50a4070a60 2023-05-22T01:34:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5094003d30 con 0x7f50a4070a60 2023-05-22T01:34:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f508b7fe700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50900662f0 0x7f50900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f50a27fc700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50900662f0 0x7f50900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5094084f90 con 0x7f50a4070a60 2023-05-22T01:34:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.066+0000 7f50a27fc700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50900662f0 0x7f50900687a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f50a41e5a60 tx=0x7f5098009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.074+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f50940b56f0 con 0x7f50a4070a60 2023-05-22T01:34:01.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.234+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50a4067ac0 con 0x7f50900662f0 2023-05-22T01:34:01.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.234+0000 7f508b7fe700 1 -- 172.21.15.46:0/151111794 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71111 (secure 0 0 0) 0x7f50a4067ac0 con 0x7f50900662f0 2023-05-22T01:34:01.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:01.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50900662f0 msgr2=0x7f50900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50900662f0 0x7f50900687a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f50a41e5a60 tx=0x7f5098009040 comp rx=0 tx=0).stop 2023-05-22T01:34:01.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 msgr2=0x7f50a4152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 0x7f50a4152c40 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f5094013040 tx=0x7f5094004770 comp rx=0 tx=0).stop 2023-05-22T01:34:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 shutdown_connections 2023-05-22T01:34:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f50900662f0 0x7f50900687a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50a40d06a0 0x7f50a41e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50a40b6230 0x7f50a40c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 --2- 172.21.15.46:0/151111794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50a4070a60 0x7f50a4152c40 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 >> 172.21.15.46:0/151111794 conn(0x7f50a40d0c60 msgr2=0x7f50a40b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 shutdown_connections 2023-05-22T01:34:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.238+0000 7f50a3fff700 1 -- 172.21.15.46:0/151111794 wait complete. 2023-05-22T01:34:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-22T01:34:01.291 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":15628,"stamp":"2023-05-22T01:34:00.013816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8141864,"kb_used_data":5096,"kb_used_omap":47479,"kb_used_meta":8089224,"kb_avail":746832856,"statfs":{"total":773094113280,"available":764756844544,"internally_reserved":0,"allocated":5218304,"data_stored":2873120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48619470,"internal_metadata":8283365426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"1.0","version":"40'161","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945351+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-22T01:33:38.945351+0000","last_peered":"2023-05-22T01:33:38.945351+0000","last_clean":"2023-05-22T01:33:38.945351+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-22T01:33:38.945351+0000","last_undegraded":"2023-05-22T01:33:38.945351+0000","last_fullsized":"2023-05-22T01:33:38.945351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:51:17.569979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.073441+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-22T01:33:38.073441+0000","last_peered":"2023-05-22T01:33:38.073441+0000","last_clean":"2023-05-22T01:33:38.073441+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-22T01:33:38.073441+0000","last_undegraded":"2023-05-22T01:33:38.073441+0000","last_fullsized":"2023-05-22T01:33:38.073441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:26:33.334567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.942345+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-22T01:33:38.942345+0000","last_peered":"2023-05-22T01:33:38.942345+0000","last_clean":"2023-05-22T01:33:38.942345+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-22T01:33:38.942345+0000","last_undegraded":"2023-05-22T01:33:38.942345+0000","last_fullsized":"2023-05-22T01:33:38.942345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:15:27.801927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":299,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.573891+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-22T01:33:37.573891+0000","last_peered":"2023-05-22T01:33:37.573891+0000","last_clean":"2023-05-22T01:33:37.573891+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-22T01:33:37.573891+0000","last_undegraded":"2023-05-22T01:33:37.573891+0000","last_fullsized":"2023-05-22T01:33:37.573891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:31:00.057381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.653638+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-22T01:33:37.653638+0000","last_peered":"2023-05-22T01:33:37.653638+0000","last_clean":"2023-05-22T01:33:37.653638+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-22T01:33:37.653638+0000","last_undegraded":"2023-05-22T01:33:37.653638+0000","last_fullsized":"2023-05-22T01:33:37.653638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:54:43.079830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":301,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.006672+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-22T01:33:38.006672+0000","last_peered":"2023-05-22T01:33:38.006672+0000","last_clean":"2023-05-22T01:33:38.006672+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-22T01:33:38.006672+0000","last_undegraded":"2023-05-22T01:33:38.006672+0000","last_fullsized":"2023-05-22T01:33:38.006672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:37:00.564053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945172+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-22T01:33:38.945172+0000","last_peered":"2023-05-22T01:33:38.945172+0000","last_clean":"2023-05-22T01:33:38.945172+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-22T01:33:38.945172+0000","last_undegraded":"2023-05-22T01:33:38.945172+0000","last_fullsized":"2023-05-22T01:33:38.945172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:25:24.904929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":293,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.009841+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-22T01:33:38.009841+0000","last_peered":"2023-05-22T01:33:38.009841+0000","last_clean":"2023-05-22T01:33:38.009841+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-22T01:33:38.009841+0000","last_undegraded":"2023-05-22T01:33:38.009841+0000","last_fullsized":"2023-05-22T01:33:38.009841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T04:49:30.801377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.742907+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-22T01:33:38.742907+0000","last_peered":"2023-05-22T01:33:38.742907+0000","last_clean":"2023-05-22T01:33:38.742907+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-22T01:33:38.742907+0000","last_undegraded":"2023-05-22T01:33:38.742907+0000","last_fullsized":"2023-05-22T01:33:38.742907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:00:13.169152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581088,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119864,"kb_used_data":1072,"kb_used_omap":3881,"kb_used_meta":1114902,"kb_avail":93251976,"statfs":{"total":96636764160,"available":95490023424,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3974582,"internal_metadata":1141660234},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.85899999999999999,"15min":0.95799999999999996},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":5.9900000000000002,"5min":5.9900000000000002,"15min":8.157},"last":0.745},{"interface":"front","average":{"1min":1.288,"5min":0.81899999999999995,"15min":0.872},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":6.1230000000000002,"5min":6.6349999999999998,"15min":6.7430000000000003},"last":0.80700000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":0.94999999999999996,"15min":0.95699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28899999999999998},"max":{"1min":14.869,"5min":14.869,"15min":14.869},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.8109999999999999,"5min":1.274,"15min":1.21},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":14.644,"5min":14.644,"15min":14.644},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1910000000000001,"15min":1.1899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30599999999999999},"max":{"1min":4.0519999999999996,"5min":9.8300000000000001,"15min":9.8300000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.139,"15min":1.095},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":6.1660000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":1.01}]},{"osd":3,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0980000000000001,"15min":1.145},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.32900000000000001},"max":{"1min":3.1150000000000002,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.766,"5min":1.159,"15min":1.3120000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":8.9600000000000009,"5min":8.9600000000000009,"15min":10.041},"last":1.0449999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.78700000000000003,"15min":0.873},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":6.0330000000000004,"5min":6.5339999999999998,"15min":8.5380000000000003},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.202,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.318},"max":{"1min":6.1059999999999999,"5min":6.7610000000000001,"15min":6.7610000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.96699999999999997,"15min":0.96099999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":4.1340000000000003,"5min":6.2670000000000003,"15min":7.931},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.1739999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.91200000000000003,"15min":1.0109999999999999},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.36499999999999999},"max":{"1min":6.133,"5min":6.6600000000000001,"15min":6.8179999999999996},"last":1.2929999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":2.9180000000000001,"5min":6.8090000000000002,"15min":8.0760000000000005},"last":1.1120000000000001}]}]},{"osd":6,"up_from":13,"seq":55834581088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838900,"kb_used_data":492,"kb_used_omap":4141,"kb_used_meta":834258,"kb_avail":93532940,"statfs":{"total":96636764160,"available":95777730560,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4241217,"internal_metadata":854280383},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.633,"15min":1.048},"min":{"1min":0.27700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.721,"5min":54.807000000000002,"15min":54.807000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":2.661,"5min":1.9219999999999999,"15min":1.3029999999999999},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":13.321999999999999,"5min":54.838999999999999,"15min":54.838999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.1699999999999999,"15min":1.105},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":6.6050000000000004,"5min":8.7699999999999996,"15min":8.7699999999999996},"last":0.623},{"interface":"front","average":{"1min":2.6349999999999998,"5min":1.468,"15min":1.2869999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":31.484999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":0.99099999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.369,"15min":1.3069999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":14.484,"5min":14.484,"15min":14.484},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.238,"15min":1.218},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":6.6360000000000001,"5min":8.8719999999999999,"15min":9.3499999999999996},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":2.1299999999999999,"15min":1.5940000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":5.7649999999999997,"5min":55.756999999999998,"15min":55.756999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.7110000000000001,"15min":1.3240000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.319,"5min":54.451999999999998,"15min":54.451999999999998},"last":0.749}]},{"osd":4,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0920000000000001,"15min":1.0129999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0920000000000005,"5min":9.8879999999999999,"15min":9.8879999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.0289999999999999,"5min":1.246,"15min":1.095},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.92800000000000005,"15min":0.99299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":3.7570000000000001,"5min":5.601,"15min":7.6219999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.135,"15min":1.1950000000000001},"min":{"1min":0.48299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":9.7249999999999996,"5min":9.7249999999999996,"15min":9.7249999999999996},"last":0.92300000000000004}]},{"osd":7,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.171,"15min":1.0529999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36899999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":1.103},{"interface":"front","average":{"1min":1.248,"5min":1.1279999999999999,"15min":1.0609999999999999},"min":{"1min":0.46600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.1920000000000002,"5min":7.1920000000000002,"15min":7.1920000000000002},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834581089,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1168180,"kb_used_data":492,"kb_used_omap":7161,"kb_used_meta":1160518,"kb_avail":93203660,"statfs":{"total":96636764160,"available":95440547840,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7333659,"internal_metadata":1188370661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.2210000000000001,"15min":1.0309999999999999},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.23599999999999999},"max":{"1min":26.170999999999999,"5min":26.170999999999999,"15min":26.170999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":2.359,"5min":1.23,"15min":1.1120000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":25.670000000000002,"5min":25.670000000000002,"15min":25.670000000000002},"last":0.76500000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.145,"15min":1.23},"min":{"1min":0.33400000000000002,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":2.677,"5min":6.5579999999999998,"15min":11.092000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.2609999999999999,"15min":1.2250000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.2300000000000004,"5min":7.6230000000000002,"15min":7.6230000000000002},"last":0.86399999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.198,"15min":1.3460000000000001},"min":{"1min":0.39500000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4050000000000002,"5min":6.6420000000000003,"15min":8.6769999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.244},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.313},"max":{"1min":5.7220000000000004,"5min":6.7610000000000001,"15min":8.7870000000000008},"last":0.91300000000000003}]},{"osd":3,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.1519999999999999,"15min":1.1910000000000001},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.9989999999999997,"5min":7.5339999999999998,"15min":7.5339999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2170000000000001,"15min":1.353},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":4.2759999999999998,"5min":7.843,"15min":9.3379999999999992},"last":0.80800000000000005}]},{"osd":4,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66500000000000004,"15min":0.80200000000000005},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.27200000000000002},"max":{"1min":1.603,"5min":4.4539999999999997,"15min":8.7579999999999991},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.85799999999999998,"15min":0.90100000000000002},"min":{"1min":0.35299999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.7450000000000001,"5min":8.2370000000000001,"15min":8.6430000000000007},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.91500000000000004,"15min":1.022},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.1849999999999996,"5min":5.1870000000000003,"15min":16.861999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.81299999999999994,"15min":0.995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.34100000000000003},"max":{"1min":3.9329999999999998,"5min":4.8479999999999999,"15min":8.7200000000000006},"last":0.83199999999999996}]},{"osd":7,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.97799999999999998,"15min":1.046},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":4.0700000000000003,"5min":5.5490000000000004,"15min":7.1909999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.339,"5min":1.0389999999999999,"15min":1.1040000000000001},"min":{"1min":0.443,"5min":0.37,"15min":0.37},"max":{"1min":4.2549999999999999,"5min":5.508,"15min":6.7629999999999999},"last":1.079}]}]},{"osd":4,"up_from":13,"seq":55834581089,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1140916,"kb_used_data":492,"kb_used_omap":10283,"kb_used_meta":1130132,"kb_avail":93230924,"statfs":{"total":96636764160,"available":95468466176,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10530010,"internal_metadata":1157255974},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":5.2889999999999997,"5min":6.4199999999999999,"15min":11.731},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1,"15min":0.997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.4930000000000003,"5min":10.221,"15min":10.221},"last":0.61199999999999999}]},{"osd":1,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.94599999999999995,"15min":1.9179999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29699999999999999},"max":{"1min":10.135999999999999,"5min":10.135999999999999,"15min":227.46199999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.25,"15min":2.0510000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":227.56100000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":1.3819999999999999,"15min":1.351},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32000000000000001},"max":{"1min":12.827999999999999,"5min":12.827999999999999,"15min":13.026999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.24},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":5.9160000000000004,"5min":7.0830000000000002,"15min":8.8719999999999999},"last":0.874}]},{"osd":3,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2669999999999999,"15min":1.1779999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33100000000000002},"max":{"1min":4.5899999999999999,"5min":10.183999999999999,"15min":10.183999999999999},"last":0.504},{"interface":"front","average":{"1min":1.524,"5min":1.282,"15min":1.321},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":10.173,"5min":10.173,"15min":10.677},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":6.944},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":0.97899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.8120000000000003,"5min":10.256,"15min":10.256},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1200000000000001,"15min":1.052},"min":{"1min":0.47999999999999998,"5min":0.38800000000000001,"15min":0.28399999999999997},"max":{"1min":10.023,"5min":10.023,"15min":10.023},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.88},"min":{"1min":0.375,"5min":0.375,"15min":0.35699999999999998},"max":{"1min":1.931,"5min":3.3940000000000001,"15min":7.0350000000000001},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.1990000000000001,"15min":1.1339999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.7970000000000006,"5min":10.286,"15min":10.286},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.1240000000000001,"15min":1.0469999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33200000000000002},"max":{"1min":10.106,"5min":10.106,"15min":10.106},"last":0.97899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834581077,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1113076,"kb_used_data":492,"kb_used_omap":6752,"kb_used_meta":1105823,"kb_avail":93258764,"statfs":{"total":96636764160,"available":95496974336,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6914506,"internal_metadata":1132363318},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.4430000000000001,"15min":1.296},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.266,"5min":16.087,"15min":16.087},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2,"15min":1.2090000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.22700000000000001},"max":{"1min":10.127000000000001,"5min":10.127000000000001,"15min":12.468999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"max":{"1min":2.169,"5min":8.1029999999999998,"15min":10.978999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.3720000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":6.7290000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":0.96599999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.357,"15min":1.3100000000000001},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.27100000000000002},"max":{"1min":3.1850000000000001,"5min":8.5549999999999997,"15min":17.588999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":3.0710000000000002,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.28399999999999997},"max":{"1min":25.882999999999999,"5min":25.882999999999999,"15min":25.882999999999999},"last":1.0609999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.258,"15min":1.1970000000000001},"min":{"1min":0.42899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.3890000000000002,"5min":9.0340000000000007,"15min":12.401999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":3.0329999999999999,"5min":1.5569999999999999,"15min":1.3029999999999999},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":38.222000000000001,"5min":38.222000000000001,"15min":38.222000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":1.5189999999999999,"15min":1.401},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.35499999999999998},"max":{"1min":25.931000000000001,"5min":25.931000000000001,"15min":25.931000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.6160000000000001,"15min":1.524},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.214,"5min":28.010000000000002,"15min":28.010000000000002},"last":1.4059999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":1.772,"15min":1.498},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36599999999999999},"max":{"1min":48.582000000000001,"5min":48.582000000000001,"15min":48.582000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":5.3490000000000002,"5min":2.0459999999999998,"15min":1.657},"min":{"1min":0.624,"5min":0.501,"15min":0.40799999999999997},"max":{"1min":68.367000000000004,"5min":68.367000000000004,"15min":68.367000000000004},"last":1.363}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.72,"15min":1.552},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5630000000000002,"5min":8.9730000000000008,"15min":12.48},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.29,"15min":1.4330000000000001},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.4279999999999999,"5min":8.25,"15min":13.292999999999999},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834581079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1011444,"kb_used_data":492,"kb_used_omap":3682,"kb_used_meta":1007261,"kb_avail":93360396,"statfs":{"total":96636764160,"available":95601045504,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3770422,"internal_metadata":1031436234},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.75900000000000001,"15min":1.1299999999999999},"min":{"1min":0.26900000000000002,"5min":0.218,"15min":0.216},"max":{"1min":0.93999999999999995,"5min":8.5359999999999996,"15min":42.659999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.7689999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.7300000000000004,"5min":14.984999999999999,"15min":41.613999999999997},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.998,"15min":1.3120000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.8029999999999999,"5min":8.859,"15min":11.391},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.4199999999999999,"15min":1.5649999999999999},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.8970000000000002,"5min":14.401999999999999,"15min":14.401999999999999},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.819,"5min":1.5960000000000001,"15min":1.5660000000000001},"min":{"1min":0.35599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7270000000000003,"5min":17.779,"15min":41.917000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.306,"5min":1.05,"15min":1.4350000000000001},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":7.4039999999999999,"5min":7.4039999999999999,"15min":42.578000000000003},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97799999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":5.9790000000000001,"5min":6.5069999999999997,"15min":7.9699999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.999,"5min":1.1819999999999999,"15min":1.391},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.8179999999999996,"5min":7.0430000000000001,"15min":10.009},"last":1.123}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.2929999999999999,"15min":1.298},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":6.0069999999999997,"5min":10.605,"15min":10.605},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1439999999999999,"15min":1.179},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33000000000000002},"max":{"1min":5.7939999999999996,"5min":6.5449999999999999,"15min":7.9160000000000004},"last":1.0269999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.264,"15min":1.4730000000000001},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"max":{"1min":6.8520000000000003,"5min":7.1609999999999996,"15min":9.9819999999999993},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.806,"5min":1.373,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.35,"5min":10.645,"15min":13.244999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.4650000000000001,"15min":1.5149999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":14.59,"5min":14.59,"15min":14.59},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.599,"5min":1.4350000000000001,"15min":1.4630000000000001},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.438},"max":{"1min":5.9560000000000004,"5min":11.401,"15min":11.401},"last":1.2090000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581082,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088756,"kb_used_data":492,"kb_used_omap":6199,"kb_used_meta":1082056,"kb_avail":93283084,"statfs":{"total":96636764160,"available":95521878016,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6348278,"internal_metadata":1108025866},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.0800000000000001,"15min":0.88900000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":11.808999999999999,"5min":11.808999999999999,"15min":14.096},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.202,"15min":1.5580000000000001},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.073,"5min":7.468,"15min":14.414999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":1.492,"15min":1.2030000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":2.5070000000000001,"5min":1.6759999999999999,"15min":1.552},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":0.84599999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:30 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":1.0389999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":1.806,"15min":1.589},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.27500000000000002},"max":{"1min":11.835000000000001,"5min":11.835000000000001,"15min":15.206},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.228,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.08,"5min":12.08,"15min":12.08},"last":0.90200000000000002},{"interface":"front","average":{"1min":4.1189999999999998,"5min":1.853,"15min":1.5680000000000001},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":40.874000000000002,"5min":40.874000000000002,"15min":40.874000000000002},"last":1.2390000000000001}]},{"osd":5,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.6759999999999999,"15min":1.452},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.901,"5min":11.901,"15min":15.260999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":2.5259999999999998,"5min":1.6020000000000001,"15min":1.2989999999999999},"min":{"1min":0.61199999999999999,"5min":0.45700000000000002,"15min":0.375},"max":{"1min":14.613,"5min":14.613,"15min":14.613},"last":1.0069999999999999}]},{"osd":6,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":1.8919999999999999,"15min":1.7},"min":{"1min":0.46000000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":11.968999999999999,"5min":11.968999999999999,"15min":15.295999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.581,"15min":1.298},"min":{"1min":0.627,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":12.144,"5min":12.144,"15min":12.144},"last":1.0649999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.631,"15min":1.627},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.9890000000000001,"5min":1.839,"15min":1.7370000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.936999999999999,"5min":12.363,"15min":15.33},"last":0.92400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834581078,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660728,"kb_used_data":1072,"kb_used_omap":5377,"kb_used_meta":654270,"kb_avail":93711112,"statfs":{"total":96636764160,"available":95960178688,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5506796,"internal_metadata":669972756},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":2.2549999999999999,"5min":15.766999999999999,"15min":15.766999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.91300000000000003,"15min":1.0980000000000001},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":1.548,"5min":15.926,"15min":15.926},"last":0.96699999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.087,"15min":1.129},"min":{"1min":0.26500000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":10.250999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":1.137,"15min":1.2869999999999999},"min":{"1min":0.28699999999999998,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":3.0640000000000001,"5min":10.025,"15min":12.134},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":1.3799999999999999,"15min":1.5820000000000001},"min":{"1min":0.32900000000000001,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":2.4630000000000001,"5min":9.8330000000000002,"15min":30.591999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":1.3049999999999999,"15min":1.5649999999999999},"min":{"1min":0.32400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.056,"5min":15.707000000000001,"15min":32.085000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":1.111,"15min":1.1890000000000001},"min":{"1min":0.34399999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.508,"5min":6.2999999999999998,"15min":18.071000000000002},"last":1.095},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.879,"15min":1.0349999999999999},"min":{"1min":0.40799999999999997,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.85699999999999998,"5min":6.2359999999999998,"15min":8.8149999999999995},"last":1.079}]},{"osd":5,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.99199999999999999,"15min":1.238},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.35999999999999999},"max":{"1min":3.2890000000000001,"5min":7.7690000000000001,"15min":8.8580000000000005},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.208,"15min":1.319},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":4.819,"5min":6.3419999999999996,"15min":17.975999999999999},"last":0.995}]},{"osd":6,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.214,"15min":1.246},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.35299999999999998},"max":{"1min":5.4989999999999997,"5min":10.324999999999999,"15min":10.324999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.2609999999999999,"15min":1.339},"min":{"1min":0.433,"5min":0.41599999999999998,"15min":0.39200000000000002},"max":{"1min":4.7800000000000002,"5min":10.792,"15min":13.109},"last":1.135}]},{"osd":7,"last update":"Mon May 22 01:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.282,"15min":1.391},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":2.02,"5min":7.8440000000000003,"15min":8.8309999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.173,"5min":1.45,"15min":1.403},"min":{"1min":0.52000000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":4.9939999999999998,"5min":6.3769999999999998,"15min":18.039000000000001},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-22T01:34:01.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-22T01:34:01.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 Processor -- start 2023-05-22T01:34:01.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- start start 2023-05-22T01:34:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe700b85b0 0x7efe700cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe701600c0 0x7efe700b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efe700b2140 0x7efe700b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7006afd0 con 0x7efe701600c0 2023-05-22T01:34:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe700cd6b0 con 0x7efe700b2140 2023-05-22T01:34:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700cd990 con 0x7efe700b85b0 2023-05-22T01:34:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe701600c0 0x7efe700b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe701600c0 0x7efe700b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43118/0 (socket says 172.21.15.46:43118) 2023-05-22T01:34:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 -- 172.21.15.46:0/3435747409 learned_addr learned my addr 172.21.15.46:0/3435747409 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe75e8f700 1 --2- 172.21.15.46:0/3435747409 >> v2:172.21.15.142:3300/0 conn(0x7efe700b2140 0x7efe700b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe7568e700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe700b85b0 0x7efe700cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 -- 172.21.15.46:0/3435747409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe700b85b0 msgr2=0x7efe700cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe700b85b0 0x7efe700cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 -- 172.21.15.46:0/3435747409 >> v2:172.21.15.142:3300/0 conn(0x7efe700b2140 msgr2=0x7efe700b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 --2- 172.21.15.46:0/3435747409 >> v2:172.21.15.142:3300/0 conn(0x7efe700b2140 0x7efe700b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 -- 172.21.15.46:0/3435747409 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7006b220 con 0x7efe701600c0 2023-05-22T01:34:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe75e8f700 1 --2- 172.21.15.46:0/3435747409 >> v2:172.21.15.142:3300/0 conn(0x7efe700b2140 0x7efe700b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-22T01:34:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe7568e700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe700b85b0 0x7efe700cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-22T01:34:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe74e8d700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe700b4940 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7efe700b1b30 tx=0x7efe60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cec03e222376ce3 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:01.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe67fff700 1 -- 172.21.15.46:0/3435747409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6000b8a0 con 0x7efe701600c0 2023-05-22T01:34:01.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe67fff700 1 -- 172.21.15.46:0/3435747409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000ba00 con 0x7efe701600c0 2023-05-22T01:34:01.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe67fff700 1 -- 172.21.15.46:0/3435747409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6000bd90 con 0x7efe701600c0 2023-05-22T01:34:01.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- 172.21.15.46:0/3435747409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 msgr2=0x7efe700b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe700b4940 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7efe700b1b30 tx=0x7efe60009bf0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- 172.21.15.46:0/3435747409 shutdown_connections 2023-05-22T01:34:01.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- 172.21.15.46:0/3435747409 >> v2:172.21.15.142:3300/0 conn(0x7efe700b2140 0x7efe700b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe700b4940 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 --2- 172.21.15.46:0/3435747409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe700b85b0 0x7efe700cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- 172.21.15.46:0/3435747409 >> 172.21.15.46:0/3435747409 conn(0x7efe7006cc00 msgr2=0x7efe700cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:01.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- 172.21.15.46:0/3435747409 shutdown_connections 2023-05-22T01:34:01.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.414+0000 7efe76690700 1 -- 172.21.15.46:0/3435747409 wait complete. 2023-05-22T01:34:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 Processor -- start 2023-05-22T01:34:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 -- start start 2023-05-22T01:34:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe700b85b0 0x7efe7015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe7015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe70155570 0x7efe7015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7015ade0 con 0x7efe701600c0 2023-05-22T01:34:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70158c30 con 0x7efe700b85b0 2023-05-22T01:34:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe70158670 con 0x7efe70155570 2023-05-22T01:34:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe7015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe7015b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43122/0 (socket says 172.21.15.46:43122) 2023-05-22T01:34:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 -- 172.21.15.46:0/4060744993 learned_addr learned my addr 172.21.15.46:0/4060744993 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:01.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe75e8f700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe70155570 0x7efe7015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe7568e700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe700b85b0 0x7efe7015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 -- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe70155570 msgr2=0x7efe7015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe70155570 0x7efe7015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 -- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe700b85b0 msgr2=0x7efe7015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe700b85b0 0x7efe7015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 -- 172.21.15.46:0/4060744993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60009570 con 0x7efe701600c0 2023-05-22T01:34:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe74e8d700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe7015b270 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7efe60000c00 tx=0x7efe60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:01.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60004520 con 0x7efe701600c0 2023-05-22T01:34:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6001e070 con 0x7efe701600c0 2023-05-22T01:34:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60012b10 con 0x7efe701600c0 2023-05-22T01:34:01.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe700b8980 con 0x7efe701600c0 2023-05-22T01:34:01.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.418+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7006b500 con 0x7efe701600c0 2023-05-22T01:34:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.422+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe700cf5b0 con 0x7efe701600c0 2023-05-22T01:34:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.422+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe60012c70 con 0x7efe701600c0 2023-05-22T01:34:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.422+0000 7efe65ffb700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efe540662f0 0x7efe540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.422+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efe60020070 con 0x7efe701600c0 2023-05-22T01:34:01.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.422+0000 7efe7568e700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efe540662f0 0x7efe540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:01.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.422+0000 7efe7568e700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efe540662f0 0x7efe540687a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7efe6c006fd0 tx=0x7efe6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:01.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.430+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efe60052c60 con 0x7efe701600c0 2023-05-22T01:34:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.590+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe70067ac0 con 0x7efe701600c0 2023-05-22T01:34:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.594+0000 7efe65ffb700 1 -- 172.21.15.46:0/4060744993 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14768 (secure 0 0 0) 0x7efe60056280 con 0x7efe701600c0 2023-05-22T01:34:01.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:01.609 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":43,"fsid":"88c6000c-747d-47ed-bada-4d7002233c90","created":"2023-05-21T16:53:53.659484+0000","modified":"2023-05-22T01:33:37.562784+0000","last_up_change":"2023-05-21T16:54:05.384461+0000","last_in_change":"2023-05-21T16:53:56.647177+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-21T16:54:06.846734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-21T16:54:12.494641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"612525d2-4128-4839-81a3-07a7bc220010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6817","nonce":2513150374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6819","nonce":2513150374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6823","nonce":2513150374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2513150374},{"type":"v1","addr":"172.21.15.46:6821","nonce":2513150374}]},"public_addr":"172.21.15.46:6817/2513150374","cluster_addr":"172.21.15.46:6819/2513150374","heartbeat_back_addr":"172.21.15.46:6823/2513150374","heartbeat_front_addr":"172.21.15.46:6821/2513150374","state":["exists","up"]},{"osd":1,"uuid":"5662b240-6b3b-40ae-881f-49d0a074d2ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6809","nonce":3939198338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6811","nonce":3939198338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6815","nonce":3939198338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3939198338},{"type":"v1","addr":"172.21.15.46:6813","nonce":3939198338}]},"public_addr":"172.21.15.46:6809/3939198338","cluster_addr":"172.21.15.46:6811/3939198338","heartbeat_back_addr":"172.21.15.46:6815/3939198338","heartbeat_front_addr":"172.21.15.46:6813/3939198338","state":["exists","up"]},{"osd":2,"uuid":"f78ffdcc-8d96-48c6-91ef-595b03771447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6801","nonce":4251490015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6803","nonce":4251490015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6807","nonce":4251490015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4251490015},{"type":"v1","addr":"172.21.15.46:6805","nonce":4251490015}]},"public_addr":"172.21.15.46:6801/4251490015","cluster_addr":"172.21.15.46:6803/4251490015","heartbeat_back_addr":"172.21.15.46:6807/4251490015","heartbeat_front_addr":"172.21.15.46:6805/4251490015","state":["exists","up"]},{"osd":3,"uuid":"925d9c07-7074-4307-aa90-a93dd351347d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6825","nonce":270588901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6827","nonce":270588901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6831","nonce":270588901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":270588901},{"type":"v1","addr":"172.21.15.46:6829","nonce":270588901}]},"public_addr":"172.21.15.46:6825/270588901","cluster_addr":"172.21.15.46:6827/270588901","heartbeat_back_addr":"172.21.15.46:6831/270588901","heartbeat_front_addr":"172.21.15.46:6829/270588901","state":["exists","up"]},{"osd":4,"uuid":"aef2c64a-58c5-4174-b23c-01559c32eca1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6809","nonce":2664279934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6811","nonce":2664279934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6817","nonce":2664279934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6813","nonce":2664279934},{"type":"v1","addr":"172.21.15.142:6814","nonce":2664279934}]},"public_addr":"172.21.15.142:6809/2664279934","cluster_addr":"172.21.15.142:6811/2664279934","heartbeat_back_addr":"172.21.15.142:6817/2664279934","heartbeat_front_addr":"172.21.15.142:6814/2664279934","state":["exists","up"]},{"osd":5,"uuid":"7feccbd7-5ab8-41f6-87ba-effa897b85e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6825","nonce":1063646432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6827","nonce":1063646432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6831","nonce":1063646432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1063646432},{"type":"v1","addr":"172.21.15.142:6829","nonce":1063646432}]},"public_addr":"172.21.15.142:6825/1063646432","cluster_addr":"172.21.15.142:6827/1063646432","heartbeat_back_addr":"172.21.15.142:6831/1063646432","heartbeat_front_addr":"172.21.15.142:6829/1063646432","state":["exists","up"]},{"osd":6,"uuid":"36309035-87b5-43fb-a1e6-55cf9efbd98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6815","nonce":2773532653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6819","nonce":2773532653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6823","nonce":2773532653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2773532653},{"type":"v1","addr":"172.21.15.142:6821","nonce":2773532653}]},"public_addr":"172.21.15.142:6815/2773532653","cluster_addr":"172.21.15.142:6819/2773532653","heartbeat_back_addr":"172.21.15.142:6823/2773532653","heartbeat_front_addr":"172.21.15.142:6821/2773532653","state":["exists","up"]},{"osd":7,"uuid":"47a415bd-8310-4b06-b089-df6f365f0ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6801","nonce":3864156149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6803","nonce":3864156149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6807","nonce":3864156149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3864156149},{"type":"v1","addr":"172.21.15.142:6805","nonce":3864156149}]},"public_addr":"172.21.15.142:6801/3864156149","cluster_addr":"172.21.15.142:6803/3864156149","heartbeat_back_addr":"172.21.15.142:6807/3864156149","heartbeat_front_addr":"172.21.15.142:6805/3864156149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.180061+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.957676+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.956891+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.204920+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.009997+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.724098+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:02.134435+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-21T16:54:01.933489+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6837/2842509941":"2023-05-23T01:33:33.539004+0000","172.21.15.46:6836/2842509941":"2023-05-23T01:33:33.539004+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-22T01:34:01.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.594+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efe540662f0 msgr2=0x7efe540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.594+0000 7efe76690700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efe540662f0 0x7efe540687a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7efe6c006fd0 tx=0x7efe6c008040 comp rx=0 tx=0).stop 2023-05-22T01:34:01.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.594+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 msgr2=0x7efe7015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:01.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.594+0000 7efe76690700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe7015b270 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7efe60000c00 tx=0x7efe60004770 comp rx=0 tx=0).stop 2023-05-22T01:34:01.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 shutdown_connections 2023-05-22T01:34:01.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7efe540662f0 0x7efe540687a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe70155570 0x7efe7015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe701600c0 0x7efe7015b270 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 --2- 172.21.15.46:0/4060744993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe700b85b0 0x7efe7015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:01.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 >> 172.21.15.46:0/4060744993 conn(0x7efe700b2140 msgr2=0x7efe700b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:01.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 shutdown_connections 2023-05-22T01:34:01.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:01.598+0000 7efe76690700 1 -- 172.21.15.46:0/4060744993 wait complete. 2023-05-22T01:34:02.642 INFO:tasks.ceph:Scrubbing osd.0 2023-05-22T01:34:02.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:02.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.794+0000 7f1318943700 1 Processor -- start 2023-05-22T01:34:02.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.794+0000 7f1318943700 1 -- start start 2023-05-22T01:34:02.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140aec10 0x7f131415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13140cbc10 0x7f13140cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131415aca0 con 0x7f131415a8d0 2023-05-22T01:34:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13140cb7f0 con 0x7f13140cbc10 2023-05-22T01:34:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13140ca520 con 0x7f13140aec10 2023-05-22T01:34:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13140cbc10 0x7f13140cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f13140cbc10 0x7f13140cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43124/0 (socket says 172.21.15.46:43124) 2023-05-22T01:34:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 -- 172.21.15.46:0/2783292719 learned_addr learned my addr 172.21.15.46:0/2783292719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131259c700 1 --2- 172.21.15.46:0/2783292719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140aec10 0x7f131415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 -- 172.21.15.46:0/2783292719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140aec10 msgr2=0x7f131415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 --2- 172.21.15.46:0/2783292719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140aec10 0x7f131415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 -- 172.21.15.46:0/2783292719 >> v1:172.21.15.142:6789/0 conn(0x7f131415a8d0 legacy=0x7f131415e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 -- 172.21.15.46:0/2783292719 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140cab70 con 0x7f13140cbc10 2023-05-22T01:34:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f131359e700 1 --2- 172.21.15.46:0/2783292719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13140cbc10 0x7f13140cc090 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f130c009e50 tx=0x7f130c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3a2a622a81be31 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1311d9b700 1 -- 172.21.15.46:0/2783292719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00e070 con 0x7f13140cbc10 2023-05-22T01:34:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1311d9b700 1 -- 172.21.15.46:0/2783292719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00b910 con 0x7f13140cbc10 2023-05-22T01:34:02.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1311d9b700 1 -- 172.21.15.46:0/2783292719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00bcc0 con 0x7f13140cbc10 2023-05-22T01:34:02.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- 172.21.15.46:0/2783292719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13140cbc10 msgr2=0x7f13140cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 --2- 172.21.15.46:0/2783292719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13140cbc10 0x7f13140cc090 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f130c009e50 tx=0x7f130c00b330 comp rx=0 tx=0).stop 2023-05-22T01:34:02.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- 172.21.15.46:0/2783292719 shutdown_connections 2023-05-22T01:34:02.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 --2- 172.21.15.46:0/2783292719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13140cbc10 0x7f13140cc090 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 --2- 172.21.15.46:0/2783292719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140aec10 0x7f131415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- 172.21.15.46:0/2783292719 >> 172.21.15.46:0/2783292719 conn(0x7f131406d930 msgr2=0x7f131406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:02.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- 172.21.15.46:0/2783292719 shutdown_connections 2023-05-22T01:34:02.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.798+0000 7f1318943700 1 -- 172.21.15.46:0/2783292719 wait complete. 2023-05-22T01:34:02.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 Processor -- start 2023-05-22T01:34:02.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 -- start start 2023-05-22T01:34:02.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13140aec10 0x7f13140c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140cbc10 0x7f13140b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131415a8d0 0x7f131415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131415dad0 con 0x7f131415a8d0 2023-05-22T01:34:02.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141f1230 con 0x7f13140aec10 2023-05-22T01:34:02.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13141f06b0 con 0x7f13140cbc10 2023-05-22T01:34:02.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131415a8d0 0x7f131415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131415a8d0 0x7f131415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43138/0 (socket says 172.21.15.46:43138) 2023-05-22T01:34:02.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 -- 172.21.15.46:0/175372827 learned_addr learned my addr 172.21.15.46:0/175372827 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:02.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1312d9d700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13140aec10 0x7f13140c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131259c700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140cbc10 0x7f13140b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 -- 172.21.15.46:0/175372827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140cbc10 msgr2=0x7f13140b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13140cbc10 0x7f13140b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 -- 172.21.15.46:0/175372827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13140aec10 msgr2=0x7f13140c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13140aec10 0x7f13140c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 -- 172.21.15.46:0/175372827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009b30 con 0x7f131415a8d0 2023-05-22T01:34:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f131359e700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131415a8d0 0x7f131415b0a0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f131406f4c0 tx=0x7f130c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0047c0 con 0x7f131415a8d0 2023-05-22T01:34:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c004940 con 0x7f131415a8d0 2023-05-22T01:34:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13140cb130 con 0x7f131415a8d0 2023-05-22T01:34:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c01c680 con 0x7f131415a8d0 2023-05-22T01:34:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.802+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13140cae50 con 0x7f131415a8d0 2023-05-22T01:34:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13140cb410 con 0x7f131415a8d0 2023-05-22T01:34:02.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f130c01c7e0 con 0x7f131415a8d0 2023-05-22T01:34:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f12fb7fe700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f13000662f0 0x7f13000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f130c085580 con 0x7f131415a8d0 2023-05-22T01:34:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f1312d9d700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f13000662f0 0x7f13000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f12fb7fe700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f130006c760 0x7f130006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 --> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f130006f220 con 0x7f130006c760 2023-05-22T01:34:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f130c087c20 con 0x7f131415a8d0 2023-05-22T01:34:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f131259c700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f130006c760 0x7f130006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f1312d9d700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f13000662f0 0x7f13000687a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f1304000f60 tx=0x7f1304009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.806+0000 7f131259c700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f130006c760 0x7f130006eb70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:02.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.810+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== osd.0 v2:172.21.15.46:6816/2513150374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f130006f220 con 0x7f130006c760 2023-05-22T01:34:02.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 --> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13141f0aa0 con 0x7f130006c760 2023-05-22T01:34:02.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f12fb7fe700 1 -- 172.21.15.46:0/175372827 <== osd.0 v2:172.21.15.46:6816/2513150374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f13141f0aa0 con 0x7f130006c760 2023-05-22T01:34:02.849 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:02.849 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:02.850 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:02.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f130006c760 msgr2=0x7f130006eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6816/2513150374,v1:172.21.15.46:6817/2513150374] conn(0x7f130006c760 0x7f130006eb70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f13000662f0 msgr2=0x7f13000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f13000662f0 0x7f13000687a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f1304000f60 tx=0x7f1304009040 comp rx=0 tx=0).stop 2023-05-22T01:34:02.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131415a8d0 msgr2=0x7f131415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 --2- 172.21.15.46:0/175372827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f131415a8d0 0x7f131415b0a0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f131406f4c0 tx=0x7f130c004af0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f131359e700 1 -- 172.21.15.46:0/175372827 reap_dead start 2023-05-22T01:34:02.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 shutdown_connections 2023-05-22T01:34:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 >> 172.21.15.46:0/175372827 conn(0x7f131406d930 msgr2=0x7f13140af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 shutdown_connections 2023-05-22T01:34:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.826+0000 7f1318943700 1 -- 172.21.15.46:0/175372827 wait complete. 2023-05-22T01:34:02.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-05-22T01:34:02.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.966+0000 7fdba759e700 1 Processor -- start 2023-05-22T01:34:02.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.966+0000 7fdba759e700 1 -- start start 2023-05-22T01:34:02.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdba80b85b0 0x7fdba80cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba81600c0 0x7fdba80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:02.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba806afd0 con 0x7fdba80b2140 2023-05-22T01:34:02.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80cd6b0 con 0x7fdba80b85b0 2023-05-22T01:34:02.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80cd990 con 0x7fdba81600c0 2023-05-22T01:34:02.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba659c700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdba80b85b0 0x7fdba80cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba6d9d700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdba80b2140 0x7fdba8069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49232/0 (socket says 172.21.15.46:49232) 2023-05-22T01:34:02.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba6d9d700 1 -- 172.21.15.46:0/1036860806 learned_addr learned my addr 172.21.15.46:0/1036860806 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:02.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba5d9b700 1 --2- 172.21.15.46:0/1036860806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba81600c0 0x7fdba80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:02.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba659c700 1 -- 172.21.15.46:0/1036860806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba81600c0 msgr2=0x7fdba80b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:02.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba659c700 1 --2- 172.21.15.46:0/1036860806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba81600c0 0x7fdba80b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:02.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba659c700 1 -- 172.21.15.46:0/1036860806 >> v1:172.21.15.46:6789/0 conn(0x7fdba80b2140 legacy=0x7fdba8069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:02.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba659c700 1 -- 172.21.15.46:0/1036860806 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba806b220 con 0x7fdba80b85b0 2023-05-22T01:34:02.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba659c700 1 --2- 172.21.15.46:0/1036860806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b85b0 0x7fdba80cf070 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009850 tx=0x7fdb98009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8228e18e0b3f2e1a server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:02.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba559a700 1 -- 172.21.15.46:0/1036860806 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98011830 con 0x7fdba80b85b0 2023-05-22T01:34:02.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba559a700 1 -- 172.21.15.46:0/1036860806 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98011990 con 0x7fdba80b85b0 2023-05-22T01:34:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba559a700 1 -- 172.21.15.46:0/1036860806 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98011d20 con 0x7fdba80b85b0 2023-05-22T01:34:03.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- 172.21.15.46:0/1036860806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b85b0 msgr2=0x7fdba80cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 --2- 172.21.15.46:0/1036860806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b85b0 0x7fdba80cf070 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009850 tx=0x7fdb98009b60 comp rx=0 tx=0).stop 2023-05-22T01:34:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- 172.21.15.46:0/1036860806 shutdown_connections 2023-05-22T01:34:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 --2- 172.21.15.46:0/1036860806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba81600c0 0x7fdba80b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 --2- 172.21.15.46:0/1036860806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b85b0 0x7fdba80cf070 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- 172.21.15.46:0/1036860806 >> 172.21.15.46:0/1036860806 conn(0x7fdba806cc00 msgr2=0x7fdba80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- 172.21.15.46:0/1036860806 shutdown_connections 2023-05-22T01:34:03.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.970+0000 7fdba759e700 1 -- 172.21.15.46:0/1036860806 wait complete. 2023-05-22T01:34:03.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 Processor -- start 2023-05-22T01:34:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 -- start start 2023-05-22T01:34:03.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba80b85b0 0x7fdba80d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba81600c0 0x7fdba80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 0x7fdba81541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80d31c0 con 0x7fdba80b3f50 2023-05-22T01:34:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80d35e0 con 0x7fdba81600c0 2023-05-22T01:34:03.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80d2540 con 0x7fdba80b85b0 2023-05-22T01:34:03.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 0x7fdba81541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 0x7fdba81541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43148/0 (socket says 172.21.15.46:43148) 2023-05-22T01:34:03.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 -- 172.21.15.46:0/1836957316 learned_addr learned my addr 172.21.15.46:0/1836957316 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:03.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba659c700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba80b85b0 0x7fdba80d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba5d9b700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba81600c0 0x7fdba80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 -- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba80b85b0 msgr2=0x7fdba80d1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba80b85b0 0x7fdba80d1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 -- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba81600c0 msgr2=0x7fdba80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba81600c0 0x7fdba80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 -- 172.21.15.46:0/1836957316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980094b0 con 0x7fdba80b3f50 2023-05-22T01:34:03.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba659c700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba80b85b0 0x7fdba80d1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:03.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba6d9d700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 0x7fdba81541e0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fdba000caf0 tx=0x7fdba000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000a7f0 con 0x7fdba80b3f50 2023-05-22T01:34:03.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000a950 con 0x7fdba80b3f50 2023-05-22T01:34:03.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba80b8980 con 0x7fdba80b3f50 2023-05-22T01:34:03.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000acc0 con 0x7fdba80b3f50 2023-05-22T01:34:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.974+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba806b500 con 0x7fdba80b3f50 2023-05-22T01:34:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.978+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba80cf5b0 con 0x7fdba80b3f50 2023-05-22T01:34:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.978+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdba001b3b0 con 0x7fdba80b3f50 2023-05-22T01:34:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.978+0000 7fdb96ffd700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdb880662f0 0x7fdb880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.978+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdba0083230 con 0x7fdba80b3f50 2023-05-22T01:34:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.978+0000 7fdba659c700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdb880662f0 0x7fdb880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.978+0000 7fdba659c700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdb880662f0 0x7fdb880687a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fdb98000c00 tx=0x7fdb98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:02.986+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdba0050af0 con 0x7fdba80b3f50 2023-05-22T01:34:03.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.150+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba8067ac0 con 0x7fdb880662f0 2023-05-22T01:34:03.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.150+0000 7fdb96ffd700 1 -- 172.21.15.46:0/1836957316 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdba8067ac0 con 0x7fdb880662f0 2023-05-22T01:34:03.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdb880662f0 msgr2=0x7fdb880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdb880662f0 0x7fdb880687a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fdb98000c00 tx=0x7fdb98008030 comp rx=0 tx=0).stop 2023-05-22T01:34:03.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 msgr2=0x7fdba81541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 0x7fdba81541e0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fdba000caf0 tx=0x7fdba000cbd0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 shutdown_connections 2023-05-22T01:34:03.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdb880662f0 0x7fdb880687a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdba80b3f50 0x7fdba81541e0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdba81600c0 0x7fdba80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 --2- 172.21.15.46:0/1836957316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdba80b85b0 0x7fdba80d1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 >> 172.21.15.46:0/1836957316 conn(0x7fdba80b2140 msgr2=0x7fdba80b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 shutdown_connections 2023-05-22T01:34:03.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.154+0000 7fdba759e700 1 -- 172.21.15.46:0/1836957316 wait complete. 2023-05-22T01:34:03.195 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2023-05-22T01:34:03.195 INFO:tasks.ceph:Scrubbing osd.1 2023-05-22T01:34:03.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:03.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.310+0000 7fa11b105700 1 Processor -- start 2023-05-22T01:34:03.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.310+0000 7fa11b105700 1 -- start start 2023-05-22T01:34:03.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1140aead0 0x7fa11406dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1140cc120 con 0x7fa1140cbcf0 2023-05-22T01:34:03.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1141592e0 con 0x7fa1140aead0 2023-05-22T01:34:03.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406b0b0 con 0x7fa11406ba60 2023-05-22T01:34:03.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa113fff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa1140cbcf0 0x7fa11406b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49244/0 (socket says 172.21.15.46:49244) 2023-05-22T01:34:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa113fff700 1 -- 172.21.15.46:0/3733397319 learned_addr learned my addr 172.21.15.46:0/3733397319 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa118ea1700 1 --2- 172.21.15.46:0/3733397319 >> v2:172.21.15.142:3300/0 conn(0x7fa1140aead0 0x7fa11406dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1196a2700 1 --2- 172.21.15.46:0/3733397319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1137fe700 1 -- 172.21.15.46:0/3733397319 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830741952 0 0) 0x7fa1140cc120 con 0x7fa1140cbcf0 2023-05-22T01:34:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1137fe700 1 -- 172.21.15.46:0/3733397319 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1040035d0 con 0x7fa1140cbcf0 2023-05-22T01:34:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1196a2700 1 -- 172.21.15.46:0/3733397319 >> v2:172.21.15.142:3300/0 conn(0x7fa1140aead0 msgr2=0x7fa11406dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:03.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1196a2700 1 --2- 172.21.15.46:0/3733397319 >> v2:172.21.15.142:3300/0 conn(0x7fa1140aead0 0x7fa11406dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1196a2700 1 -- 172.21.15.46:0/3733397319 >> v1:172.21.15.46:6789/0 conn(0x7fa1140cbcf0 legacy=0x7fa11406b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1196a2700 1 -- 172.21.15.46:0/3733397319 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140cc380 con 0x7fa11406ba60 2023-05-22T01:34:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1196a2700 1 --2- 172.21.15.46:0/3733397319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140c9fe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009d90 tx=0x7fa10c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f80c595208273e server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1137fe700 1 -- 172.21.15.46:0/3733397319 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00e070 con 0x7fa11406ba60 2023-05-22T01:34:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1137fe700 1 -- 172.21.15.46:0/3733397319 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00bb20 con 0x7fa11406ba60 2023-05-22T01:34:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa1137fe700 1 -- 172.21.15.46:0/3733397319 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c012430 con 0x7fa11406ba60 2023-05-22T01:34:03.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- 172.21.15.46:0/3733397319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 msgr2=0x7fa1140c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 --2- 172.21.15.46:0/3733397319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140c9fe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009d90 tx=0x7fa10c00b330 comp rx=0 tx=0).stop 2023-05-22T01:34:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- 172.21.15.46:0/3733397319 shutdown_connections 2023-05-22T01:34:03.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 --2- 172.21.15.46:0/3733397319 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140c9fe0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 --2- 172.21.15.46:0/3733397319 >> v2:172.21.15.142:3300/0 conn(0x7fa1140aead0 0x7fa11406dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- 172.21.15.46:0/3733397319 >> 172.21.15.46:0/3733397319 conn(0x7fa1140b23c0 msgr2=0x7fa1140b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- 172.21.15.46:0/3733397319 shutdown_connections 2023-05-22T01:34:03.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.314+0000 7fa11b105700 1 -- 172.21.15.46:0/3733397319 wait complete. 2023-05-22T01:34:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 Processor -- start 2023-05-22T01:34:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 -- start start 2023-05-22T01:34:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1140aead0 0x7fa114150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1140cbcf0 0x7fa114150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140af220 con 0x7fa1140aead0 2023-05-22T01:34:03.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140b1d60 con 0x7fa1140cbcf0 2023-05-22T01:34:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa11b105700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140af470 con 0x7fa11406ba60 2023-05-22T01:34:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa113fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1140aead0 0x7fa114150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa118ea1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1140cbcf0 0x7fa114150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa118ea1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:48566/0 (socket says 172.21.15.46:48566) 2023-05-22T01:34:03.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa118ea1700 1 -- 172.21.15.46:0/1751983721 learned_addr learned my addr 172.21.15.46:0/1751983721 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:03.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1140cbcf0 0x7fa114150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:50762/0 (socket says 172.21.15.46:50762) 2023-05-22T01:34:03.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa113fff700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1140aead0 0x7fa114150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43150/0 (socket says 172.21.15.46:43150) 2023-05-22T01:34:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 -- 172.21.15.46:0/1751983721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 msgr2=0x7fa1140b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 -- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1140aead0 msgr2=0x7fa114150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1140aead0 0x7fa114150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa1196a2700 1 -- 172.21.15.46:0/1751983721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c009a70 con 0x7fa1140cbcf0 2023-05-22T01:34:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa118ea1700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11406ba60 0x7fa1140b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.318+0000 7fa113fff700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1140aead0 0x7fa114150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1196a2700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1140cbcf0 0x7fa114150f50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa10c016000 tx=0x7fa10c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c012430 con 0x7fa1140cbcf0 2023-05-22T01:34:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c012a30 con 0x7fa1140cbcf0 2023-05-22T01:34:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1140cc940 con 0x7fa1140cbcf0 2023-05-22T01:34:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c012de0 con 0x7fa1140cbcf0 2023-05-22T01:34:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1140cc660 con 0x7fa1140cbcf0 2023-05-22T01:34:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1140ccc20 con 0x7fa1140cbcf0 2023-05-22T01:34:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa10c004040 con 0x7fa1140cbcf0 2023-05-22T01:34:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1117fa700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa0f80662f0 0x7fa0f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa118ea1700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa0f80662f0 0x7fa0f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.322+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa10c089f00 con 0x7fa1140cbcf0 2023-05-22T01:34:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa1117fa700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7fa0f806c760 0x7fa0f806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 --> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0f806f220 con 0x7fa0f806c760 2023-05-22T01:34:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa10c08a270 con 0x7fa1140cbcf0 2023-05-22T01:34:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa113fff700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7fa0f806c760 0x7fa0f806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa118ea1700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa0f80662f0 0x7fa0f80687a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa11409d370 tx=0x7fa108009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa113fff700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7fa0f806c760 0x7fa0f806eb70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.326+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== osd.1 v2:172.21.15.46:6808/3939198338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa0f806f220 con 0x7fa0f806c760 2023-05-22T01:34:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 --> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa114073cb0 con 0x7fa0f806c760 2023-05-22T01:34:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa1117fa700 1 -- 172.21.15.46:0/1751983721 <== osd.1 v2:172.21.15.46:6808/3939198338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa114073cb0 con 0x7fa0f806c760 2023-05-22T01:34:03.421 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:03.422 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:03.422 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:03.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7fa0f806c760 msgr2=0x7fa0f806eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6808/3939198338,v1:172.21.15.46:6809/3939198338] conn(0x7fa0f806c760 0x7fa0f806eb70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa0f80662f0 msgr2=0x7fa0f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fa0f80662f0 0x7fa0f80687a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa11409d370 tx=0x7fa108009240 comp rx=0 tx=0).stop 2023-05-22T01:34:03.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1140cbcf0 msgr2=0x7fa114150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 --2- 172.21.15.46:0/1751983721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1140cbcf0 0x7fa114150f50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa10c016000 tx=0x7fa10c004af0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa1196a2700 1 -- 172.21.15.46:0/1751983721 reap_dead start 2023-05-22T01:34:03.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 shutdown_connections 2023-05-22T01:34:03.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 >> 172.21.15.46:0/1751983721 conn(0x7fa1140b23c0 msgr2=0x7fa1140c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 shutdown_connections 2023-05-22T01:34:03.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.342+0000 7fa11b105700 1 -- 172.21.15.46:0/1751983721 wait complete. 2023-05-22T01:34:03.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-05-22T01:34:03.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.534+0000 7f16522f0700 1 Processor -- start 2023-05-22T01:34:03.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.534+0000 7f16522f0700 1 -- start start 2023-05-22T01:34:03.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c15a4f0 0x7f164c160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f164c0d0640 0x7f164c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f164c0cb940 0x7f164c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c161320 con 0x7f164c0cb940 2023-05-22T01:34:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0ceb20 con 0x7f164c0d0640 2023-05-22T01:34:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0cee00 con 0x7f164c15a4f0 2023-05-22T01:34:03.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f164c0cb940 0x7f164c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f164c0cb940 0x7f164c15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43160/0 (socket says 172.21.15.46:43160) 2023-05-22T01:34:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 -- 172.21.15.46:0/2261172568 learned_addr learned my addr 172.21.15.46:0/2261172568 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f164b7fe700 1 --2- 172.21.15.46:0/2261172568 >> v2:172.21.15.142:3300/0 conn(0x7f164c0d0640 0x7f164c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f164bfff700 1 --2- 172.21.15.46:0/2261172568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c15a4f0 0x7f164c160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 -- 172.21.15.46:0/2261172568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c15a4f0 msgr2=0x7f164c160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:03.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 --2- 172.21.15.46:0/2261172568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c15a4f0 0x7f164c160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 -- 172.21.15.46:0/2261172568 >> v2:172.21.15.142:3300/0 conn(0x7f164c0d0640 msgr2=0x7f164c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:03.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 --2- 172.21.15.46:0/2261172568 >> v2:172.21.15.142:3300/0 conn(0x7f164c0d0640 0x7f164c0cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 -- 172.21.15.46:0/2261172568 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c15ce50 con 0x7f164c0cb940 2023-05-22T01:34:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f165088d700 1 --2- 172.21.15.46:0/2261172568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c0cb940 0x7f164c15d370 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f164c0716e0 tx=0x7f1644009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce779aace2d1253 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f164affd700 1 -- 172.21.15.46:0/2261172568 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644011830 con 0x7f164c0cb940 2023-05-22T01:34:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f164affd700 1 -- 172.21.15.46:0/2261172568 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644011990 con 0x7f164c0cb940 2023-05-22T01:34:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f164affd700 1 -- 172.21.15.46:0/2261172568 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644011d20 con 0x7f164c0cb940 2023-05-22T01:34:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- 172.21.15.46:0/2261172568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c0cb940 msgr2=0x7f164c15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- 172.21.15.46:0/2261172568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c0cb940 0x7f164c15d370 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f164c0716e0 tx=0x7f1644009bf0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- 172.21.15.46:0/2261172568 shutdown_connections 2023-05-22T01:34:03.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- 172.21.15.46:0/2261172568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c0cb940 0x7f164c15d370 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- 172.21.15.46:0/2261172568 >> v2:172.21.15.142:3300/0 conn(0x7f164c0d0640 0x7f164c0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 --2- 172.21.15.46:0/2261172568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c15a4f0 0x7f164c160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- 172.21.15.46:0/2261172568 >> 172.21.15.46:0/2261172568 conn(0x7f164c06fc60 msgr2=0x7f164c0cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- 172.21.15.46:0/2261172568 shutdown_connections 2023-05-22T01:34:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.538+0000 7f16522f0700 1 -- 172.21.15.46:0/2261172568 wait complete. 2023-05-22T01:34:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 Processor -- start 2023-05-22T01:34:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 -- start start 2023-05-22T01:34:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0cb940 0x7f164c1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0d0640 0x7f164c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 0x7f164c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c6540 con 0x7f164c15a4f0 2023-05-22T01:34:03.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0b48e0 con 0x7f164c0d0640 2023-05-22T01:34:03.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1f60b0 con 0x7f164c0cb940 2023-05-22T01:34:03.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 0x7f164c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 0x7f164c158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43166/0 (socket says 172.21.15.46:43166) 2023-05-22T01:34:03.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f164bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0cb940 0x7f164c1f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 -- 172.21.15.46:0/2633153099 learned_addr learned my addr 172.21.15.46:0/2633153099 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:03.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f164b7fe700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0d0640 0x7f164c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 -- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0cb940 msgr2=0x7f164c1f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0cb940 0x7f164c1f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 -- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0d0640 msgr2=0x7f164c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0d0640 0x7f164c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 -- 172.21.15.46:0/2633153099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009570 con 0x7f164c15a4f0 2023-05-22T01:34:03.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f165088d700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 0x7f164c158e20 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f1644013000 tx=0x7f1644004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644004450 con 0x7f164c15a4f0 2023-05-22T01:34:03.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440045b0 con 0x7f164c15a4f0 2023-05-22T01:34:03.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0cf0e0 con 0x7f164c15a4f0 2023-05-22T01:34:03.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644003900 con 0x7f164c15a4f0 2023-05-22T01:34:03.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.542+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c0d0a90 con 0x7f164c15a4f0 2023-05-22T01:34:03.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.546+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1644021070 con 0x7f164c15a4f0 2023-05-22T01:34:03.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.546+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c15d8b0 con 0x7f164c15a4f0 2023-05-22T01:34:03.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.546+0000 7f1648ff9700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f162c0662f0 0x7f162c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.546+0000 7f164bfff700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f162c0662f0 0x7f162c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.546+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1644084d50 con 0x7f164c15a4f0 2023-05-22T01:34:03.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.546+0000 7f164bfff700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f162c0662f0 0x7f162c0687a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f163c011340 tx=0x7f163c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.554+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1644088030 con 0x7f164c15a4f0 2023-05-22T01:34:03.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f164c073cb0 con 0x7f162c0662f0 2023-05-22T01:34:03.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f1648ff9700 1 -- 172.21.15.46:0/2633153099 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f164c073cb0 con 0x7f162c0662f0 2023-05-22T01:34:03.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f162c0662f0 msgr2=0x7f162c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f162c0662f0 0x7f162c0687a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f163c011340 tx=0x7f163c00b040 comp rx=0 tx=0).stop 2023-05-22T01:34:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 msgr2=0x7f164c158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 0x7f164c158e20 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f1644013000 tx=0x7f1644004770 comp rx=0 tx=0).stop 2023-05-22T01:34:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 shutdown_connections 2023-05-22T01:34:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f162c0662f0 0x7f162c0687a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f164c15a4f0 0x7f164c158e20 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f164c0d0640 0x7f164c1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 --2- 172.21.15.46:0/2633153099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f164c0cb940 0x7f164c1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 >> 172.21.15.46:0/2633153099 conn(0x7f164c06fc60 msgr2=0x7f164c15af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 shutdown_connections 2023-05-22T01:34:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.718+0000 7f16522f0700 1 -- 172.21.15.46:0/2633153099 wait complete. 2023-05-22T01:34:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2023-05-22T01:34:03.751 INFO:tasks.ceph:Scrubbing osd.2 2023-05-22T01:34:03.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:03.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.878+0000 7f6b1bfff700 1 Processor -- start 2023-05-22T01:34:03.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.878+0000 7f6b1bfff700 1 -- start start 2023-05-22T01:34:03.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b1c157470 0x7f6b1c06c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b1c0b1c30 0x7f6b1c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c0cd670 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c06cb10 con 0x7f6b1c157470 2023-05-22T01:34:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c06cdf0 con 0x7f6b1c0b1c30 2023-05-22T01:34:03.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b1c157470 0x7f6b1c06c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b1c157470 0x7f6b1c06c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43168/0 (socket says 172.21.15.46:43168) 2023-05-22T01:34:03.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 -- 172.21.15.46:0/2987074731 learned_addr learned my addr 172.21.15.46:0/2987074731 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:03.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1b7fe700 1 --2- 172.21.15.46:0/2987074731 >> v2:172.21.15.142:3300/0 conn(0x7f6b1c0b1c30 0x7f6b1c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 -- 172.21.15.46:0/2987074731 >> v2:172.21.15.142:3300/0 conn(0x7f6b1c0b1c30 msgr2=0x7f6b1c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:03.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 --2- 172.21.15.46:0/2987074731 >> v2:172.21.15.142:3300/0 conn(0x7f6b1c0b1c30 0x7f6b1c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 -- 172.21.15.46:0/2987074731 >> v1:172.21.15.142:6789/0 conn(0x7f6b1c15a8e0 legacy=0x7f6b1c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 -- 172.21.15.46:0/2987074731 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c06d0d0 con 0x7f6b1c157470 2023-05-22T01:34:03.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1b7fe700 1 --2- 172.21.15.46:0/2987074731 >> v2:172.21.15.142:3300/0 conn(0x7f6b1c0b1c30 0x7f6b1c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:03.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1affd700 1 --2- 172.21.15.46:0/2987074731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c157470 0x7f6b1c06c2c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c15e2f0 tx=0x7f6b0c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6c2967e474f364 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b19ffb700 1 -- 172.21.15.46:0/2987074731 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00b8a0 con 0x7f6b1c157470 2023-05-22T01:34:03.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b19ffb700 1 -- 172.21.15.46:0/2987074731 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c00ba00 con 0x7f6b1c157470 2023-05-22T01:34:03.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b19ffb700 1 -- 172.21.15.46:0/2987074731 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00bd90 con 0x7f6b1c157470 2023-05-22T01:34:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- 172.21.15.46:0/2987074731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c157470 msgr2=0x7f6b1c06c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 --2- 172.21.15.46:0/2987074731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c157470 0x7f6b1c06c2c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c15e2f0 tx=0x7f6b0c009bf0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- 172.21.15.46:0/2987074731 shutdown_connections 2023-05-22T01:34:03.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 --2- 172.21.15.46:0/2987074731 >> v2:172.21.15.142:3300/0 conn(0x7f6b1c0b1c30 0x7f6b1c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 --2- 172.21.15.46:0/2987074731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c157470 0x7f6b1c06c2c0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- 172.21.15.46:0/2987074731 >> 172.21.15.46:0/2987074731 conn(0x7f6b1c06d930 msgr2=0x7f6b1c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- 172.21.15.46:0/2987074731 shutdown_connections 2023-05-22T01:34:03.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.882+0000 7f6b1bfff700 1 -- 172.21.15.46:0/2987074731 wait complete. 2023-05-22T01:34:03.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 Processor -- start 2023-05-22T01:34:03.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 -- start start 2023-05-22T01:34:03.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b1c0b1c30 0x7f6b1c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1c157470 0x7f6b1c0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c15a8e0 0x7f6b1c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1e3810 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0c9ad0 con 0x7f6b1c0b1c30 2023-05-22T01:34:03.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1bfff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b5840 con 0x7f6b1c157470 2023-05-22T01:34:03.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c15a8e0 0x7f6b1c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1a7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1c157470 0x7f6b1c0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b1c0b1c30 0x7f6b1c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1a7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1c157470 0x7f6b1c0b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:48598/0 (socket says 172.21.15.46:48598) 2023-05-22T01:34:03.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1a7fc700 1 -- 172.21.15.46:0/962528057 learned_addr learned my addr 172.21.15.46:0/962528057 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:03.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c15a8e0 0x7f6b1c0b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43170/0 (socket says 172.21.15.46:43170) 2023-05-22T01:34:03.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 -- 172.21.15.46:0/962528057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1c157470 msgr2=0x7f6b1c0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1c157470 0x7f6b1c0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 -- 172.21.15.46:0/962528057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b1c0b1c30 msgr2=0x7f6b1c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b1c0b1c30 0x7f6b1c0b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1b7fe700 1 -- 172.21.15.46:0/962528057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009570 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.886+0000 7f6b1a7fc700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b1c157470 0x7f6b1c0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:03.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b1b7fe700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c15a8e0 0x7f6b1c0b1540 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f6b14007ef0 tx=0x7f6b1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1400dde0 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1400f040 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c06c800 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14015640 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c0cd8c0 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b1c0ce320 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.890+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b1401e3b0 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b037fe700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6b08066320 0x7f6b080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6b140839d0 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b1affd700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6b08066320 0x7f6b080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b037fe700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f6b0806c790 0x7f6b0806eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:03.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 --> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b0806f250 con 0x7f6b0806c790 2023-05-22T01:34:03.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b140882a0 con 0x7f6b1c15a8e0 2023-05-22T01:34:03.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b1a7fc700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f6b0806c790 0x7f6b0806eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:03.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b1affd700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6b08066320 0x7f6b080687d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c000c00 tx=0x7f6b0c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b1a7fc700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f6b0806c790 0x7f6b0806eba0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:03.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.894+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== osd.2 v2:172.21.15.46:6800/4251490015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6b0806f250 con 0x7f6b0806c790 2023-05-22T01:34:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 --> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6b1c1e39c0 con 0x7f6b0806c790 2023-05-22T01:34:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b037fe700 1 -- 172.21.15.46:0/962528057 <== osd.2 v2:172.21.15.46:6800/4251490015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6b1c1e39c0 con 0x7f6b0806c790 2023-05-22T01:34:03.990 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:03.990 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:03.990 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f6b0806c790 msgr2=0x7f6b0806eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6800/4251490015,v1:172.21.15.46:6801/4251490015] conn(0x7f6b0806c790 0x7f6b0806eba0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6b08066320 msgr2=0x7f6b080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6b08066320 0x7f6b080687d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c000c00 tx=0x7f6b0c008030 comp rx=0 tx=0).stop 2023-05-22T01:34:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c15a8e0 msgr2=0x7f6b1c0b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 --2- 172.21.15.46:0/962528057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b1c15a8e0 0x7f6b1c0b1540 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f6b14007ef0 tx=0x7f6b1400d3b0 comp rx=0 tx=0).stop 2023-05-22T01:34:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1b7fe700 1 -- 172.21.15.46:0/962528057 reap_dead start 2023-05-22T01:34:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.910+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 shutdown_connections 2023-05-22T01:34:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.914+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 >> 172.21.15.46:0/962528057 conn(0x7f6b1c06d930 msgr2=0x7f6b1c158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.914+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 shutdown_connections 2023-05-22T01:34:03.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:03.914+0000 7f6b1bfff700 1 -- 172.21.15.46:0/962528057 wait complete. 2023-05-22T01:34:03.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-05-22T01:34:04.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2e255700 1 Processor -- start 2023-05-22T01:34:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2e255700 1 -- start start 2023-05-22T01:34:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2e255700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a280cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2e255700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2806afd0 con 0x7f6a280b5050 2023-05-22T01:34:04.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2e255700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a280cd6b0 con 0x7f6a281600c0 2023-05-22T01:34:04.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2e255700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280cd990 con 0x7f6a280b85b0 2023-05-22T01:34:04.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2da54700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6a280b5050 0x7f6a28069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49260/0 (socket says 172.21.15.46:49260) 2023-05-22T01:34:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2da54700 1 -- 172.21.15.46:0/752476542 learned_addr learned my addr 172.21.15.46:0/752476542 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2d253700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a280cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780198059 0 0) 0x7f6a2806afd0 con 0x7f6a280b5050 2023-05-22T01:34:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a140035d0 con 0x7f6a280b5050 2023-05-22T01:34:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647861787 0 0) 0x7f6a140035d0 con 0x7f6a280b5050 2023-05-22T01:34:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 msgr2=0x7f6a280cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a280cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 >> v1:172.21.15.142:6789/0 conn(0x7f6a281600c0 legacy=0x7f6a280b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2806b220 con 0x7f6a280b5050 2023-05-22T01:34:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f6a200019f0 con 0x7f6a280b5050 2023-05-22T01:34:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 >> v1:172.21.15.46:6789/0 conn(0x7f6a280b5050 legacy=0x7f6a28069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a14003a50 0x7f6a14003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a14004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a14004db0 0x7f6a14005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280cd990 con 0x7f6a14004db0 2023-05-22T01:34:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1400bb40 con 0x7f6a14003a50 2023-05-22T01:34:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1400bd00 con 0x7f6a280b85b0 2023-05-22T01:34:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2da54700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a14004db0 0x7f6a14005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2d253700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a14003a50 0x7f6a14003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.102+0000 7f6a2ca52700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a14004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 -- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 msgr2=0x7f6a14004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a14004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 -- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a14003a50 msgr2=0x7f6a14003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:04.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a14003a50 0x7f6a14003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 -- 172.21.15.46:0/752476542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140035d0 con 0x7f6a14004db0 2023-05-22T01:34:04.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2ca52700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b85b0 0x7f6a14004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:04.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a14004db0 0x7f6a14005220 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f6a28160020 tx=0x7f6a140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaf31076ebdc411 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200072d0 con 0x7f6a14004db0 2023-05-22T01:34:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000ae90 con 0x7f6a14004db0 2023-05-22T01:34:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a1bfff700 1 -- 172.21.15.46:0/752476542 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20007630 con 0x7f6a14004db0 2023-05-22T01:34:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- 172.21.15.46:0/752476542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a14004db0 msgr2=0x7f6a14005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 --2- 172.21.15.46:0/752476542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a14004db0 0x7f6a14005220 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f6a28160020 tx=0x7f6a140058a0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2da54700 1 -- 172.21.15.46:0/752476542 reap_dead start 2023-05-22T01:34:04.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- 172.21.15.46:0/752476542 shutdown_connections 2023-05-22T01:34:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- 172.21.15.46:0/752476542 >> 172.21.15.46:0/752476542 conn(0x7f6a2806cc00 msgr2=0x7f6a280cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- 172.21.15.46:0/752476542 shutdown_connections 2023-05-22T01:34:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- 172.21.15.46:0/752476542 wait complete. 2023-05-22T01:34:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 Processor -- start 2023-05-22T01:34:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- start start 2023-05-22T01:34:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 0x7f6a281f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b4410 0x7f6a2814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a28149ea0 0x7f6a2814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2814a880 con 0x7f6a280b4040 2023-05-22T01:34:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280c6ab0 con 0x7f6a28149ea0 2023-05-22T01:34:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2e255700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2814daa0 con 0x7f6a280b4410 2023-05-22T01:34:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2d253700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 0x7f6a281f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2d253700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 0x7f6a281f4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43180/0 (socket says 172.21.15.46:43180) 2023-05-22T01:34:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.106+0000 7f6a2d253700 1 -- 172.21.15.46:0/3067642860 learned_addr learned my addr 172.21.15.46:0/3067642860 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2ca52700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b4410 0x7f6a2814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2da54700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a28149ea0 0x7f6a2814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2d253700 1 -- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b4410 msgr2=0x7f6a2814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2d253700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b4410 0x7f6a2814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2d253700 1 -- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a28149ea0 msgr2=0x7f6a2814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2d253700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a28149ea0 0x7f6a2814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2d253700 1 -- 172.21.15.46:0/3067642860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280b8980 con 0x7f6a280b4040 2023-05-22T01:34:04.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2ca52700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b4410 0x7f6a2814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2d253700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 0x7f6a281f4e90 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f6a240119b0 tx=0x7f6a24011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400f8e0 con 0x7f6a280b4040 2023-05-22T01:34:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2400fa40 con 0x7f6a280b4040 2023-05-22T01:34:04.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2806b500 con 0x7f6a280b4040 2023-05-22T01:34:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400fdd0 con 0x7f6a280b4040 2023-05-22T01:34:04.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a280b2140 con 0x7f6a280b4040 2023-05-22T01:34:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a28067ac0 con 0x7f6a280b4040 2023-05-22T01:34:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a24014440 con 0x7f6a280b4040 2023-05-22T01:34:04.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.110+0000 7f6a19ffb700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a0c066320 0x7f6a0c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.114+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6a240840e0 con 0x7f6a280b4040 2023-05-22T01:34:04.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.114+0000 7f6a2ca52700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a0c066320 0x7f6a0c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.114+0000 7f6a2ca52700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a0c066320 0x7f6a0c0687d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6a2815c000 tx=0x7f6a1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.118+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6a24051860 con 0x7f6a280b4040 2023-05-22T01:34:04.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.282+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a280c6bf0 con 0x7f6a0c066320 2023-05-22T01:34:04.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.282+0000 7f6a19ffb700 1 -- 172.21.15.46:0/3067642860 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a1c0013b0 con 0x7f6a0c066320 2023-05-22T01:34:04.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a0c066320 msgr2=0x7f6a0c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a0c066320 0x7f6a0c0687d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6a2815c000 tx=0x7f6a1c009040 comp rx=0 tx=0).stop 2023-05-22T01:34:04.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 msgr2=0x7f6a281f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 0x7f6a281f4e90 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f6a240119b0 tx=0x7f6a24011d70 comp rx=0 tx=0).stop 2023-05-22T01:34:04.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 shutdown_connections 2023-05-22T01:34:04.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a0c066320 0x7f6a0c0687d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a28149ea0 0x7f6a2814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280b4410 0x7f6a2814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 --2- 172.21.15.46:0/3067642860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a280b4040 0x7f6a281f4e90 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 >> 172.21.15.46:0/3067642860 conn(0x7f6a14004db0 msgr2=0x7f6a280d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:04.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 shutdown_connections 2023-05-22T01:34:04.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.286+0000 7f6a2e255700 1 -- 172.21.15.46:0/3067642860 wait complete. 2023-05-22T01:34:04.307 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2023-05-22T01:34:04.322 INFO:tasks.ceph:Scrubbing osd.3 2023-05-22T01:34:04.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:04.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.430+0000 7f79effff700 1 Processor -- start 2023-05-22T01:34:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.430+0000 7f79effff700 1 -- start start 2023-05-22T01:34:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f015a8e0 0x7f79f00b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f00cd670 con 0x7f79f00b1a60 2023-05-22T01:34:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f006cb10 con 0x7f79f0157470 2023-05-22T01:34:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00b1f00 con 0x7f79f015a8e0 2023-05-22T01:34:04.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ef7fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f79f00b1a60 0x7f79f00cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49274/0 (socket says 172.21.15.46:49274) 2023-05-22T01:34:04.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ef7fe700 1 -- 172.21.15.46:0/2868300862 learned_addr learned my addr 172.21.15.46:0/2868300862 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ee7fc700 1 --2- 172.21.15.46:0/2868300862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f015a8e0 0x7f79f00b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79edffb700 1 -- 172.21.15.46:0/2868300862 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494992860 0 0) 0x7f79f00cd670 con 0x7f79f00b1a60 2023-05-22T01:34:04.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79edffb700 1 -- 172.21.15.46:0/2868300862 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d80035d0 con 0x7f79f00b1a60 2023-05-22T01:34:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79edffb700 1 -- 172.21.15.46:0/2868300862 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044531669 0 0) 0x7f79f006cb10 con 0x7f79f0157470 2023-05-22T01:34:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ee7fc700 1 -- 172.21.15.46:0/2868300862 >> v1:172.21.15.142:6789/0 conn(0x7f79f0157470 legacy=0x7f79f006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ee7fc700 1 -- 172.21.15.46:0/2868300862 >> v1:172.21.15.46:6789/0 conn(0x7f79f00b1a60 legacy=0x7f79f00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ee7fc700 1 -- 172.21.15.46:0/2868300862 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f006cdf0 con 0x7f79f015a8e0 2023-05-22T01:34:04.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79ee7fc700 1 --2- 172.21.15.46:0/2868300862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f015a8e0 0x7f79f00b1520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009880 tx=0x7f79e4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eca1d541b6ebee4b server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79edffb700 1 -- 172.21.15.46:0/2868300862 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011830 con 0x7f79f015a8e0 2023-05-22T01:34:04.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79edffb700 1 -- 172.21.15.46:0/2868300862 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4011990 con 0x7f79f015a8e0 2023-05-22T01:34:04.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79edffb700 1 -- 172.21.15.46:0/2868300862 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011d20 con 0x7f79f015a8e0 2023-05-22T01:34:04.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- 172.21.15.46:0/2868300862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f015a8e0 msgr2=0x7f79f00b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 --2- 172.21.15.46:0/2868300862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f015a8e0 0x7f79f00b1520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009880 tx=0x7f79e4009b90 comp rx=0 tx=0).stop 2023-05-22T01:34:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- 172.21.15.46:0/2868300862 shutdown_connections 2023-05-22T01:34:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 --2- 172.21.15.46:0/2868300862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f015a8e0 0x7f79f00b1520 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- 172.21.15.46:0/2868300862 >> 172.21.15.46:0/2868300862 conn(0x7f79f006d930 msgr2=0x7f79f006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- 172.21.15.46:0/2868300862 shutdown_connections 2023-05-22T01:34:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.434+0000 7f79effff700 1 -- 172.21.15.46:0/2868300862 wait complete. 2023-05-22T01:34:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 Processor -- start 2023-05-22T01:34:04.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 -- start start 2023-05-22T01:34:04.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f00b1a60 0x7f79f014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f0157470 0x7f79f00b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f015a8e0 0x7f79f006a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00afd90 con 0x7f79f00b1a60 2023-05-22T01:34:04.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00b0070 con 0x7f79f015a8e0 2023-05-22T01:34:04.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00b0350 con 0x7f79f0157470 2023-05-22T01:34:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f00b1a60 0x7f79f014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f00b1a60 0x7f79f014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43196/0 (socket says 172.21.15.46:43196) 2023-05-22T01:34:04.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 -- 172.21.15.46:0/4163882671 learned_addr learned my addr 172.21.15.46:0/4163882671 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:04.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79ee7fc700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f0157470 0x7f79f00b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79ef7fe700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f015a8e0 0x7f79f006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 -- 172.21.15.46:0/4163882671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f0157470 msgr2=0x7f79f00b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f0157470 0x7f79f00b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 -- 172.21.15.46:0/4163882671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f015a8e0 msgr2=0x7f79f006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f015a8e0 0x7f79f006a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 -- 172.21.15.46:0/4163882671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40094b0 con 0x7f79f00b1a60 2023-05-22T01:34:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79eeffd700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f00b1a60 0x7f79f014cc40 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c520 tx=0x7f79e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00054e0 con 0x7f79f00b1a60 2023-05-22T01:34:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e00036a0 con 0x7f79f00b1a60 2023-05-22T01:34:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00cd8c0 con 0x7f79f00b1a60 2023-05-22T01:34:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0003a50 con 0x7f79f00b1a60 2023-05-22T01:34:04.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.438+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f006d0d0 con 0x7f79f00b1a60 2023-05-22T01:34:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79f00ce4f0 con 0x7f79f00b1a60 2023-05-22T01:34:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79e0003bb0 con 0x7f79f00b1a60 2023-05-22T01:34:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79d77fe700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79dc066320 0x7f79dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f79e0082ec0 con 0x7f79f00b1a60 2023-05-22T01:34:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79ee7fc700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79dc066320 0x7f79dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79d77fe700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f79dc06c790 0x7f79dc06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 --> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79dc06f250 con 0x7f79dc06c790 2023-05-22T01:34:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e0085560 con 0x7f79f00b1a60 2023-05-22T01:34:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79ef7fe700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f79dc06c790 0x7f79dc06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79ee7fc700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79dc066320 0x7f79dc0687d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009880 tx=0x7f79e401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.442+0000 7f79ef7fe700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f79dc06c790 0x7f79dc06eba0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.446+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== osd.3 v2:172.21.15.46:6824/270588901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f79dc06f250 con 0x7f79dc06c790 2023-05-22T01:34:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.462+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 --> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79f0073cb0 con 0x7f79dc06c790 2023-05-22T01:34:04.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.462+0000 7f79d77fe700 1 -- 172.21.15.46:0/4163882671 <== osd.3 v2:172.21.15.46:6824/270588901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f79f0073cb0 con 0x7f79dc06c790 2023-05-22T01:34:04.554 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:04.554 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:04.554 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:04.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f79dc06c790 msgr2=0x7f79dc06eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6824/270588901,v1:172.21.15.46:6825/270588901] conn(0x7f79dc06c790 0x7f79dc06eba0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79dc066320 msgr2=0x7f79dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f79dc066320 0x7f79dc0687d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009880 tx=0x7f79e401c040 comp rx=0 tx=0).stop 2023-05-22T01:34:04.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f00b1a60 msgr2=0x7f79f014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 --2- 172.21.15.46:0/4163882671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f00b1a60 0x7f79f014cc40 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c520 tx=0x7f79e000c830 comp rx=0 tx=0).stop 2023-05-22T01:34:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79ef7fe700 1 -- 172.21.15.46:0/4163882671 reap_dead start 2023-05-22T01:34:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 shutdown_connections 2023-05-22T01:34:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 >> 172.21.15.46:0/4163882671 conn(0x7f79f006d930 msgr2=0x7f79f0158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:04.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 shutdown_connections 2023-05-22T01:34:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.466+0000 7f79effff700 1 -- 172.21.15.46:0/4163882671 wait complete. 2023-05-22T01:34:04.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-05-22T01:34:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.658+0000 7f7f5d7f3700 1 Processor -- start 2023-05-22T01:34:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.658+0000 7f7f5d7f3700 1 -- start start 2023-05-22T01:34:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f580cf460 0x7f7f580cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5806af50 con 0x7f7f580b50e0 2023-05-22T01:34:04.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5815cc70 con 0x7f7f5815c8a0 2023-05-22T01:34:04.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5806a990 con 0x7f7f580cf460 2023-05-22T01:34:04.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f580cf460 0x7f7f580cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7f580cf460 0x7f7f580cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40550/0 (socket says 172.21.15.46:40550) 2023-05-22T01:34:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 -- 172.21.15.46:0/685914719 learned_addr learned my addr 172.21.15.46:0/685914719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f567fc700 1 --1- 172.21.15.46:0/685914719 >> v1:172.21.15.46:6789/0 conn(0x7f7f580b50e0 0x7f7f580b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39292/0 (socket says 172.21.15.46:39292) 2023-05-22T01:34:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 -- 172.21.15.46:0/685914719 >> v1:172.21.15.142:6789/0 conn(0x7f7f5815c8a0 legacy=0x7f7f580b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 -- 172.21.15.46:0/685914719 >> v1:172.21.15.46:6789/0 conn(0x7f7f580b50e0 legacy=0x7f7f580b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 -- 172.21.15.46:0/685914719 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5806ac70 con 0x7f7f580cf460 2023-05-22T01:34:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f577fe700 1 --2- 172.21.15.46:0/685914719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f580cf460 0x7f7f580cd910 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009910 tx=0x7f7f48009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b506ae0a3f00756a server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f55ffb700 1 -- 172.21.15.46:0/685914719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800ba60 con 0x7f7f580cf460 2023-05-22T01:34:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f55ffb700 1 -- 172.21.15.46:0/685914719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4800bbc0 con 0x7f7f580cf460 2023-05-22T01:34:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f55ffb700 1 -- 172.21.15.46:0/685914719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48009e60 con 0x7f7f580cf460 2023-05-22T01:34:04.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/685914719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f580cf460 msgr2=0x7f7f580cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/685914719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f580cf460 0x7f7f580cd910 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009910 tx=0x7f7f48009c20 comp rx=0 tx=0).stop 2023-05-22T01:34:04.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/685914719 shutdown_connections 2023-05-22T01:34:04.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/685914719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f580cf460 0x7f7f580cd910 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/685914719 >> 172.21.15.46:0/685914719 conn(0x7f7f5806cce0 msgr2=0x7f7f580d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:04.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/685914719 shutdown_connections 2023-05-22T01:34:04.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.662+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/685914719 wait complete. 2023-05-22T01:34:04.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.666+0000 7f7f5d7f3700 1 Processor -- start 2023-05-22T01:34:04.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.666+0000 7f7f5d7f3700 1 -- start start 2023-05-22T01:34:04.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 0x7f7f5814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f580cf460 0x7f7f580c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 0x7f7f5815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580b7120 con 0x7f7f5815c8a0 2023-05-22T01:34:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580b7400 con 0x7f7f580cf460 2023-05-22T01:34:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580b76e0 con 0x7f7f580b50e0 2023-05-22T01:34:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f577fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 0x7f7f5815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f56ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 0x7f7f5814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f580cf460 0x7f7f580c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f577fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 0x7f7f5815f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40562/0 (socket says 172.21.15.46:40562) 2023-05-22T01:34:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f56ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 0x7f7f5814d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:60872/0 (socket says 172.21.15.46:60872) 2023-05-22T01:34:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f577fe700 1 -- 172.21.15.46:0/2107743856 learned_addr learned my addr 172.21.15.46:0/2107743856 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 -- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 msgr2=0x7f7f5814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 0x7f7f5814d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 -- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 msgr2=0x7f7f5815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 0x7f7f5815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 -- 172.21.15.46:0/2107743856 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009570 con 0x7f7f580cf460 2023-05-22T01:34:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f577fe700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 0x7f7f5815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f56ffd700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 0x7f7f5814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f567fc700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f580cf460 0x7f7f580c6a80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000c500 tx=0x7f7f4000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40005cd0 con 0x7f7f580cf460 2023-05-22T01:34:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40005e30 con 0x7f7f580cf460 2023-05-22T01:34:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5806b5a0 con 0x7f7f580cf460 2023-05-22T01:34:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400072d0 con 0x7f7f580cf460 2023-05-22T01:34:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.670+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5806b2c0 con 0x7f7f580cf460 2023-05-22T01:34:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.674+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f580b2380 con 0x7f7f580cf460 2023-05-22T01:34:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.674+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f40007430 con 0x7f7f580cf460 2023-05-22T01:34:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.674+0000 7f7f4f7fe700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f380662f0 0x7f7f380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.674+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7f40082bd0 con 0x7f7f580cf460 2023-05-22T01:34:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.674+0000 7f7f56ffd700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f380662f0 0x7f7f380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.674+0000 7f7f56ffd700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f380662f0 0x7f7f380687a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d570 tx=0x7f7f50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.686+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7f40050400 con 0x7f7f580cf460 2023-05-22T01:34:04.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.850+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f580b7540 con 0x7f7f380662f0 2023-05-22T01:34:04.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.850+0000 7f7f4f7fe700 1 -- 172.21.15.46:0/2107743856 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f580b7540 con 0x7f7f380662f0 2023-05-22T01:34:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f380662f0 msgr2=0x7f7f380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f380662f0 0x7f7f380687a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d570 tx=0x7f7f50009040 comp rx=0 tx=0).stop 2023-05-22T01:34:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f580cf460 msgr2=0x7f7f580c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f580cf460 0x7f7f580c6a80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000c500 tx=0x7f7f4000c810 comp rx=0 tx=0).stop 2023-05-22T01:34:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 shutdown_connections 2023-05-22T01:34:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f7f380662f0 0x7f7f380687a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f5815c8a0 0x7f7f5815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f580cf460 0x7f7f580c6a80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 --2- 172.21.15.46:0/2107743856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f580b50e0 0x7f7f5814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 >> 172.21.15.46:0/2107743856 conn(0x7f7f5806cce0 msgr2=0x7f7f581593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 shutdown_connections 2023-05-22T01:34:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.854+0000 7f7f5d7f3700 1 -- 172.21.15.46:0/2107743856 wait complete. 2023-05-22T01:34:04.879 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2023-05-22T01:34:04.881 INFO:tasks.ceph:Scrubbing osd.4 2023-05-22T01:34:04.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:05.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.994+0000 7f441e045700 1 Processor -- start 2023-05-22T01:34:05.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.994+0000 7f441e045700 1 -- start start 2023-05-22T01:34:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44180cd800 0x7f441806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441806ed50 con 0x7f4418142c60 2023-05-22T01:34:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44180cdff0 con 0x7f44180cd800 2023-05-22T01:34:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44180ce200 con 0x7f441806e8f0 2023-05-22T01:34:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441d844700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441c842700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f44180cd800 0x7f441806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441d844700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:60888/0 (socket says 172.21.15.46:60888) 2023-05-22T01:34:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441d844700 1 -- 172.21.15.46:0/1885185979 learned_addr learned my addr 172.21.15.46:0/1885185979 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:05.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441c842700 1 -- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 msgr2=0x7f44180c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441c842700 1 --2- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f440ffff700 1 -- 172.21.15.46:0/1885185979 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864410116 0 0) 0x7f441806ed50 con 0x7f4418142c60 2023-05-22T01:34:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441c842700 1 -- 172.21.15.46:0/1885185979 >> v1:172.21.15.142:6789/0 conn(0x7f4418142c60 legacy=0x7f44180ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441c842700 1 -- 172.21.15.46:0/1885185979 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180ce4e0 con 0x7f44180cd800 2023-05-22T01:34:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441d844700 1 --2- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441c842700 1 --2- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44180cd800 0x7f441806e3b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4408009850 tx=0x7f4408009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4194230a42c188c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f440ffff700 1 -- 172.21.15.46:0/1885185979 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408011830 con 0x7f44180cd800 2023-05-22T01:34:05.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f440ffff700 1 -- 172.21.15.46:0/1885185979 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4408011990 con 0x7f44180cd800 2023-05-22T01:34:05.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f440ffff700 1 -- 172.21.15.46:0/1885185979 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408011d40 con 0x7f44180cd800 2023-05-22T01:34:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44180cd800 msgr2=0x7f441806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 --2- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44180cd800 0x7f441806e3b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4408009850 tx=0x7f4408009b60 comp rx=0 tx=0).stop 2023-05-22T01:34:05.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- 172.21.15.46:0/1885185979 shutdown_connections 2023-05-22T01:34:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 --2- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 --2- 172.21.15.46:0/1885185979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44180cd800 0x7f441806e3b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- 172.21.15.46:0/1885185979 >> 172.21.15.46:0/1885185979 conn(0x7f44180cfeb0 msgr2=0x7f44180cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- 172.21.15.46:0/1885185979 shutdown_connections 2023-05-22T01:34:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:04.998+0000 7f441e045700 1 -- 172.21.15.46:0/1885185979 wait complete. 2023-05-22T01:34:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 Processor -- start 2023-05-22T01:34:05.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 -- start start 2023-05-22T01:34:05.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44180cd800 0x7f44180c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4418142c60 0x7f441813a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180b30b0 con 0x7f44180cd800 2023-05-22T01:34:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44181f1f90 con 0x7f4418142c60 2023-05-22T01:34:05.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441e045700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44180b2150 con 0x7f441806e8f0 2023-05-22T01:34:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441c842700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44180cd800 0x7f44180c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441d043700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441c842700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44180cd800 0x7f44180c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40578/0 (socket says 172.21.15.46:40578) 2023-05-22T01:34:05.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441c842700 1 -- 172.21.15.46:0/1178202953 learned_addr learned my addr 172.21.15.46:0/1178202953 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.002+0000 7f441d844700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4418142c60 0x7f441813a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441c842700 1 -- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 msgr2=0x7f44180c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441c842700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f441806e8f0 0x7f44180c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441c842700 1 -- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4418142c60 msgr2=0x7f441813a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441c842700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4418142c60 0x7f441813a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441c842700 1 -- 172.21.15.46:0/1178202953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009570 con 0x7f44180cd800 2023-05-22T01:34:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441c842700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44180cd800 0x7f44180c8a00 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f4408000c00 tx=0x7f4408004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408004550 con 0x7f44180cd800 2023-05-22T01:34:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440801f070 con 0x7f44180cd800 2023-05-22T01:34:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44080094b0 con 0x7f44180cd800 2023-05-22T01:34:05.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408003900 con 0x7f44180cd800 2023-05-22T01:34:05.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180c4160 con 0x7f44180cd800 2023-05-22T01:34:05.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44180ce7c0 con 0x7f44180cd800 2023-05-22T01:34:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.006+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4408003a60 con 0x7f44180cd800 2023-05-22T01:34:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f440dffb700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f43fc0662f0 0x7f43fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f441d043700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f43fc0662f0 0x7f43fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4408021070 con 0x7f44180cd800 2023-05-22T01:34:05.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f440dffb700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7f43fc06c760 0x7f43fc06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 --> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43fc06f220 con 0x7f43fc06c760 2023-05-22T01:34:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4408087600 con 0x7f44180cd800 2023-05-22T01:34:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f441d844700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7f43fc06c760 0x7f43fc06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f441d043700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f43fc0662f0 0x7f43fc0687a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f44140012e0 tx=0x7f4414009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.010+0000 7f441d844700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7f43fc06c760 0x7f43fc06eb70 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.014+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== osd.4 v2:172.21.15.142:6808/2664279934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f43fc06f220 con 0x7f43fc06c760 2023-05-22T01:34:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 --> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f44180b52d0 con 0x7f43fc06c760 2023-05-22T01:34:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f440dffb700 1 -- 172.21.15.46:0/1178202953 <== osd.4 v2:172.21.15.142:6808/2664279934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f44180b52d0 con 0x7f43fc06c760 2023-05-22T01:34:05.072 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:05.075 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:05.075 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7f43fc06c760 msgr2=0x7f43fc06eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.142:6808/2664279934,v1:172.21.15.142:6809/2664279934] conn(0x7f43fc06c760 0x7f43fc06eb70 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f43fc0662f0 msgr2=0x7f43fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f43fc0662f0 0x7f43fc0687a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f44140012e0 tx=0x7f4414009040 comp rx=0 tx=0).stop 2023-05-22T01:34:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44180cd800 msgr2=0x7f44180c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 --2- 172.21.15.46:0/1178202953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44180cd800 0x7f44180c8a00 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f4408000c00 tx=0x7f4408004770 comp rx=0 tx=0).stop 2023-05-22T01:34:05.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441d844700 1 -- 172.21.15.46:0/1178202953 reap_dead start 2023-05-22T01:34:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 shutdown_connections 2023-05-22T01:34:05.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 >> 172.21.15.46:0/1178202953 conn(0x7f44180cfeb0 msgr2=0x7f441815b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 shutdown_connections 2023-05-22T01:34:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.034+0000 7f441e045700 1 -- 172.21.15.46:0/1178202953 wait complete. 2023-05-22T01:34:05.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-05-22T01:34:05.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 Processor -- start 2023-05-22T01:34:05.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 -- start start 2023-05-22T01:34:05.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0160be0 0x7f53d01651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53d0069f80 0x7f53d006a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00ade30 con 0x7f53d0070c50 2023-05-22T01:34:05.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00cd210 con 0x7f53d0069f80 2023-05-22T01:34:05.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d63b2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00cc970 con 0x7f53d0160be0 2023-05-22T01:34:05.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d4baf700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f53d0069f80 0x7f53d006a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d5bb1700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f53d0070c50 0x7f53d00c18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39306/0 (socket says 172.21.15.46:39306) 2023-05-22T01:34:05.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d5bb1700 1 -- 172.21.15.46:0/2056534872 learned_addr learned my addr 172.21.15.46:0/2056534872 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:05.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d53b0700 1 --2- 172.21.15.46:0/2056534872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0160be0 0x7f53d01651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d4baf700 1 -- 172.21.15.46:0/2056534872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0160be0 msgr2=0x7f53d01651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:05.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d4baf700 1 --2- 172.21.15.46:0/2056534872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0160be0 0x7f53d01651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d4baf700 1 -- 172.21.15.46:0/2056534872 >> v1:172.21.15.46:6789/0 conn(0x7f53d0070c50 legacy=0x7f53d00c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d4baf700 1 -- 172.21.15.46:0/2056534872 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00ccc50 con 0x7f53d0069f80 2023-05-22T01:34:05.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.202+0000 7f53d4baf700 1 --2- 172.21.15.46:0/2056534872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0069f80 0x7f53d006a3f0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009850 tx=0x7f53cc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439f0e48f04a866a server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53c7fff700 1 -- 172.21.15.46:0/2056534872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc011830 con 0x7f53d0069f80 2023-05-22T01:34:05.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53c7fff700 1 -- 172.21.15.46:0/2056534872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc011990 con 0x7f53d0069f80 2023-05-22T01:34:05.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53c7fff700 1 -- 172.21.15.46:0/2056534872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc011d40 con 0x7f53d0069f80 2023-05-22T01:34:05.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 -- 172.21.15.46:0/2056534872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0069f80 msgr2=0x7f53d006a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2056534872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0069f80 0x7f53d006a3f0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009850 tx=0x7f53cc009b60 comp rx=0 tx=0).stop 2023-05-22T01:34:05.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 -- 172.21.15.46:0/2056534872 shutdown_connections 2023-05-22T01:34:05.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2056534872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0069f80 0x7f53d006a3f0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2056534872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0160be0 0x7f53d01651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 -- 172.21.15.46:0/2056534872 >> 172.21.15.46:0/2056534872 conn(0x7f53d00cf720 msgr2=0x7f53d00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 -- 172.21.15.46:0/2056534872 shutdown_connections 2023-05-22T01:34:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 -- 172.21.15.46:0/2056534872 wait complete. 2023-05-22T01:34:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 Processor -- start 2023-05-22T01:34:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.206+0000 7f53d63b2700 1 -- start start 2023-05-22T01:34:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d0069f80 0x7f53d00c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0070c50 0x7f53d00c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 0x7f53d01fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c3f70 con 0x7f53d0160be0 2023-05-22T01:34:05.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c4250 con 0x7f53d0069f80 2023-05-22T01:34:05.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c4530 con 0x7f53d0070c50 2023-05-22T01:34:05.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 0x7f53d01fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d4baf700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0070c50 0x7f53d00c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 0x7f53d01fa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40606/0 (socket says 172.21.15.46:40606) 2023-05-22T01:34:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 -- 172.21.15.46:0/2783279367 learned_addr learned my addr 172.21.15.46:0/2783279367 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d53b0700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d0069f80 0x7f53d00c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 -- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0070c50 msgr2=0x7f53d00c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0070c50 0x7f53d00c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 -- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d0069f80 msgr2=0x7f53d00c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d0069f80 0x7f53d00c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 -- 172.21.15.46:0/2783279367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0094b0 con 0x7f53d0160be0 2023-05-22T01:34:05.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d5bb1700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 0x7f53d01fa1a0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f53c800cbc0 tx=0x7f53c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8007480 con 0x7f53d0160be0 2023-05-22T01:34:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c80075e0 con 0x7f53d0160be0 2023-05-22T01:34:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0070730 con 0x7f53d0160be0 2023-05-22T01:34:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8007950 con 0x7f53d0160be0 2023-05-22T01:34:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.210+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00ccf30 con 0x7f53d0160be0 2023-05-22T01:34:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.214+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d0165700 con 0x7f53d0160be0 2023-05-22T01:34:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.214+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53c8012400 con 0x7f53d0160be0 2023-05-22T01:34:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.214+0000 7f53c5ffb700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b40662f0 0x7f53b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.214+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f53c80832d0 con 0x7f53d0160be0 2023-05-22T01:34:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.214+0000 7f53d53b0700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b40662f0 0x7f53b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.214+0000 7f53d53b0700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b40662f0 0x7f53b40687a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b50 tx=0x7f53c0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.222+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f53c8050a80 con 0x7f53d0160be0 2023-05-22T01:34:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f53d00733b0 con 0x7f53b40662f0 2023-05-22T01:34:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53c5ffb700 1 -- 172.21.15.46:0/2783279367 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f53d00733b0 con 0x7f53b40662f0 2023-05-22T01:34:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b40662f0 msgr2=0x7f53b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b40662f0 0x7f53b40687a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b50 tx=0x7f53c0009240 comp rx=0 tx=0).stop 2023-05-22T01:34:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 msgr2=0x7f53d01fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 0x7f53d01fa1a0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f53c800cbc0 tx=0x7f53c800cbf0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 shutdown_connections 2023-05-22T01:34:05.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f53b40662f0 0x7f53b40687a0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53d0160be0 0x7f53d01fa1a0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0070c50 0x7f53d00c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 --2- 172.21.15.46:0/2783279367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d0069f80 0x7f53d00c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.386+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 >> 172.21.15.46:0/2783279367 conn(0x7f53d00cf720 msgr2=0x7f53d00b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.390+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 shutdown_connections 2023-05-22T01:34:05.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.390+0000 7f53d63b2700 1 -- 172.21.15.46:0/2783279367 wait complete. 2023-05-22T01:34:05.422 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2023-05-22T01:34:05.422 INFO:tasks.ceph:Scrubbing osd.5 2023-05-22T01:34:05.425 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:05.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.542+0000 7f835deff700 1 Processor -- start 2023-05-22T01:34:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- start start 2023-05-22T01:34:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580b4800 0x7f83580b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f83580d1ac0 0x7f83580b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580d0d00 con 0x7f83580d1f10 2023-05-22T01:34:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8358161520 con 0x7f83580d1ac0 2023-05-22T01:34:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580d0fe0 con 0x7f83580b4800 2023-05-22T01:34:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f8357fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f83580d1ac0 0x7f83580b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835cefd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580b4800 0x7f83580b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835d6fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f83580d1f10 0x7f83580b6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:34970/0 (socket says 172.21.15.46:34970) 2023-05-22T01:34:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835d6fe700 1 -- 172.21.15.46:0/3785272717 learned_addr learned my addr 172.21.15.46:0/3785272717 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f83577fe700 1 -- 172.21.15.46:0/3785272717 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072795263 0 0) 0x7f83580d0d00 con 0x7f83580d1f10 2023-05-22T01:34:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835cefd700 1 -- 172.21.15.46:0/3785272717 >> v2:172.21.15.142:3300/0 conn(0x7f83580d1ac0 msgr2=0x7f83580b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835cefd700 1 --2- 172.21.15.46:0/3785272717 >> v2:172.21.15.142:3300/0 conn(0x7f83580d1ac0 0x7f83580b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835cefd700 1 -- 172.21.15.46:0/3785272717 >> v1:172.21.15.142:6789/0 conn(0x7f83580d1f10 legacy=0x7f83580b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835cefd700 1 -- 172.21.15.46:0/3785272717 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580d12c0 con 0x7f83580b4800 2023-05-22T01:34:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835cefd700 1 --2- 172.21.15.46:0/3785272717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580b4800 0x7f83580b4bd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f834c009850 tx=0x7f834c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8697f08ca805c3b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f83577fe700 1 -- 172.21.15.46:0/3785272717 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c011830 con 0x7f83580b4800 2023-05-22T01:34:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f83577fe700 1 -- 172.21.15.46:0/3785272717 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c011990 con 0x7f83580b4800 2023-05-22T01:34:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f83577fe700 1 -- 172.21.15.46:0/3785272717 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c011d40 con 0x7f83580b4800 2023-05-22T01:34:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- 172.21.15.46:0/3785272717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580b4800 msgr2=0x7f83580b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 --2- 172.21.15.46:0/3785272717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580b4800 0x7f83580b4bd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f834c009850 tx=0x7f834c009b60 comp rx=0 tx=0).stop 2023-05-22T01:34:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- 172.21.15.46:0/3785272717 shutdown_connections 2023-05-22T01:34:05.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 --2- 172.21.15.46:0/3785272717 >> v2:172.21.15.142:3300/0 conn(0x7f83580d1ac0 0x7f83580b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 --2- 172.21.15.46:0/3785272717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580b4800 0x7f83580b4bd0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- 172.21.15.46:0/3785272717 >> 172.21.15.46:0/3785272717 conn(0x7f835806c170 msgr2=0x7f835806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- 172.21.15.46:0/3785272717 shutdown_connections 2023-05-22T01:34:05.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.546+0000 7f835deff700 1 -- 172.21.15.46:0/3785272717 wait complete. 2023-05-22T01:34:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.550+0000 7f835deff700 1 Processor -- start 2023-05-22T01:34:05.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.550+0000 7f835deff700 1 -- start start 2023-05-22T01:34:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.550+0000 7f835deff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83580b4800 0x7f835815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.550+0000 7f835deff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580d1ac0 0x7f83580b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83580d1f10 0x7f83580c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580b2b60 con 0x7f83580b4800 2023-05-22T01:34:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83580b4800 0x7f835815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83580b4800 0x7f835815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40610/0 (socket says 172.21.15.46:40610) 2023-05-22T01:34:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83581f68b0 con 0x7f83580d1f10 2023-05-22T01:34:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 -- 172.21.15.46:0/743843932 learned_addr learned my addr 172.21.15.46:0/743843932 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835815a9e0 con 0x7f83580d1ac0 2023-05-22T01:34:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f8357fff700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580d1ac0 0x7f83580b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835d6fe700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83580d1f10 0x7f83580c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 -- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580d1ac0 msgr2=0x7f83580b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83580d1ac0 0x7f83580b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 -- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83580d1f10 msgr2=0x7f83580c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83580d1f10 0x7f83580c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0094b0 con 0x7f83580b4800 2023-05-22T01:34:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835d6fe700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83580d1f10 0x7f83580c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835cefd700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83580b4800 0x7f835815a4a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f834c000c00 tx=0x7f834c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0045d0 con 0x7f83580b4800 2023-05-22T01:34:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c01f070 con 0x7f83580b4800 2023-05-22T01:34:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580b5110 con 0x7f83580b4800 2023-05-22T01:34:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0038e0 con 0x7f83580b4800 2023-05-22T01:34:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580d15a0 con 0x7f83580b4800 2023-05-22T01:34:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83580b2480 con 0x7f83580b4800 2023-05-22T01:34:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f834c003a40 con 0x7f83580b4800 2023-05-22T01:34:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.554+0000 7f83557fa700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f833c0662f0 0x7f833c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f834c021070 con 0x7f83580b4800 2023-05-22T01:34:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f8357fff700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f833c0662f0 0x7f833c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f83557fa700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f833c06c760 0x7f833c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f833c06f220 con 0x7f833c06c760 2023-05-22T01:34:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f834c0877b0 con 0x7f83580b4800 2023-05-22T01:34:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f835d6fe700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f833c06c760 0x7f833c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f8357fff700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f833c0662f0 0x7f833c0687a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f83580b7c20 tx=0x7f83440091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f835d6fe700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f833c06c760 0x7f833c06eb70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.558+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== osd.5 v2:172.21.15.142:6824/1063646432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f833c06f220 con 0x7f833c06c760 2023-05-22T01:34:05.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 --> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8358073cb0 con 0x7f833c06c760 2023-05-22T01:34:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f83557fa700 1 -- 172.21.15.46:0/743843932 <== osd.5 v2:172.21.15.142:6824/1063646432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8358073cb0 con 0x7f833c06c760 2023-05-22T01:34:05.625 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:05.625 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:05.625 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:05.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f833c06c760 msgr2=0x7f833c06eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.142:6824/1063646432,v1:172.21.15.142:6825/1063646432] conn(0x7f833c06c760 0x7f833c06eb70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f833c0662f0 msgr2=0x7f833c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f833c0662f0 0x7f833c0687a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f83580b7c20 tx=0x7f83440091c0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83580b4800 msgr2=0x7f835815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 --2- 172.21.15.46:0/743843932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83580b4800 0x7f835815a4a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f834c000c00 tx=0x7f834c004770 comp rx=0 tx=0).stop 2023-05-22T01:34:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835d6fe700 1 -- 172.21.15.46:0/743843932 reap_dead start 2023-05-22T01:34:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 shutdown_connections 2023-05-22T01:34:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 >> 172.21.15.46:0/743843932 conn(0x7f835806c170 msgr2=0x7f83580b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 shutdown_connections 2023-05-22T01:34:05.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.574+0000 7f835deff700 1 -- 172.21.15.46:0/743843932 wait complete. 2023-05-22T01:34:05.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-05-22T01:34:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.742+0000 7fdc2b200700 1 Processor -- start 2023-05-22T01:34:05.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.742+0000 7fdc2b200700 1 -- start start 2023-05-22T01:34:05.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.742+0000 7fdc2b200700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc2406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.742+0000 7fdc2b200700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240b3980 con 0x7fdc240cff30 2023-05-22T01:34:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240b3c60 con 0x7fdc24159470 2023-05-22T01:34:05.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b3f40 con 0x7fdc240cd5d0 2023-05-22T01:34:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2a9ff700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdc240cff30 0x7fdc2406db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39316/0 (socket says 172.21.15.46:39316) 2023-05-22T01:34:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc299fd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc2406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2a9ff700 1 -- 172.21.15.46:0/1777052866 learned_addr learned my addr 172.21.15.46:0/1777052866 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:05.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc299fd700 1 -- 172.21.15.46:0/1777052866 >> v1:172.21.15.142:6789/0 conn(0x7fdc24159470 legacy=0x7fdc240ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc299fd700 1 -- 172.21.15.46:0/1777052866 >> v1:172.21.15.46:6789/0 conn(0x7fdc240cff30 legacy=0x7fdc2406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc299fd700 1 -- 172.21.15.46:0/1777052866 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2406d120 con 0x7fdc240cd5d0 2023-05-22T01:34:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc299fd700 1 --2- 172.21.15.46:0/1777052866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc2406d640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009880 tx=0x7fdc18009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=176b7b61c5352a01 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc291fc700 1 -- 172.21.15.46:0/1777052866 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18011830 con 0x7fdc240cd5d0 2023-05-22T01:34:05.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc291fc700 1 -- 172.21.15.46:0/1777052866 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18011990 con 0x7fdc240cd5d0 2023-05-22T01:34:05.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc291fc700 1 -- 172.21.15.46:0/1777052866 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18011d20 con 0x7fdc240cd5d0 2023-05-22T01:34:05.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- 172.21.15.46:0/1777052866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 msgr2=0x7fdc2406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 --2- 172.21.15.46:0/1777052866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc2406d640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009880 tx=0x7fdc18009b90 comp rx=0 tx=0).stop 2023-05-22T01:34:05.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- 172.21.15.46:0/1777052866 shutdown_connections 2023-05-22T01:34:05.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 --2- 172.21.15.46:0/1777052866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc2406d640 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- 172.21.15.46:0/1777052866 >> 172.21.15.46:0/1777052866 conn(0x7fdc240cca00 msgr2=0x7fdc240cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- 172.21.15.46:0/1777052866 shutdown_connections 2023-05-22T01:34:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.746+0000 7fdc2b200700 1 -- 172.21.15.46:0/1777052866 wait complete. 2023-05-22T01:34:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 Processor -- start 2023-05-22T01:34:05.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 -- start start 2023-05-22T01:34:05.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc241f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc240cff30 0x7fdc240c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc24159470 0x7fdc240cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc241f2a50 con 0x7fdc24159470 2023-05-22T01:34:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240c4cb0 con 0x7fdc240cff30 2023-05-22T01:34:05.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240c4f90 con 0x7fdc240cd5d0 2023-05-22T01:34:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc24159470 0x7fdc240cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc241f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc241f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:60960/0 (socket says 172.21.15.46:60960) 2023-05-22T01:34:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc24159470 0x7fdc240cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40612/0 (socket says 172.21.15.46:40612) 2023-05-22T01:34:05.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 -- 172.21.15.46:0/3946871528 learned_addr learned my addr 172.21.15.46:0/3946871528 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc299fd700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc240cff30 0x7fdc240c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 -- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc240cff30 msgr2=0x7fdc240c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc240cff30 0x7fdc240c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 -- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc24159470 msgr2=0x7fdc240cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc24159470 0x7fdc240cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 -- 172.21.15.46:0/3946871528 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180094b0 con 0x7fdc240cd5d0 2023-05-22T01:34:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2a1fe700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc241f2510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400cbd0 tx=0x7fdc1400cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14003c20 con 0x7fdc240cd5d0 2023-05-22T01:34:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14003d80 con 0x7fdc240cd5d0 2023-05-22T01:34:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400aae0 con 0x7fdc240cd5d0 2023-05-22T01:34:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240b35d0 con 0x7fdc240cd5d0 2023-05-22T01:34:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.750+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc24159840 con 0x7fdc240cd5d0 2023-05-22T01:34:05.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.754+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc240b26f0 con 0x7fdc240cd5d0 2023-05-22T01:34:05.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.754+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc1400ac40 con 0x7fdc240cd5d0 2023-05-22T01:34:05.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.754+0000 7fdc22ffd700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc100662f0 0x7fdc100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:05.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.754+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdc14038030 con 0x7fdc240cd5d0 2023-05-22T01:34:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.754+0000 7fdc299fd700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc100662f0 0x7fdc100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.754+0000 7fdc299fd700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc100662f0 0x7fdc100687a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdc240cd9c0 tx=0x7fdc18008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.762+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdc14051b80 con 0x7fdc240cd5d0 2023-05-22T01:34:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.922+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc24067ac0 con 0x7fdc100662f0 2023-05-22T01:34:05.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.922+0000 7fdc22ffd700 1 -- 172.21.15.46:0/3946871528 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdc24067ac0 con 0x7fdc100662f0 2023-05-22T01:34:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc100662f0 msgr2=0x7fdc100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc100662f0 0x7fdc100687a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdc240cd9c0 tx=0x7fdc18008030 comp rx=0 tx=0).stop 2023-05-22T01:34:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 msgr2=0x7fdc241f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc241f2510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400cbd0 tx=0x7fdc1400cee0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 shutdown_connections 2023-05-22T01:34:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fdc100662f0 0x7fdc100687a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc24159470 0x7fdc240cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc240cff30 0x7fdc240c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 --2- 172.21.15.46:0/3946871528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc240cd5d0 0x7fdc241f2510 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 >> 172.21.15.46:0/3946871528 conn(0x7fdc240cca00 msgr2=0x7fdc240adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 shutdown_connections 2023-05-22T01:34:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:05.926+0000 7fdc2b200700 1 -- 172.21.15.46:0/3946871528 wait complete. 2023-05-22T01:34:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2023-05-22T01:34:05.965 INFO:tasks.ceph:Scrubbing osd.6 2023-05-22T01:34:05.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:06.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe2968700 1 Processor -- start 2023-05-22T01:34:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe2968700 1 -- start start 2023-05-22T01:34:06.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe2968700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc164580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe2968700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc159ab0 con 0x7f0fdc0ce080 2023-05-22T01:34:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe2968700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc15e010 con 0x7f0fdc0aeaf0 2023-05-22T01:34:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe2968700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0caee0 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe1165700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0fdc0ce080 0x7f0fdc15d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39326/0 (socket says 172.21.15.46:39326) 2023-05-22T01:34:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.082+0000 7f0fe1165700 1 -- 172.21.15.46:0/907895528 learned_addr learned my addr 172.21.15.46:0/907895528 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2167700 1 --2- 172.21.15.46:0/907895528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956450028 0 0) 0x7f0fdc159ab0 con 0x7f0fdc0ce080 2023-05-22T01:34:06.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc80035d0 con 0x7f0fdc0ce080 2023-05-22T01:34:06.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107304632 0 0) 0x7f0fdc15e010 con 0x7f0fdc0aeaf0 2023-05-22T01:34:06.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc159ab0 con 0x7f0fdc0aeaf0 2023-05-22T01:34:06.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2167700 1 -- 172.21.15.46:0/907895528 >> v1:172.21.15.142:6789/0 conn(0x7f0fdc0aeaf0 legacy=0x7f0fdc15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2167700 1 -- 172.21.15.46:0/907895528 >> v1:172.21.15.46:6789/0 conn(0x7f0fdc0ce080 legacy=0x7f0fdc15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2167700 1 -- 172.21.15.46:0/907895528 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0ce820 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2167700 1 --2- 172.21.15.46:0/907895528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc164580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009df0 tx=0x7f0fd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f787d7c612388d server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400e070 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd400bae0 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe0964700 1 -- 172.21.15.46:0/907895528 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400be90 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 -- 172.21.15.46:0/907895528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 msgr2=0x7f0fdc164580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 --2- 172.21.15.46:0/907895528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc164580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009df0 tx=0x7f0fd400b330 comp rx=0 tx=0).stop 2023-05-22T01:34:06.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 -- 172.21.15.46:0/907895528 shutdown_connections 2023-05-22T01:34:06.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 --2- 172.21.15.46:0/907895528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc164580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 -- 172.21.15.46:0/907895528 >> 172.21.15.46:0/907895528 conn(0x7f0fdc06d930 msgr2=0x7f0fdc06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 -- 172.21.15.46:0/907895528 shutdown_connections 2023-05-22T01:34:06.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.086+0000 7f0fe2968700 1 -- 172.21.15.46:0/907895528 wait complete. 2023-05-22T01:34:06.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 Processor -- start 2023-05-22T01:34:06.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 -- start start 2023-05-22T01:34:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fdc0aeaf0 0x7f0fdc0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc0ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fdc0ce080 0x7f0fdc15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0c7720 con 0x7f0fdc0ce080 2023-05-22T01:34:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0abe90 con 0x7f0fdc0aeaf0 2023-05-22T01:34:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2968700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0ac170 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2167700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fdc0ce080 0x7f0fdc15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2167700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fdc0ce080 0x7f0fdc15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40618/0 (socket says 172.21.15.46:40618) 2023-05-22T01:34:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2167700 1 -- 172.21.15.46:0/377620409 learned_addr learned my addr 172.21.15.46:0/377620409 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc0ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1966700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fdc0aeaf0 0x7f0fdc0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 -- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fdc0aeaf0 msgr2=0x7f0fdc0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fdc0aeaf0 0x7f0fdc0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 -- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fdc0ce080 msgr2=0x7f0fdc15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fdc0ce080 0x7f0fdc15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 -- 172.21.15.46:0/377620409 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009a70 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe2167700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fdc0ce080 0x7f0fdc15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:06.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.090+0000 7f0fe1165700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc0ab500 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0011e0 tx=0x7f0fcc00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc005b90 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc005d10 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc007310 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc0cede0 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc0ceb00 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fdc0cf0c0 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0fcc007470 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fd27fc700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fc00662f0 0x7f0fc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0fcc0a53d0 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.094+0000 7f0fe1966700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fc00662f0 0x7f0fc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fd27fc700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f0fc006c760 0x7f0fc006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 --> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fc006f220 con 0x7f0fc006c760 2023-05-22T01:34:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fcc0a5800 con 0x7f0fdc0cc3d0 2023-05-22T01:34:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fe2167700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f0fc006c760 0x7f0fc006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fe1966700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fc00662f0 0x7f0fc00687a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80011e0 tx=0x7f0fd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fe2167700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f0fc006c760 0x7f0fc006eb70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.098+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== osd.6 v2:172.21.15.142:6812/2773532653 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0fc006f220 con 0x7f0fc006c760 2023-05-22T01:34:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 --> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0fdc1f5980 con 0x7f0fc006c760 2023-05-22T01:34:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fd27fc700 1 -- 172.21.15.46:0/377620409 <== osd.6 v2:172.21.15.142:6812/2773532653 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0fdc1f5980 con 0x7f0fc006c760 2023-05-22T01:34:06.191 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:06.191 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:06.191 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:06.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f0fc006c760 msgr2=0x7f0fc006eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:6812/2773532653,v1:172.21.15.142:6815/2773532653] conn(0x7f0fc006c760 0x7f0fc006eb70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fc00662f0 msgr2=0x7f0fc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f0fc00662f0 0x7f0fc00687a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80011e0 tx=0x7f0fd8009040 comp rx=0 tx=0).stop 2023-05-22T01:34:06.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 msgr2=0x7f0fdc0ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 --2- 172.21.15.46:0/377620409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fdc0cc3d0 0x7f0fdc0ab500 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0011e0 tx=0x7f0fcc00c7b0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2167700 1 -- 172.21.15.46:0/377620409 reap_dead start 2023-05-22T01:34:06.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 shutdown_connections 2023-05-22T01:34:06.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 >> 172.21.15.46:0/377620409 conn(0x7f0fdc06d930 msgr2=0x7f0fdc0af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 shutdown_connections 2023-05-22T01:34:06.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.114+0000 7f0fe2968700 1 -- 172.21.15.46:0/377620409 wait complete. 2023-05-22T01:34:06.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-05-22T01:34:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 Processor -- start 2023-05-22T01:34:06.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- start start 2023-05-22T01:34:06.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c6806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c680b3980 con 0x7f6c68159470 2023-05-22T01:34:06.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c680b3c60 con 0x7f6c680cff30 2023-05-22T01:34:06.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680b3f40 con 0x7f6c680cd5d0 2023-05-22T01:34:06.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6d57c700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6c68159470 0x7f6c680ccec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39330/0 (socket says 172.21.15.46:39330) 2023-05-22T01:34:06.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6d57c700 1 -- 172.21.15.46:0/794947588 learned_addr learned my addr 172.21.15.46:0/794947588 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6cd7b700 1 --2- 172.21.15.46:0/794947588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c6806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c5ffff700 1 -- 172.21.15.46:0/794947588 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933439993 0 0) 0x7f6c680b3980 con 0x7f6c68159470 2023-05-22T01:34:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c5ffff700 1 -- 172.21.15.46:0/794947588 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c540035d0 con 0x7f6c68159470 2023-05-22T01:34:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/794947588 >> v1:172.21.15.142:6789/0 conn(0x7f6c680cff30 legacy=0x7f6c6806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c5ffff700 1 -- 172.21.15.46:0/794947588 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932412940 0 0) 0x7f6c540035d0 con 0x7f6c68159470 2023-05-22T01:34:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/794947588 >> v1:172.21.15.46:6789/0 conn(0x7f6c68159470 legacy=0x7f6c680ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/794947588 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6806d120 con 0x7f6c680cd5d0 2023-05-22T01:34:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6cd7b700 1 --2- 172.21.15.46:0/794947588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c6806d640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009880 tx=0x7f6c58009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba8f07c11e731e server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c5ffff700 1 -- 172.21.15.46:0/794947588 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64001670 con 0x7f6c680cd5d0 2023-05-22T01:34:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c5ffff700 1 -- 172.21.15.46:0/794947588 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58010590 con 0x7f6c680cd5d0 2023-05-22T01:34:06.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c5ffff700 1 -- 172.21.15.46:0/794947588 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58010940 con 0x7f6c680cd5d0 2023-05-22T01:34:06.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- 172.21.15.46:0/794947588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 msgr2=0x7f6c6806d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/794947588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c6806d640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009880 tx=0x7f6c58009b90 comp rx=0 tx=0).stop 2023-05-22T01:34:06.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- 172.21.15.46:0/794947588 shutdown_connections 2023-05-22T01:34:06.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/794947588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c6806d640 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.317+0000 7f6c6e57e700 1 -- 172.21.15.46:0/794947588 >> 172.21.15.46:0/794947588 conn(0x7f6c680cca00 msgr2=0x7f6c680cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 -- 172.21.15.46:0/794947588 shutdown_connections 2023-05-22T01:34:06.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 -- 172.21.15.46:0/794947588 wait complete. 2023-05-22T01:34:06.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 Processor -- start 2023-05-22T01:34:06.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 -- start start 2023-05-22T01:34:06.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c680c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 0x7f6c680c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c68159470 0x7f6c681542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c6900 con 0x7f6c680cff30 2023-05-22T01:34:06.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c68154110 con 0x7f6c68159470 2023-05-22T01:34:06.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6e57e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680ac2e0 con 0x7f6c680cd5d0 2023-05-22T01:34:06.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 0x7f6c680c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6d57c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c680c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 0x7f6c680c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40626/0 (socket says 172.21.15.46:40626) 2023-05-22T01:34:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/3919743056 learned_addr learned my addr 172.21.15.46:0/3919743056 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6dd7d700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c68159470 0x7f6c681542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 msgr2=0x7f6c680c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c680c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c68159470 msgr2=0x7f6c681542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c68159470 0x7f6c681542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 -- 172.21.15.46:0/3919743056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580094b0 con 0x7f6c680cff30 2023-05-22T01:34:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.321+0000 7f6c6cd7b700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 0x7f6c680c63c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f6c58013040 tx=0x7f6c58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58003d10 con 0x7f6c680cff30 2023-05-22T01:34:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58003e70 con 0x7f6c680cff30 2023-05-22T01:34:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c680b35d0 con 0x7f6c680cff30 2023-05-22T01:34:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58010920 con 0x7f6c680cff30 2023-05-22T01:34:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c68159840 con 0x7f6c680cff30 2023-05-22T01:34:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c58010a80 con 0x7f6c680cff30 2023-05-22T01:34:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c680b26f0 con 0x7f6c680cff30 2023-05-22T01:34:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c5dffb700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6c4c0662f0 0x7f6c4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6c58084af0 con 0x7f6c680cff30 2023-05-22T01:34:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.325+0000 7f6c6d57c700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6c4c0662f0 0x7f6c4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.329+0000 7f6c6d57c700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6c4c0662f0 0x7f6c4c0687a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6c64001200 tx=0x7f6c64001130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.333+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6c58052330 con 0x7f6c680cff30 2023-05-22T01:34:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.513+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c68067ac0 con 0x7f6c4c0662f0 2023-05-22T01:34:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.513+0000 7f6c5dffb700 1 -- 172.21.15.46:0/3919743056 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c68067ac0 con 0x7f6c4c0662f0 2023-05-22T01:34:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6c4c0662f0 msgr2=0x7f6c4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6c4c0662f0 0x7f6c4c0687a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6c64001200 tx=0x7f6c64001130 comp rx=0 tx=0).stop 2023-05-22T01:34:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 msgr2=0x7f6c680c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 0x7f6c680c63c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f6c58013040 tx=0x7f6c58004770 comp rx=0 tx=0).stop 2023-05-22T01:34:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 shutdown_connections 2023-05-22T01:34:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6c4c0662f0 0x7f6c4c0687a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c68159470 0x7f6c681542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c680cff30 0x7f6c680c63c0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 --2- 172.21.15.46:0/3919743056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c680cd5d0 0x7f6c680c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 >> 172.21.15.46:0/3919743056 conn(0x7f6c680cca00 msgr2=0x7f6c680afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 shutdown_connections 2023-05-22T01:34:06.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.517+0000 7f6c6e57e700 1 -- 172.21.15.46:0/3919743056 wait complete. 2023-05-22T01:34:06.546 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2023-05-22T01:34:06.546 INFO:tasks.ceph:Scrubbing osd.7 2023-05-22T01:34:06.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-05-22T01:34:06.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 Processor -- start 2023-05-22T01:34:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- start start 2023-05-22T01:34:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83780e5ea0 0x7f8378057840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8378057d80 con 0x7f837803b3f0 2023-05-22T01:34:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8378057fb0 con 0x7f8378055520 2023-05-22T01:34:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837803c150 con 0x7f83780e5ea0 2023-05-22T01:34:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83780e5ea0 0x7f8378057840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83780e5ea0 0x7f8378057840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40630/0 (socket says 172.21.15.46:40630) 2023-05-22T01:34:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 -- 172.21.15.46:0/865530641 learned_addr learned my addr 172.21.15.46:0/865530641 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8384c86700 1 --1- 172.21.15.46:0/865530641 >> v1:172.21.15.46:6789/0 conn(0x7f837803b3f0 0x7f837803c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39346/0 (socket says 172.21.15.46:39346) 2023-05-22T01:34:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 -- 172.21.15.46:0/865530641 >> v1:172.21.15.142:6789/0 conn(0x7f8378055520 legacy=0x7f837803ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 -- 172.21.15.46:0/865530641 >> v1:172.21.15.46:6789/0 conn(0x7f837803b3f0 legacy=0x7f837803c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 -- 172.21.15.46:0/865530641 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83780539e0 con 0x7f83780e5ea0 2023-05-22T01:34:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837ffff700 1 --2- 172.21.15.46:0/865530641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83780e5ea0 0x7f8378057840 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f8370009910 tx=0x7f8370009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb8f20c9175ace server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837effd700 1 -- 172.21.15.46:0/865530641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000ba60 con 0x7f83780e5ea0 2023-05-22T01:34:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837effd700 1 -- 172.21.15.46:0/865530641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000bbc0 con 0x7f83780e5ea0 2023-05-22T01:34:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f837effd700 1 -- 172.21.15.46:0/865530641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370009e60 con 0x7f83780e5ea0 2023-05-22T01:34:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- 172.21.15.46:0/865530641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83780e5ea0 msgr2=0x7f8378057840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 --2- 172.21.15.46:0/865530641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83780e5ea0 0x7f8378057840 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f8370009910 tx=0x7f8370009c20 comp rx=0 tx=0).stop 2023-05-22T01:34:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- 172.21.15.46:0/865530641 shutdown_connections 2023-05-22T01:34:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 --2- 172.21.15.46:0/865530641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83780e5ea0 0x7f8378057840 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- 172.21.15.46:0/865530641 >> 172.21.15.46:0/865530641 conn(0x7f8378055ce0 msgr2=0x7f83780560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- 172.21.15.46:0/865530641 shutdown_connections 2023-05-22T01:34:06.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.657+0000 7f8385487700 1 -- 172.21.15.46:0/865530641 wait complete. 2023-05-22T01:34:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 Processor -- start 2023-05-22T01:34:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- start start 2023-05-22T01:34:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f837803b3f0 0x7f837804d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8378055520 0x7f837804e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83780e5ea0 0x7f83780cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837804dd50 con 0x7f8378055520 2023-05-22T01:34:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780508d0 con 0x7f83780e5ea0 2023-05-22T01:34:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8378050bb0 con 0x7f837803b3f0 2023-05-22T01:34:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8378055520 0x7f837804e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8378055520 0x7f837804e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40636/0 (socket says 172.21.15.46:40636) 2023-05-22T01:34:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 -- 172.21.15.46:0/754342269 learned_addr learned my addr 172.21.15.46:0/754342269 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8384c86700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83780e5ea0 0x7f83780cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837ffff700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f837803b3f0 0x7f837804d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 -- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f837803b3f0 msgr2=0x7f837804d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f837803b3f0 0x7f837804d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 -- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83780e5ea0 msgr2=0x7f83780cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83780e5ea0 0x7f83780cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 -- 172.21.15.46:0/754342269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370009570 con 0x7f8378055520 2023-05-22T01:34:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837f7fe700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8378055520 0x7f837804e200 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f837400c500 tx=0x7f837400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740052d0 con 0x7f8378055520 2023-05-22T01:34:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374005430 con 0x7f8378055520 2023-05-22T01:34:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83780e6270 con 0x7f8378055520 2023-05-22T01:34:06.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740055a0 con 0x7f8378055520 2023-05-22T01:34:06.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8378053cc0 con 0x7f8378055520 2023-05-22T01:34:06.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.661+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83780559a0 con 0x7f8378055520 2023-05-22T01:34:06.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83740038e0 con 0x7f8378055520 2023-05-22T01:34:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837cff9700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f836c0662f0 0x7f836c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8374082d80 con 0x7f8378055520 2023-05-22T01:34:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837ffff700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f836c0662f0 0x7f836c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837cff9700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7f836c06c760 0x7f836c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 --> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f836c06f220 con 0x7f836c06c760 2023-05-22T01:34:06.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83740853c0 con 0x7f8378055520 2023-05-22T01:34:06.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f8384c86700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7f836c06c760 0x7f836c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f837ffff700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f836c0662f0 0x7f836c0687a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8370006f80 tx=0x7f8370008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.665+0000 7f8384c86700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7f836c06c760 0x7f836c06eb70 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.669+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== osd.7 v2:172.21.15.142:6800/3864156149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f836c06f220 con 0x7f836c06c760 2023-05-22T01:34:06.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 --> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8378005990 con 0x7f836c06c760 2023-05-22T01:34:06.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f837cff9700 1 -- 172.21.15.46:0/754342269 <== osd.7 v2:172.21.15.142:6800/3864156149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8378005990 con 0x7f836c06c760 2023-05-22T01:34:06.754 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-05-22T01:34:06.754 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-05-22T01:34:06.766 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-05-22T01:34:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7f836c06c760 msgr2=0x7f836c06eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.142:6800/3864156149,v1:172.21.15.142:6801/3864156149] conn(0x7f836c06c760 0x7f836c06eb70 crc :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f836c0662f0 msgr2=0x7f836c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f836c0662f0 0x7f836c0687a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8370006f80 tx=0x7f8370008030 comp rx=0 tx=0).stop 2023-05-22T01:34:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8378055520 msgr2=0x7f837804e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 --2- 172.21.15.46:0/754342269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8378055520 0x7f837804e200 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f837400c500 tx=0x7f837400c810 comp rx=0 tx=0).stop 2023-05-22T01:34:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8384c86700 1 -- 172.21.15.46:0/754342269 reap_dead start 2023-05-22T01:34:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 shutdown_connections 2023-05-22T01:34:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 >> 172.21.15.46:0/754342269 conn(0x7f8378055ce0 msgr2=0x7f83780e00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 shutdown_connections 2023-05-22T01:34:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.693+0000 7f8385487700 1 -- 172.21.15.46:0/754342269 wait complete. 2023-05-22T01:34:06.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-05-22T01:34:06.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 Processor -- start 2023-05-22T01:34:06.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 -- start start 2023-05-22T01:34:06.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a1815a2b0 0x7f6a1806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6a1815e8c0 0x7f6a180ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180caeb0 con 0x7f6a180caa90 2023-05-22T01:34:06.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1806a990 con 0x7f6a1815e8c0 2023-05-22T01:34:06.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a17fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1806ac70 con 0x7f6a1815a2b0 2023-05-22T01:34:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a167fc700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6a1815e8c0 0x7f6a180ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a177fe700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6a180caa90 0x7f6a180b15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39350/0 (socket says 172.21.15.46:39350) 2023-05-22T01:34:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a177fe700 1 -- 172.21.15.46:0/2718208396 learned_addr learned my addr 172.21.15.46:0/2718208396 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a16ffd700 1 --2- 172.21.15.46:0/2718208396 >> v2:172.21.15.142:3300/0 conn(0x7f6a1815a2b0 0x7f6a1806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.909+0000 7f6a15ffb700 1 -- 172.21.15.46:0/2718208396 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054692606 0 0) 0x7f6a180caeb0 con 0x7f6a180caa90 2023-05-22T01:34:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a15ffb700 1 -- 172.21.15.46:0/2718208396 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a000035d0 con 0x7f6a180caa90 2023-05-22T01:34:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a167fc700 1 -- 172.21.15.46:0/2718208396 >> v2:172.21.15.142:3300/0 conn(0x7f6a1815a2b0 msgr2=0x7f6a1806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a167fc700 1 --2- 172.21.15.46:0/2718208396 >> v2:172.21.15.142:3300/0 conn(0x7f6a1815a2b0 0x7f6a1806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a167fc700 1 -- 172.21.15.46:0/2718208396 >> v1:172.21.15.46:6789/0 conn(0x7f6a180caa90 legacy=0x7f6a180b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a167fc700 1 -- 172.21.15.46:0/2718208396 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1806b120 con 0x7f6a1815e8c0 2023-05-22T01:34:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a167fc700 1 --2- 172.21.15.46:0/2718208396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a1815e8c0 0x7f6a180ca550 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f6a180b26a0 tx=0x7f6a0c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f861d183da85492 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a15ffb700 1 -- 172.21.15.46:0/2718208396 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c011830 con 0x7f6a1815e8c0 2023-05-22T01:34:06.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a15ffb700 1 -- 172.21.15.46:0/2718208396 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c011990 con 0x7f6a1815e8c0 2023-05-22T01:34:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a15ffb700 1 -- 172.21.15.46:0/2718208396 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c011d20 con 0x7f6a1815e8c0 2023-05-22T01:34:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 -- 172.21.15.46:0/2718208396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a1815e8c0 msgr2=0x7f6a180ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 --2- 172.21.15.46:0/2718208396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a1815e8c0 0x7f6a180ca550 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f6a180b26a0 tx=0x7f6a0c009b30 comp rx=0 tx=0).stop 2023-05-22T01:34:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 -- 172.21.15.46:0/2718208396 shutdown_connections 2023-05-22T01:34:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 --2- 172.21.15.46:0/2718208396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a1815e8c0 0x7f6a180ca550 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 --2- 172.21.15.46:0/2718208396 >> v2:172.21.15.142:3300/0 conn(0x7f6a1815a2b0 0x7f6a1806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 -- 172.21.15.46:0/2718208396 >> 172.21.15.46:0/2718208396 conn(0x7f6a1806d8f0 msgr2=0x7f6a1806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 -- 172.21.15.46:0/2718208396 shutdown_connections 2023-05-22T01:34:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 -- 172.21.15.46:0/2718208396 wait complete. 2023-05-22T01:34:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 Processor -- start 2023-05-22T01:34:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.913+0000 7f6a17fff700 1 -- start start 2023-05-22T01:34:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 0x7f6a181540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1815a2b0 0x7f6a180cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1815e8c0 0x7f6a180b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180c8520 con 0x7f6a180caa90 2023-05-22T01:34:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 0x7f6a181540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18154600 con 0x7f6a1815e8c0 2023-05-22T01:34:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180ce200 con 0x7f6a1815a2b0 2023-05-22T01:34:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 0x7f6a181540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40656/0 (socket says 172.21.15.46:40656) 2023-05-22T01:34:07.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 -- 172.21.15.46:0/1210294328 learned_addr learned my addr 172.21.15.46:0/1210294328 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:07.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a177fe700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1815e8c0 0x7f6a180b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 -- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1815a2b0 msgr2=0x7f6a180cdcc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-22T01:34:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1815a2b0 0x7f6a180cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 -- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1815e8c0 msgr2=0x7f6a180b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1815e8c0 0x7f6a180b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 -- 172.21.15.46:0/1210294328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0094b0 con 0x7f6a180caa90 2023-05-22T01:34:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a16ffd700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 0x7f6a181540c0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800ea00 tx=0x7f6a0800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08009720 con 0x7f6a180caa90 2023-05-22T01:34:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800c850 con 0x7f6a180caa90 2023-05-22T01:34:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180cb2c0 con 0x7f6a180caa90 2023-05-22T01:34:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800cbc0 con 0x7f6a180caa90 2023-05-22T01:34:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1806b400 con 0x7f6a180caa90 2023-05-22T01:34:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a18067ac0 con 0x7f6a180caa90 2023-05-22T01:34:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.917+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a08013470 con 0x7f6a180caa90 2023-05-22T01:34:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.921+0000 7f69ff7fe700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a04066340 0x7f6a040687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.921+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6a08083a90 con 0x7f6a180caa90 2023-05-22T01:34:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.921+0000 7f6a167fc700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a04066340 0x7f6a040687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.921+0000 7f6a167fc700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a04066340 0x7f6a040687f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6a1806ceb0 tx=0x7f6a0c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:07.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:06.925+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6a08054da0 con 0x7f6a180caa90 2023-05-22T01:34:07.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.081+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a180b29a0 con 0x7f6a04066340 2023-05-22T01:34:07.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.081+0000 7f69ff7fe700 1 -- 172.21.15.46:0/1210294328 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a180b29a0 con 0x7f6a04066340 2023-05-22T01:34:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a04066340 msgr2=0x7f6a040687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a04066340 0x7f6a040687f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6a1806ceb0 tx=0x7f6a0c010000 comp rx=0 tx=0).stop 2023-05-22T01:34:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 msgr2=0x7f6a181540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 0x7f6a181540c0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800ea00 tx=0x7f6a0800edc0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 shutdown_connections 2023-05-22T01:34:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f6a04066340 0x7f6a040687f0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1815e8c0 0x7f6a180b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1815a2b0 0x7f6a180cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 --2- 172.21.15.46:0/1210294328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a180caa90 0x7f6a181540c0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 >> 172.21.15.46:0/1210294328 conn(0x7f6a1806d8f0 msgr2=0x7f6a18159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 shutdown_connections 2023-05-22T01:34:07.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.085+0000 7f6a17fff700 1 -- 172.21.15.46:0/1210294328 wait complete. 2023-05-22T01:34:07.105 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2023-05-22T01:34:07.114 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-22T01:34:07.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 Processor -- start 2023-05-22T01:34:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- start start 2023-05-22T01:34:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00d00514c0 0x7f00d0053020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 0x7f00d000c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d00554f0 con 0x7f00d00e0750 2023-05-22T01:34:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d000cdd0 con 0x7f00d00514c0 2023-05-22T01:34:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d003a460 con 0x7f00d000c410 2023-05-22T01:34:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d6ffd700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f00d00e0750 0x7f00d0039d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39360/0 (socket says 172.21.15.46:39360) 2023-05-22T01:34:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d6ffd700 1 -- 172.21.15.46:0/1212119501 learned_addr learned my addr 172.21.15.46:0/1212119501 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:07.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d77fe700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 0x7f00d000c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1212119501 >> v2:172.21.15.142:3300/0 conn(0x7f00d00514c0 0x7f00d0053020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943511809 0 0) 0x7f00d00554f0 con 0x7f00d00e0750 2023-05-22T01:34:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c00035d0 con 0x7f00d00e0750 2023-05-22T01:34:07.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1557718636 0 0) 0x7f00c00035d0 con 0x7f00d00e0750 2023-05-22T01:34:07.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 msgr2=0x7f00d000c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:07.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 0x7f00d000c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 >> v2:172.21.15.142:3300/0 conn(0x7f00d00514c0 msgr2=0x7f00d0053020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:07.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 --2- 172.21.15.46:0/1212119501 >> v2:172.21.15.142:3300/0 conn(0x7f00d00514c0 0x7f00d0053020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00e0b20 con 0x7f00d00e0750 2023-05-22T01:34:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1716786547 0 0) 0x7f00c8001670 con 0x7f00d00e0750 2023-05-22T01:34:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 >> v1:172.21.15.46:6789/0 conn(0x7f00d00e0750 legacy=0x7f00d0039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00c0003a20 0x7f00c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00c0004450 0x7f00c0004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 0x7f00c0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d000cdd0 con 0x7f00c0004450 2023-05-22T01:34:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d003a460 con 0x7f00c0003a20 2023-05-22T01:34:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0009a20 con 0x7f00d000c410 2023-05-22T01:34:07.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00c0004450 0x7f00c0004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d6ffd700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00c0003a20 0x7f00c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d77fe700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 0x7f00c0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 -- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 msgr2=0x7f00c0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:07.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d000c410 0x7f00c0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 -- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00c0003a20 msgr2=0x7f00c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00c0003a20 0x7f00c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 -- 172.21.15.46:0/1212119501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00035d0 con 0x7f00c0004450 2023-05-22T01:34:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d6ffd700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00c0003a20 0x7f00c0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00c0004450 0x7f00c0004910 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009b70 tx=0x7f00c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31e51e80ab0ce1b server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:07.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00e6c0 con 0x7f00c0004450 2023-05-22T01:34:07.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00e820 con 0x7f00c0004450 2023-05-22T01:34:07.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d5ffb700 1 -- 172.21.15.46:0/1212119501 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00eb90 con 0x7f00c0004450 2023-05-22T01:34:07.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- 172.21.15.46:0/1212119501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00c0004450 msgr2=0x7f00c0004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1212119501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00c0004450 0x7f00c0004910 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009b70 tx=0x7f00c00058a0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d77fe700 1 -- 172.21.15.46:0/1212119501 reap_dead start 2023-05-22T01:34:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- 172.21.15.46:0/1212119501 shutdown_connections 2023-05-22T01:34:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- 172.21.15.46:0/1212119501 >> 172.21.15.46:0/1212119501 conn(0x7f00d0056f00 msgr2=0x7f00d0057300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- 172.21.15.46:0/1212119501 shutdown_connections 2023-05-22T01:34:07.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.225+0000 7f00d7fff700 1 -- 172.21.15.46:0/1212119501 wait complete. 2023-05-22T01:34:07.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 Processor -- start 2023-05-22T01:34:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 -- start start 2023-05-22T01:34:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00d002d8b0 0x7f00d002dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 0x7f00d0173770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d0173cb0 0x7f00d0176d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0039360 con 0x7f00d00389d0 2023-05-22T01:34:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0174780 con 0x7f00d002d8b0 2023-05-22T01:34:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d7fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d002e1c0 con 0x7f00d0173cb0 2023-05-22T01:34:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 0x7f00d0173770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 0x7f00d0173770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40664/0 (socket says 172.21.15.46:40664) 2023-05-22T01:34:07.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00d002d8b0 0x7f00d002dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 -- 172.21.15.46:0/1627595186 learned_addr learned my addr 172.21.15.46:0/1627595186 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d77fe700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d0173cb0 0x7f00d0176d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 -- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d0173cb0 msgr2=0x7f00d0176d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d0173cb0 0x7f00d0176d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 -- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00d002d8b0 msgr2=0x7f00d002dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00d002d8b0 0x7f00d002dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 -- 172.21.15.46:0/1627595186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0055a70 con 0x7f00d00389d0 2023-05-22T01:34:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.229+0000 7f00d67fc700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 0x7f00d0173770 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f00cc016000 tx=0x7f00cc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00e6c0 con 0x7f00d00389d0 2023-05-22T01:34:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d0055790 con 0x7f00d00389d0 2023-05-22T01:34:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0038c0 con 0x7f00d00389d0 2023-05-22T01:34:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00e6c0 con 0x7f00d00389d0 2023-05-22T01:34:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d0055d50 con 0x7f00d00389d0 2023-05-22T01:34:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d000af70 con 0x7f00d00389d0 2023-05-22T01:34:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00cc003a30 con 0x7f00d00389d0 2023-05-22T01:34:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00bf7fe700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00c4066380 0x7f00c4068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f00cc084740 con 0x7f00d00389d0 2023-05-22T01:34:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00d6ffd700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00c4066380 0x7f00c4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.233+0000 7f00d6ffd700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00c4066380 0x7f00c4068830 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f00d00def90 tx=0x7f00c8007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.237+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f00d000af70 con 0x7f00d00389d0 2023-05-22T01:34:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.397+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00d000af70 con 0x7f00c4066380 2023-05-22T01:34:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00bf7fe700 1 -- 172.21.15.46:0/1627595186 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70919 (secure 0 0 0) 0x7f00d000af70 con 0x7f00c4066380 2023-05-22T01:34:07.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:07.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00c4066380 msgr2=0x7f00c4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00c4066380 0x7f00c4068830 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f00d00def90 tx=0x7f00c8007040 comp rx=0 tx=0).stop 2023-05-22T01:34:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 msgr2=0x7f00d0173770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 0x7f00d0173770 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f00cc016000 tx=0x7f00cc0047e0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 shutdown_connections 2023-05-22T01:34:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f00c4066380 0x7f00c4068830 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00d0173cb0 0x7f00d0176d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00d00389d0 0x7f00d0173770 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 --2- 172.21.15.46:0/1627595186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00d002d8b0 0x7f00d002dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.405+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 >> 172.21.15.46:0/1627595186 conn(0x7f00d0056f00 msgr2=0x7f00d0004cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.409+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 shutdown_connections 2023-05-22T01:34:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:07.409+0000 7f00d7fff700 1 -- 172.21.15.46:0/1627595186 wait complete. 2023-05-22T01:34:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-22T01:34:07.466 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":15631,"stamp":"2023-05-22T01:34:06.015337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8141864,"kb_used_data":5096,"kb_used_omap":47479,"kb_used_meta":8089224,"kb_avail":746832856,"statfs":{"total":773094113280,"available":764756844544,"internally_reserved":0,"allocated":5218304,"data_stored":2873120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48619470,"internal_metadata":8283365426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003406"},"pg_stats":[{"pgid":"1.0","version":"40'161","reported_seq":524,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945351+0000","last_change":"2023-05-21T16:54:08.725212+0000","last_active":"2023-05-22T01:33:38.945351+0000","last_peered":"2023-05-22T01:33:38.945351+0000","last_clean":"2023-05-22T01:33:38.945351+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-22T01:33:38.945351+0000","last_undegraded":"2023-05-22T01:33:38.945351+0000","last_fullsized":"2023-05-22T01:33:38.945351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:07.391844+0000","last_clean_scrub_stamp":"2023-05-21T16:54:07.391844+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T00:51:17.569979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.073441+0000","last_change":"2023-05-21T16:54:13.637219+0000","last_active":"2023-05-22T01:33:38.073441+0000","last_peered":"2023-05-22T01:33:38.073441+0000","last_clean":"2023-05-22T01:33:38.073441+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-22T01:33:38.073441+0000","last_undegraded":"2023-05-22T01:33:38.073441+0000","last_fullsized":"2023-05-22T01:33:38.073441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:26:33.334567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.942345+0000","last_change":"2023-05-21T16:54:13.637227+0000","last_active":"2023-05-22T01:33:38.942345+0000","last_peered":"2023-05-22T01:33:38.942345+0000","last_clean":"2023-05-22T01:33:38.942345+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-22T01:33:38.942345+0000","last_undegraded":"2023-05-22T01:33:38.942345+0000","last_fullsized":"2023-05-22T01:33:38.942345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:15:27.801927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":299,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.573891+0000","last_change":"2023-05-21T16:54:13.711489+0000","last_active":"2023-05-22T01:33:37.573891+0000","last_peered":"2023-05-22T01:33:37.573891+0000","last_clean":"2023-05-22T01:33:37.573891+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-22T01:33:37.573891+0000","last_undegraded":"2023-05-22T01:33:37.573891+0000","last_fullsized":"2023-05-22T01:33:37.573891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T22:31:00.057381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":306,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:37.653638+0000","last_change":"2023-05-21T16:54:13.636827+0000","last_active":"2023-05-22T01:33:37.653638+0000","last_peered":"2023-05-22T01:33:37.653638+0000","last_clean":"2023-05-22T01:33:37.653638+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-22T01:33:37.653638+0000","last_undegraded":"2023-05-22T01:33:37.653638+0000","last_fullsized":"2023-05-22T01:33:37.653638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T21:54:43.079830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":302,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.006714+0000","last_change":"2023-05-21T16:54:13.713358+0000","last_active":"2023-05-22T01:33:38.006714+0000","last_peered":"2023-05-22T01:33:38.006714+0000","last_clean":"2023-05-22T01:33:38.006714+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-22T01:33:38.006714+0000","last_undegraded":"2023-05-22T01:33:38.006714+0000","last_fullsized":"2023-05-22T01:33:38.006714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":305,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.945172+0000","last_change":"2023-05-21T16:54:13.712446+0000","last_active":"2023-05-22T01:33:38.945172+0000","last_peered":"2023-05-22T01:33:38.945172+0000","last_clean":"2023-05-22T01:33:38.945172+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-22T01:33:38.945172+0000","last_undegraded":"2023-05-22T01:33:38.945172+0000","last_fullsized":"2023-05-22T01:33:38.945172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T01:25:24.904929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":294,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.010182+0000","last_change":"2023-05-21T16:54:13.639316+0000","last_active":"2023-05-22T01:33:38.010182+0000","last_peered":"2023-05-22T01:33:38.010182+0000","last_clean":"2023-05-22T01:33:38.010182+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-22T01:33:38.010182+0000","last_undegraded":"2023-05-22T01:33:38.010182+0000","last_fullsized":"2023-05-22T01:33:38.010182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:33:38.742907+0000","last_change":"2023-05-21T16:54:13.639248+0000","last_active":"2023-05-22T01:33:38.742907+0000","last_peered":"2023-05-22T01:33:38.742907+0000","last_clean":"2023-05-22T01:33:38.742907+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-22T01:33:38.742907+0000","last_undegraded":"2023-05-22T01:33:38.742907+0000","last_fullsized":"2023-05-22T01:33:38.742907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-21T16:54:12.618215+0000","last_clean_scrub_stamp":"2023-05-21T16:54:12.618215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-22T20:00:13.169152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581089,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119864,"kb_used_data":1072,"kb_used_omap":3881,"kb_used_meta":1114902,"kb_avail":93251976,"statfs":{"total":96636764160,"available":95490023424,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3974582,"internal_metadata":1141660234},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.85899999999999999,"15min":0.95799999999999996},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":5.9900000000000002,"5min":5.9900000000000002,"15min":8.157},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.288,"5min":0.81899999999999995,"15min":0.872},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":6.1230000000000002,"5min":6.6349999999999998,"15min":6.7430000000000003},"last":0.68899999999999995}]},{"osd":1,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":0.94999999999999996,"15min":0.95699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28899999999999998},"max":{"1min":14.869,"5min":14.869,"15min":14.869},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.8109999999999999,"5min":1.274,"15min":1.21},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":14.644,"5min":14.644,"15min":14.644},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1910000000000001,"15min":1.1899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30599999999999999},"max":{"1min":4.0519999999999996,"5min":9.8300000000000001,"15min":9.8300000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.139,"15min":1.095},"min":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":6.1660000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":0.871}]},{"osd":3,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":1.0980000000000001,"15min":1.145},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.32900000000000001},"max":{"1min":3.1150000000000002,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":0.753},{"interface":"front","average":{"1min":1.766,"5min":1.159,"15min":1.3120000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":8.9600000000000009,"5min":8.9600000000000009,"15min":10.041},"last":0.80500000000000005}]},{"osd":4,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":0.78700000000000003,"15min":0.873},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":6.0330000000000004,"5min":6.5339999999999998,"15min":8.5380000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.202,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.318},"max":{"1min":6.1059999999999999,"5min":6.7610000000000001,"15min":6.7610000000000001},"last":0.82899999999999996}]},{"osd":5,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.96699999999999997,"15min":0.96099999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":4.1340000000000003,"5min":6.2670000000000003,"15min":7.931},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.44500000000000001,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":0.94699999999999995}]},{"osd":6,"last update":"Mon May 22 01:33:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.91200000000000003,"15min":1.0109999999999999},"min":{"1min":0.41899999999999998,"5min":0.41099999999999998,"15min":0.36499999999999999},"max":{"1min":6.133,"5min":6.6600000000000001,"15min":6.8179999999999996},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.47899999999999998,"5min":0.40100000000000002,"15min":0.38700000000000001},"max":{"1min":2.9180000000000001,"5min":6.8090000000000002,"15min":8.0760000000000005},"last":1.0800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834581089,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838900,"kb_used_data":492,"kb_used_omap":4141,"kb_used_meta":834258,"kb_avail":93532940,"statfs":{"total":96636764160,"available":95777730560,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4241217,"internal_metadata":854280383},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.633,"15min":1.048},"min":{"1min":0.27700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.721,"5min":54.807000000000002,"15min":54.807000000000002},"last":0.83099999999999996},{"interface":"front","average":{"1min":2.661,"5min":1.9219999999999999,"15min":1.3029999999999999},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":13.321999999999999,"5min":54.838999999999999,"15min":54.838999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.1699999999999999,"15min":1.105},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":6.6050000000000004,"5min":8.7699999999999996,"15min":8.7699999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":2.6349999999999998,"5min":1.468,"15min":1.2869999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":31.484999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.369,"15min":1.3069999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":14.484,"5min":14.484,"15min":14.484},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.238,"15min":1.218},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":6.6360000000000001,"5min":8.8719999999999999,"15min":9.3499999999999996},"last":0.78000000000000003}]},{"osd":3,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":2.1299999999999999,"15min":1.5940000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":5.7649999999999997,"5min":55.756999999999998,"15min":55.756999999999998},"last":0.628},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.7110000000000001,"15min":1.3240000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.319,"5min":54.451999999999998,"15min":54.451999999999998},"last":0.86299999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0920000000000001,"15min":1.0129999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0920000000000005,"5min":9.8879999999999999,"15min":9.8879999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":2.0289999999999999,"5min":1.246,"15min":1.095},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.92800000000000005,"15min":0.99299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":3.7570000000000001,"5min":5.601,"15min":7.6219999999999999},"last":1.161},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.135,"15min":1.1950000000000001},"min":{"1min":0.48299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":9.7249999999999996,"5min":9.7249999999999996,"15min":9.7249999999999996},"last":1.0369999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.171,"15min":1.0529999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36899999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.248,"5min":1.1279999999999999,"15min":1.0609999999999999},"min":{"1min":0.46600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.1920000000000002,"5min":7.1920000000000002,"15min":7.1920000000000002},"last":1.0229999999999999}]}]},{"osd":5,"up_from":13,"seq":55834581091,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1168180,"kb_used_data":492,"kb_used_omap":7161,"kb_used_meta":1160518,"kb_avail":93203660,"statfs":{"total":96636764160,"available":95440547840,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7333659,"internal_metadata":1188370661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.2210000000000001,"15min":1.0309999999999999},"min":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.23599999999999999},"max":{"1min":26.170999999999999,"5min":26.170999999999999,"15min":26.170999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":2.359,"5min":1.23,"15min":1.1120000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":25.670000000000002,"5min":25.670000000000002,"15min":25.670000000000002},"last":0.72599999999999998}]},{"osd":1,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.145,"15min":1.23},"min":{"1min":0.33400000000000002,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":2.677,"5min":6.5579999999999998,"15min":11.092000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.2609999999999999,"15min":1.2250000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.2300000000000004,"5min":7.6230000000000002,"15min":7.6230000000000002},"last":0.95399999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.198,"15min":1.3460000000000001},"min":{"1min":0.39500000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":5.4050000000000002,"5min":6.6420000000000003,"15min":8.6769999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.244},"min":{"1min":0.41599999999999998,"5min":0.32600000000000001,"15min":0.313},"max":{"1min":5.7220000000000004,"5min":6.7610000000000001,"15min":8.7870000000000008},"last":0.83999999999999997}]},{"osd":3,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.1519999999999999,"15min":1.1910000000000001},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.9989999999999997,"5min":7.5339999999999998,"15min":7.5339999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.2170000000000001,"15min":1.353},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.34999999999999998},"max":{"1min":4.2759999999999998,"5min":7.843,"15min":9.3379999999999992},"last":1.024}]},{"osd":4,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66500000000000004,"15min":0.80200000000000005},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.27200000000000002},"max":{"1min":1.603,"5min":4.4539999999999997,"15min":8.7579999999999991},"last":0.751},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.85799999999999998,"15min":0.90100000000000002},"min":{"1min":0.35299999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.7450000000000001,"5min":8.2370000000000001,"15min":8.6430000000000007},"last":1.0600000000000001}]},{"osd":6,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.91500000000000004,"15min":1.022},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.1849999999999996,"5min":5.1870000000000003,"15min":16.861999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.81299999999999994,"15min":0.995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.34100000000000003},"max":{"1min":3.9329999999999998,"5min":4.8479999999999999,"15min":8.7200000000000006},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon May 22 01:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.97799999999999998,"15min":1.046},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":4.0700000000000003,"5min":5.5490000000000004,"15min":7.1909999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.0389999999999999,"15min":1.1040000000000001},"min":{"1min":0.443,"5min":0.37,"15min":0.37},"max":{"1min":4.2549999999999999,"5min":5.508,"15min":6.7629999999999999},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834581090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1140916,"kb_used_data":492,"kb_used_omap":10283,"kb_used_meta":1130132,"kb_avail":93230924,"statfs":{"total":96636764160,"available":95468466176,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10530010,"internal_metadata":1157255974},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":5.2889999999999997,"5min":6.4199999999999999,"15min":11.731},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1,"15min":0.997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.4930000000000003,"5min":10.221,"15min":10.221},"last":0.83999999999999997}]},{"osd":1,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.94599999999999995,"15min":1.9179999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29699999999999999},"max":{"1min":10.135999999999999,"5min":10.135999999999999,"15min":227.46199999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.25,"15min":2.0510000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":227.56100000000001},"last":0.746}]},{"osd":2,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":1.3819999999999999,"15min":1.351},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32000000000000001},"max":{"1min":12.827999999999999,"5min":12.827999999999999,"15min":13.026999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.24},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":5.9160000000000004,"5min":7.0830000000000002,"15min":8.8719999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2669999999999999,"15min":1.1779999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33100000000000002},"max":{"1min":4.5899999999999999,"5min":10.183999999999999,"15min":10.183999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.282,"15min":1.321},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":10.173,"5min":10.173,"15min":10.677},"last":0.96299999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":6.944},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":0.97899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.8120000000000003,"5min":10.256,"15min":10.256},"last":0.92400000000000004}]},{"osd":6,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1200000000000001,"15min":1.052},"min":{"1min":0.47999999999999998,"5min":0.38800000000000001,"15min":0.28399999999999997},"max":{"1min":10.023,"5min":10.023,"15min":10.023},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.88},"min":{"1min":0.375,"5min":0.375,"15min":0.35699999999999998},"max":{"1min":1.931,"5min":3.3940000000000001,"15min":7.0350000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.1990000000000001,"15min":1.1339999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.7970000000000006,"5min":10.286,"15min":10.286},"last":0.996},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.1240000000000001,"15min":1.0469999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33200000000000002},"max":{"1min":10.106,"5min":10.106,"15min":10.106},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834581078,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1113076,"kb_used_data":492,"kb_used_omap":6752,"kb_used_meta":1105823,"kb_avail":93258764,"statfs":{"total":96636764160,"available":95496974336,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6914506,"internal_metadata":1132363318},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.4430000000000001,"15min":1.296},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.266,"5min":16.087,"15min":16.087},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2,"15min":1.2090000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.22700000000000001},"max":{"1min":10.127000000000001,"5min":10.127000000000001,"15min":12.468999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"max":{"1min":2.169,"5min":8.1029999999999998,"15min":10.978999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.3720000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":6.7290000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":1.1759999999999999}]},{"osd":2,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.357,"15min":1.3100000000000001},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.27100000000000002},"max":{"1min":3.1850000000000001,"5min":8.5549999999999997,"15min":17.588999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":3.0710000000000002,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.28399999999999997},"max":{"1min":25.882999999999999,"5min":25.882999999999999,"15min":25.882999999999999},"last":1.083}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.258,"15min":1.1970000000000001},"min":{"1min":0.42899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.3890000000000002,"5min":9.0340000000000007,"15min":12.401999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":3.0329999999999999,"5min":1.5569999999999999,"15min":1.3029999999999999},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":38.222000000000001,"5min":38.222000000000001,"15min":38.222000000000001},"last":0.88300000000000001}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":1.5189999999999999,"15min":1.401},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.35499999999999998},"max":{"1min":25.931000000000001,"5min":25.931000000000001,"15min":25.931000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.6160000000000001,"15min":1.524},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.214,"5min":28.010000000000002,"15min":28.010000000000002},"last":1.2050000000000001}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":1.772,"15min":1.498},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36599999999999999},"max":{"1min":48.582000000000001,"5min":48.582000000000001,"15min":48.582000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":5.3490000000000002,"5min":2.0459999999999998,"15min":1.657},"min":{"1min":0.624,"5min":0.501,"15min":0.40799999999999997},"max":{"1min":68.367000000000004,"5min":68.367000000000004,"15min":68.367000000000004},"last":1.3200000000000001}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.72,"15min":1.552},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5630000000000002,"5min":8.9730000000000008,"15min":12.48},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.29,"15min":1.4330000000000001},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.4279999999999999,"5min":8.25,"15min":13.292999999999999},"last":1.0369999999999999}]}]},{"osd":2,"up_from":13,"seq":55834581080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1011444,"kb_used_data":492,"kb_used_omap":3682,"kb_used_meta":1007261,"kb_avail":93360396,"statfs":{"total":96636764160,"available":95601045504,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3770422,"internal_metadata":1031436234},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.75900000000000001,"15min":1.1299999999999999},"min":{"1min":0.26900000000000002,"5min":0.218,"15min":0.216},"max":{"1min":0.93999999999999995,"5min":8.5359999999999996,"15min":42.659999999999997},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.7689999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.7300000000000004,"5min":14.984999999999999,"15min":41.613999999999997},"last":0.72999999999999998}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.998,"15min":1.3120000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.8029999999999999,"5min":8.859,"15min":11.391},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.4199999999999999,"15min":1.5649999999999999},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.8970000000000002,"5min":14.401999999999999,"15min":14.401999999999999},"last":1.1599999999999999}]},{"osd":3,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.819,"5min":1.5960000000000001,"15min":1.5660000000000001},"min":{"1min":0.35599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7270000000000003,"5min":17.779,"15min":41.917000000000002},"last":1.091},{"interface":"front","average":{"1min":1.306,"5min":1.05,"15min":1.4350000000000001},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":7.4039999999999999,"5min":7.4039999999999999,"15min":42.578000000000003},"last":1.3260000000000001}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97799999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":5.9790000000000001,"5min":6.5069999999999997,"15min":7.9699999999999998},"last":1.4319999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.1819999999999999,"15min":1.391},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.8179999999999996,"5min":7.0430000000000001,"15min":10.009},"last":1.0509999999999999}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.2929999999999999,"15min":1.298},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":6.0069999999999997,"5min":10.605,"15min":10.605},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1439999999999999,"15min":1.179},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33000000000000002},"max":{"1min":5.7939999999999996,"5min":6.5449999999999999,"15min":7.9160000000000004},"last":1.524}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.264,"15min":1.4730000000000001},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"max":{"1min":6.8520000000000003,"5min":7.1609999999999996,"15min":9.9819999999999993},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.806,"5min":1.373,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.35,"5min":10.645,"15min":13.244999999999999},"last":1.2869999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.4650000000000001,"15min":1.5149999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":14.59,"5min":14.59,"15min":14.59},"last":1.369},{"interface":"front","average":{"1min":1.599,"5min":1.4350000000000001,"15min":1.4630000000000001},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.438},"max":{"1min":5.9560000000000004,"5min":11.401,"15min":11.401},"last":1.1990000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581083,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088756,"kb_used_data":492,"kb_used_omap":6199,"kb_used_meta":1082056,"kb_avail":93283084,"statfs":{"total":96636764160,"available":95521878016,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6348278,"internal_metadata":1108025866},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.0800000000000001,"15min":0.88900000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":11.808999999999999,"5min":11.808999999999999,"15min":14.096},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.202,"15min":1.5580000000000001},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.073,"5min":7.468,"15min":14.414999999999999},"last":1.129}]},{"osd":2,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":1.492,"15min":1.2030000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":2.5070000000000001,"5min":1.6759999999999999,"15min":1.552},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":0.60799999999999998}]},{"osd":3,"last update":"Mon May 22 01:33:30 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":0.81299999999999994},{"interface":"front","average":{"1min":2.2829999999999999,"5min":1.806,"15min":1.589},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.27500000000000002},"max":{"1min":11.835000000000001,"5min":11.835000000000001,"15min":15.206},"last":0.86699999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.228,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.08,"5min":12.08,"15min":12.08},"last":0.92000000000000004},{"interface":"front","average":{"1min":4.1189999999999998,"5min":1.853,"15min":1.5680000000000001},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":40.874000000000002,"5min":40.874000000000002,"15min":40.874000000000002},"last":0.97099999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.6759999999999999,"15min":1.452},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.901,"5min":11.901,"15min":15.260999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":2.5259999999999998,"5min":1.6020000000000001,"15min":1.2989999999999999},"min":{"1min":0.61199999999999999,"5min":0.45700000000000002,"15min":0.375},"max":{"1min":14.613,"5min":14.613,"15min":14.613},"last":1.105}]},{"osd":6,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":1.8919999999999999,"15min":1.7},"min":{"1min":0.46000000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":11.968999999999999,"5min":11.968999999999999,"15min":15.295999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.581,"15min":1.298},"min":{"1min":0.627,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":12.144,"5min":12.144,"15min":12.144},"last":1.024}]},{"osd":7,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.631,"15min":1.627},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.9890000000000001,"5min":1.839,"15min":1.7370000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.936999999999999,"5min":12.363,"15min":15.33},"last":1.3859999999999999}]}]},{"osd":0,"up_from":13,"seq":55834581079,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660728,"kb_used_data":1072,"kb_used_omap":5377,"kb_used_meta":654270,"kb_avail":93711112,"statfs":{"total":96636764160,"available":95960178688,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5506796,"internal_metadata":669972756},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.91300000000000003,"15min":1.157},"min":{"1min":0.26800000000000002,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":1.7609999999999999,"5min":15.766999999999999,"15min":15.766999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.93799999999999994,"15min":1.069},"min":{"1min":0.28999999999999998,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":3.944,"5min":15.926,"15min":15.926},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.1060000000000001,"15min":1.1799999999999999},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.32,"5min":14.32,"15min":14.32},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0720000000000001,"15min":1.2849999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":4.7869999999999999,"5min":10.025,"15min":12.134},"last":0.70699999999999996}]},{"osd":3,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.304,"15min":1.4450000000000001},"min":{"1min":0.39100000000000001,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":5.4299999999999997,"5min":9.8330000000000002,"15min":12.185},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1819999999999999,"15min":1.45},"min":{"1min":0.30499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.3780000000000001,"5min":15.707000000000001,"15min":15.707000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2759999999999998,"5min":1.3560000000000001,"15min":1.284},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":22.163,"5min":22.163,"15min":22.163},"last":0.88900000000000001},{"interface":"front","average":{"1min":2.4009999999999998,"5min":1.127,"15min":1.153},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":23.003,"5min":23.003,"15min":23.003},"last":0.872}]},{"osd":5,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.02,"15min":1.2430000000000001},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":3.9849999999999999,"5min":7.7690000000000001,"15min":8.8580000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.452,"5min":1.276,"15min":1.3420000000000001},"min":{"1min":0.48999999999999999,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":10.597,"5min":10.597,"15min":17.975999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":9.1760000000000002,"5min":10.324999999999999,"15min":10.324999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.335},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.39200000000000002},"max":{"1min":5.9199999999999999,"5min":7.8109999999999999,"15min":13.109},"last":0.622}]},{"osd":7,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1850000000000001,"15min":1.4079999999999999},"min":{"1min":0.54900000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":4.0529999999999999,"5min":7.8440000000000003,"15min":8.8309999999999995},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.327,"15min":1.3740000000000001},"min":{"1min":0.52500000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.669,"5min":6.3769999999999998,"15min":18.039000000000001},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-22T01:34:07.579 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-05-21T16:54:07.391844+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=7, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.579 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.580 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.581 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.581 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.581 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.582 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.582 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.582 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-05-21T16:54:12.618215+0000 time.struct_time(tm_year=2023, tm_mon=5, tm_mday=21, tm_hour=16, tm_min=54, tm_sec=12, tm_wday=6, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=5, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=1, tm_wday=0, tm_yday=142, tm_isdst=0) 2023-05-22T01:34:07.582 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-05-22T01:34:27.584 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-22T01:34:27.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 Processor -- start 2023-05-22T01:34:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- start start 2023-05-22T01:34:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c0b85b0 0x7f949c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f949c1600c0 0x7f949c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:27.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c06afd0 con 0x7f949c0b2140 2023-05-22T01:34:27.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c0cd6b0 con 0x7f949c1600c0 2023-05-22T01:34:27.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0cd990 con 0x7f949c0b85b0 2023-05-22T01:34:27.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2354700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f949c0b2140 0x7f949c069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41820/0 (socket says 172.21.15.46:41820) 2023-05-22T01:34:27.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2354700 1 -- 172.21.15.46:0/2690269973 learned_addr learned my addr 172.21.15.46:0/2690269973 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:27.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1352700 1 --2- 172.21.15.46:0/2690269973 >> v2:172.21.15.142:3300/0 conn(0x7f949c1600c0 0x7f949c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:27.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1b53700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c0b85b0 0x7f949c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:27.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1352700 1 -- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c0b85b0 msgr2=0x7f949c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:27.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1352700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c0b85b0 0x7f949c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1352700 1 -- 172.21.15.46:0/2690269973 >> v1:172.21.15.46:6789/0 conn(0x7f949c0b2140 legacy=0x7f949c069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:27.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1352700 1 -- 172.21.15.46:0/2690269973 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c06b220 con 0x7f949c1600c0 2023-05-22T01:34:27.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a0b51700 1 -- 172.21.15.46:0/2690269973 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325972624 0 0) 0x7f949c06afd0 con 0x7f949c0b2140 2023-05-22T01:34:27.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1b53700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c0b85b0 0x7f949c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-22T01:34:27.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a1352700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c0b4940 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f948c009850 tx=0x7f948c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45339ea76b1c9eda server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:27.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a0b51700 1 -- 172.21.15.46:0/2690269973 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c011830 con 0x7f949c1600c0 2023-05-22T01:34:27.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a0b51700 1 -- 172.21.15.46:0/2690269973 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c011990 con 0x7f949c1600c0 2023-05-22T01:34:27.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a0b51700 1 -- 172.21.15.46:0/2690269973 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c011d40 con 0x7f949c1600c0 2023-05-22T01:34:27.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 msgr2=0x7f949c0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c0b4940 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f948c009850 tx=0x7f948c009b60 comp rx=0 tx=0).stop 2023-05-22T01:34:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- 172.21.15.46:0/2690269973 shutdown_connections 2023-05-22T01:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c0b4940 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 --2- 172.21.15.46:0/2690269973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c0b85b0 0x7f949c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- 172.21.15.46:0/2690269973 >> 172.21.15.46:0/2690269973 conn(0x7f949c06cc00 msgr2=0x7f949c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- 172.21.15.46:0/2690269973 shutdown_connections 2023-05-22T01:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.689+0000 7f94a2b55700 1 -- 172.21.15.46:0/2690269973 wait complete. 2023-05-22T01:34:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 Processor -- start 2023-05-22T01:34:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 -- start start 2023-05-22T01:34:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 0x7f949c150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c154d20 0x7f949c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c15e910 con 0x7f949c0b85b0 2023-05-22T01:34:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0b3a70 con 0x7f949c1600c0 2023-05-22T01:34:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0b3d50 con 0x7f949c154d20 2023-05-22T01:34:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 0x7f949c150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 0x7f949c150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57784/0 (socket says 172.21.15.46:57784) 2023-05-22T01:34:27.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 -- 172.21.15.46:0/872326141 learned_addr learned my addr 172.21.15.46:0/872326141 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1352700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2354700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c154d20 0x7f949c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 -- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c154d20 msgr2=0x7f949c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c154d20 0x7f949c15cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 -- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 msgr2=0x7f949c1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c1547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 -- 172.21.15.46:0/872326141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494009a70 con 0x7f949c0b85b0 2023-05-22T01:34:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1352700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-22T01:34:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a1b53700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 0x7f949c150ef0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f949400efc0 tx=0x7f949400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400cee0 con 0x7f949c0b85b0 2023-05-22T01:34:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949400f040 con 0x7f949c0b85b0 2023-05-22T01:34:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c0094b0 con 0x7f949c0b85b0 2023-05-22T01:34:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494014680 con 0x7f949c0b85b0 2023-05-22T01:34:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.693+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c0b8980 con 0x7f949c0b85b0 2023-05-22T01:34:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.697+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c06b500 con 0x7f949c0b85b0 2023-05-22T01:34:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.697+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94940147e0 con 0x7f949c0b85b0 2023-05-22T01:34:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.697+0000 7f94927fc700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9480066320 0x7f94800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.697+0000 7f94a1352700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9480066320 0x7f94800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.697+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9494084740 con 0x7f949c0b85b0 2023-05-22T01:34:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.697+0000 7f94a1352700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9480066320 0x7f94800687d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f948c0090b0 tx=0x7f948c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:27.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.701+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9494051f50 con 0x7f949c0b85b0 2023-05-22T01:34:27.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.861+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 --> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f949c067ac0 con 0x7f9480066320 2023-05-22T01:34:27.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94927fc700 1 -- 172.21.15.46:0/872326141 <== mgr.4101 v2:172.21.15.46:6832/1217485649 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71106 (secure 0 0 0) 0x7f949c067ac0 con 0x7f9480066320 2023-05-22T01:34:27.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9480066320 msgr2=0x7f94800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9480066320 0x7f94800687d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f948c0090b0 tx=0x7f948c01c040 comp rx=0 tx=0).stop 2023-05-22T01:34:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 msgr2=0x7f949c150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 0x7f949c150ef0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f949400efc0 tx=0x7f949400c3a0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 shutdown_connections 2023-05-22T01:34:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7f9480066320 0x7f94800687d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.869+0000 7f94a2b55700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949c154d20 0x7f949c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.873+0000 7f94a2b55700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949c1600c0 0x7f949c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.873+0000 7f94a2b55700 1 --2- 172.21.15.46:0/872326141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f949c0b85b0 0x7f949c150ef0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.873+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 >> 172.21.15.46:0/872326141 conn(0x7f949c0b2140 msgr2=0x7f949c0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.873+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 shutdown_connections 2023-05-22T01:34:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:27.873+0000 7f94a2b55700 1 -- 172.21.15.46:0/872326141 wait complete. 2023-05-22T01:34:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-05-22T01:34:27.925 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":15641,"stamp":"2023-05-22T01:34:26.020493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8141928,"kb_used_data":5096,"kb_used_omap":47479,"kb_used_meta":8089288,"kb_avail":746832792,"statfs":{"total":773094113280,"available":764756779008,"internally_reserved":0,"allocated":5218304,"data_stored":2873120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48619470,"internal_metadata":8283430962},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003285"},"pg_stats":[{"pgid":"1.0","version":"43'163","reported_seq":535,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:12.280075+0000","last_change":"2023-05-22T01:34:12.280181+0000","last_active":"2023-05-22T01:34:12.280075+0000","last_peered":"2023-05-22T01:34:12.280075+0000","last_clean":"2023-05-22T01:34:12.280075+0000","last_became_active":"2023-05-21T16:54:08.722853+0000","last_became_peered":"2023-05-21T16:54:08.722853+0000","last_unstale":"2023-05-22T01:34:12.280075+0000","last_undegraded":"2023-05-22T01:34:12.280075+0000","last_fullsized":"2023-05-22T01:34:12.280075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'163","last_scrub_stamp":"2023-05-22T01:34:12.279876+0000","last_deep_scrub":"43'163","last_deep_scrub_stamp":"2023-05-22T01:34:12.279876+0000","last_clean_scrub_stamp":"2023-05-22T01:34:12.279876+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T02:39:59.961483+0000","scrub_duration":0.59013562200000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:18.851595+0000","last_change":"2023-05-22T01:34:18.851762+0000","last_active":"2023-05-22T01:34:18.851595+0000","last_peered":"2023-05-22T01:34:18.851595+0000","last_clean":"2023-05-22T01:34:18.851595+0000","last_became_active":"2023-05-21T16:54:13.635730+0000","last_became_peered":"2023-05-21T16:54:13.635730+0000","last_unstale":"2023-05-22T01:34:18.851595+0000","last_undegraded":"2023-05-22T01:34:18.851595+0000","last_fullsized":"2023-05-22T01:34:18.851595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:18.851300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:18.851300+0000","last_clean_scrub_stamp":"2023-05-22T01:34:18.851300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T10:10:15.830173+0000","scrub_duration":1.374584134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":325,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:17.890962+0000","last_change":"2023-05-22T01:34:17.891007+0000","last_active":"2023-05-22T01:34:17.890962+0000","last_peered":"2023-05-22T01:34:17.890962+0000","last_clean":"2023-05-22T01:34:17.890962+0000","last_became_active":"2023-05-21T16:54:13.636754+0000","last_became_peered":"2023-05-21T16:54:13.636754+0000","last_unstale":"2023-05-22T01:34:17.890962+0000","last_undegraded":"2023-05-22T01:34:17.890962+0000","last_fullsized":"2023-05-22T01:34:17.890962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:17.890856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:17.890856+0000","last_clean_scrub_stamp":"2023-05-22T01:34:17.890856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T03:49:45.433659+0000","scrub_duration":1.159878052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":308,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:07.289561+0000","last_change":"2023-05-22T01:34:07.289647+0000","last_active":"2023-05-22T01:34:07.289561+0000","last_peered":"2023-05-22T01:34:07.289561+0000","last_clean":"2023-05-22T01:34:07.289561+0000","last_became_active":"2023-05-21T16:54:13.711055+0000","last_became_peered":"2023-05-21T16:54:13.711055+0000","last_unstale":"2023-05-22T01:34:07.289561+0000","last_undegraded":"2023-05-22T01:34:07.289561+0000","last_fullsized":"2023-05-22T01:34:07.289561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:07.289390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:07.289390+0000","last_clean_scrub_stamp":"2023-05-22T01:34:07.289390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T08:14:02.170879+0000","scrub_duration":1.9703688370000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:16.268986+0000","last_change":"2023-05-22T01:34:16.269035+0000","last_active":"2023-05-22T01:34:16.268986+0000","last_peered":"2023-05-22T01:34:16.268986+0000","last_clean":"2023-05-22T01:34:16.268986+0000","last_became_active":"2023-05-21T16:54:13.635949+0000","last_became_peered":"2023-05-21T16:54:13.635949+0000","last_unstale":"2023-05-22T01:34:16.268986+0000","last_undegraded":"2023-05-22T01:34:16.268986+0000","last_fullsized":"2023-05-22T01:34:16.268986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:16.268870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:16.268870+0000","last_clean_scrub_stamp":"2023-05-22T01:34:16.268870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T06:24:22.687380+0000","scrub_duration":0.82576380299999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":311,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:10.300928+0000","last_change":"2023-05-22T01:34:10.300928+0000","last_active":"2023-05-22T01:34:10.300928+0000","last_peered":"2023-05-22T01:34:10.300928+0000","last_clean":"2023-05-22T01:34:10.300928+0000","last_became_active":"2023-05-21T16:54:13.713042+0000","last_became_peered":"2023-05-21T16:54:13.713042+0000","last_unstale":"2023-05-22T01:34:10.300928+0000","last_undegraded":"2023-05-22T01:34:10.300928+0000","last_fullsized":"2023-05-22T01:34:10.300928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:10.300666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:10.300666+0000","last_clean_scrub_stamp":"2023-05-22T01:34:10.300666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T13:21:06.721090+0000","scrub_duration":0.55987436700000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:15.453124+0000","last_change":"2023-05-22T01:34:15.453230+0000","last_active":"2023-05-22T01:34:15.453124+0000","last_peered":"2023-05-22T01:34:15.453124+0000","last_clean":"2023-05-22T01:34:15.453124+0000","last_became_active":"2023-05-21T16:54:13.712031+0000","last_became_peered":"2023-05-21T16:54:13.712031+0000","last_unstale":"2023-05-22T01:34:15.453124+0000","last_undegraded":"2023-05-22T01:34:15.453124+0000","last_fullsized":"2023-05-22T01:34:15.453124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:15.452875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:15.452875+0000","last_clean_scrub_stamp":"2023-05-22T01:34:15.452875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T12:54:45.471543+0000","scrub_duration":1.740175831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:08.723228+0000","last_change":"2023-05-22T01:34:08.723298+0000","last_active":"2023-05-22T01:34:08.723228+0000","last_peered":"2023-05-22T01:34:08.723228+0000","last_clean":"2023-05-22T01:34:08.723228+0000","last_became_active":"2023-05-21T16:54:13.638756+0000","last_became_peered":"2023-05-21T16:54:13.638756+0000","last_unstale":"2023-05-22T01:34:08.723228+0000","last_undegraded":"2023-05-22T01:34:08.723228+0000","last_fullsized":"2023-05-22T01:34:08.723228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:08.723011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:08.723011+0000","last_clean_scrub_stamp":"2023-05-22T01:34:08.723011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T05:25:37.024633+0000","scrub_duration":0.96591498899999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":298,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-05-22T01:34:10.954943+0000","last_change":"2023-05-22T01:34:10.954943+0000","last_active":"2023-05-22T01:34:10.954943+0000","last_peered":"2023-05-22T01:34:10.954943+0000","last_clean":"2023-05-22T01:34:10.954943+0000","last_became_active":"2023-05-21T16:54:13.638870+0000","last_became_peered":"2023-05-21T16:54:13.638870+0000","last_unstale":"2023-05-22T01:34:10.954943+0000","last_undegraded":"2023-05-22T01:34:10.954943+0000","last_fullsized":"2023-05-22T01:34:10.954943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-22T01:34:10.954726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-22T01:34:10.954726+0000","last_clean_scrub_stamp":"2023-05-22T01:34:10.954726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-05-23T07:31:45.921767+0000","scrub_duration":1.5244812240000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581093,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1119864,"kb_used_data":1072,"kb_used_omap":3881,"kb_used_meta":1114902,"kb_avail":93251976,"statfs":{"total":96636764160,"available":95490023424,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3974582,"internal_metadata":1141660234},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.006,"15min":0.98799999999999999},"min":{"1min":0.318,"5min":0.27200000000000002,"15min":0.26100000000000001},"max":{"1min":5.0679999999999996,"5min":5.9900000000000002,"15min":8.157},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.89300000000000002,"15min":0.85599999999999998},"min":{"1min":0.34899999999999998,"5min":0.28299999999999997,"15min":0.26500000000000001},"max":{"1min":4.8360000000000003,"5min":6.6349999999999998,"15min":6.7430000000000003},"last":0.60899999999999999}]},{"osd":1,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":2.3069999999999999,"5min":1.1930000000000001,"15min":1.0800000000000001},"min":{"1min":0.33400000000000002,"5min":0.32200000000000001,"15min":0.28899999999999998},"max":{"1min":20.408999999999999,"5min":20.408999999999999,"15min":20.408999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":2.0659999999999998,"5min":1.494,"15min":1.2470000000000001},"min":{"1min":0.42299999999999999,"5min":0.30599999999999999,"15min":0.30099999999999999},"max":{"1min":20.396000000000001,"5min":20.396000000000001,"15min":20.396000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.2869999999999999,"15min":1.238},"min":{"1min":0.39700000000000002,"5min":0.31900000000000001,"15min":0.30599999999999999},"max":{"1min":4.7629999999999999,"5min":9.8300000000000001,"15min":9.8300000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.119,"15min":1.073},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.316},"max":{"1min":4.6130000000000004,"5min":6.5810000000000004,"15min":6.5810000000000004},"last":1.1319999999999999}]},{"osd":3,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.056,"15min":1.143},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32900000000000001},"max":{"1min":4.8639999999999999,"5min":7.1950000000000003,"15min":7.1950000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.226,"15min":1.2689999999999999},"min":{"1min":0.38400000000000001,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":3.8479999999999999,"5min":8.9600000000000009,"15min":10.041},"last":0.84699999999999998}]},{"osd":4,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":0.94599999999999995,"15min":0.85699999999999998},"min":{"1min":0.438,"5min":0.307,"15min":0.307},"max":{"1min":6.8179999999999996,"5min":6.8179999999999996,"15min":7.1299999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":0.94799999999999995,"15min":0.88200000000000001},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.318},"max":{"1min":6.8550000000000004,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.85699999999999998}]},{"osd":5,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0369999999999999,"15min":0.97999999999999998},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":4.7560000000000002,"5min":6.2670000000000003,"15min":7.931},"last":0.871},{"interface":"front","average":{"1min":1.268,"5min":1.3260000000000001,"15min":1.22},"min":{"1min":0.40200000000000002,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":4.7149999999999999,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.054}]},{"osd":6,"last update":"Mon May 22 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.94399999999999995,"15min":0.97599999999999998},"min":{"1min":0.46300000000000002,"5min":0.41099999999999998,"15min":0.36499999999999999},"max":{"1min":1.302,"5min":6.6600000000000001,"15min":6.8179999999999996},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.39000000000000001},"max":{"1min":1.284,"5min":6.8090000000000002,"15min":8.0760000000000005},"last":1.1499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834581093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838900,"kb_used_data":492,"kb_used_omap":4141,"kb_used_meta":834258,"kb_avail":93532940,"statfs":{"total":96636764160,"available":95777730560,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4241217,"internal_metadata":854280383},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":1.633,"15min":1.048},"min":{"1min":0.27700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":14.721,"5min":54.807000000000002,"15min":54.807000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":2.661,"5min":1.9219999999999999,"15min":1.3029999999999999},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28000000000000003},"max":{"1min":13.321999999999999,"5min":54.838999999999999,"15min":54.838999999999999},"last":0.85499999999999998}]},{"osd":1,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.1699999999999999,"15min":1.105},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":6.6050000000000004,"5min":8.7699999999999996,"15min":8.7699999999999996},"last":1.089},{"interface":"front","average":{"1min":2.6349999999999998,"5min":1.468,"15min":1.2869999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.29299999999999998},"max":{"1min":31.484999999999999,"5min":31.484999999999999,"15min":31.484999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.369,"15min":1.3069999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":14.484,"5min":14.484,"15min":14.484},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.238,"15min":1.218},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31900000000000001},"max":{"1min":6.6360000000000001,"5min":8.8719999999999999,"15min":9.3499999999999996},"last":0.998}]},{"osd":3,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":2.1299999999999999,"15min":1.5940000000000001},"min":{"1min":0.432,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":5.7649999999999997,"5min":55.756999999999998,"15min":55.756999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.7110000000000001,"15min":1.3240000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.319,"5min":54.451999999999998,"15min":54.451999999999998},"last":1.123}]},{"osd":4,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.0920000000000001,"15min":1.0129999999999999},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":9.0920000000000005,"5min":9.8879999999999999,"15min":9.8879999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":2.0289999999999999,"5min":1.246,"15min":1.095},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.96799999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.92800000000000005,"15min":0.99299999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34100000000000003},"max":{"1min":3.7570000000000001,"5min":5.601,"15min":7.6219999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.135,"15min":1.1950000000000001},"min":{"1min":0.48299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":9.7249999999999996,"5min":9.7249999999999996,"15min":9.7249999999999996},"last":1.165}]},{"osd":7,"last update":"Mon May 22 01:33:34 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.171,"15min":1.0529999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36899999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":1.149},{"interface":"front","average":{"1min":1.248,"5min":1.1279999999999999,"15min":1.0609999999999999},"min":{"1min":0.46600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.1920000000000002,"5min":7.1920000000000002,"15min":7.1920000000000002},"last":1.1919999999999999}]}]},{"osd":5,"up_from":13,"seq":55834581095,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1168244,"kb_used_data":492,"kb_used_omap":7161,"kb_used_meta":1160582,"kb_avail":93203596,"statfs":{"total":96636764160,"available":95440482304,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7333659,"internal_metadata":1188436197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.2370000000000001,"15min":1.05},"min":{"1min":0.33900000000000002,"5min":0.26900000000000002,"15min":0.23599999999999999},"max":{"1min":3.4689999999999999,"5min":26.170999999999999,"15min":26.170999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.2629999999999999,"15min":1.107},"min":{"1min":0.29699999999999999,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":2.415,"5min":25.670000000000002,"15min":25.670000000000002},"last":0.93300000000000005}]},{"osd":1,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":1.0409999999999999,"15min":1.21},"min":{"1min":0.29999999999999999,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":2.375,"5min":6.5579999999999998,"15min":11.092000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.2210000000000001,"15min":1.244},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":3.1120000000000001,"5min":7.6230000000000002,"15min":7.6230000000000002},"last":0.99099999999999999}]},{"osd":2,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.1479999999999999,"15min":1.339},"min":{"1min":0.42899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.0110000000000001,"5min":5.952,"15min":8.6769999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":1.2270000000000001,"15min":1.2370000000000001},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.313},"max":{"1min":2.923,"5min":6.7610000000000001,"15min":8.7870000000000008},"last":0.871}]},{"osd":3,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0820000000000001,"15min":1.1759999999999999},"min":{"1min":0.38100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.9569999999999999,"5min":7.5339999999999998,"15min":7.5339999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.2569999999999999,"15min":1.3400000000000001},"min":{"1min":0.46500000000000002,"5min":0.373,"15min":0.34999999999999998},"max":{"1min":3.0510000000000002,"5min":7.843,"15min":8.7970000000000006},"last":0.91000000000000003}]},{"osd":4,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.68100000000000005,"15min":0.81100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.27200000000000002},"max":{"1min":2.7829999999999999,"5min":4.4539999999999997,"15min":8.7579999999999991},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76800000000000002,"15min":0.90000000000000002},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.3460000000000001,"5min":4.726,"15min":8.6430000000000007},"last":1.1080000000000001}]},{"osd":6,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90100000000000002,"15min":1.038},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.0840000000000001,"5min":5.1870000000000003,"15min":16.861999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84799999999999998,"15min":1.01},"min":{"1min":0.42899999999999999,"5min":0.39300000000000002,"15min":0.34100000000000003},"max":{"1min":3,"5min":4.8479999999999999,"15min":8.7200000000000006},"last":0.76100000000000001}]},{"osd":7,"last update":"Mon May 22 01:34:07 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.071,"15min":1.1040000000000001},"min":{"1min":0.39200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.0880000000000001,"15min":1.1120000000000001},"min":{"1min":0.498,"5min":0.37,"15min":0.37},"max":{"1min":3.3690000000000002,"5min":5.508,"15min":6.7629999999999999},"last":1.0880000000000001}]}]},{"osd":4,"up_from":13,"seq":55834581094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1140916,"kb_used_data":492,"kb_used_omap":10283,"kb_used_meta":1130132,"kb_avail":93230924,"statfs":{"total":96636764160,"available":95468466176,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10530010,"internal_metadata":1157255974},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.26500000000000001},"max":{"1min":5.2889999999999997,"5min":6.4199999999999999,"15min":11.731},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":1,"15min":0.997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.4930000000000003,"5min":10.221,"15min":10.221},"last":0.504}]},{"osd":1,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.94599999999999995,"15min":1.9179999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29699999999999999},"max":{"1min":10.135999999999999,"5min":10.135999999999999,"15min":227.46199999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.25,"15min":2.0510000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":227.56100000000001},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":2.1619999999999999,"5min":1.3819999999999999,"15min":1.351},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32000000000000001},"max":{"1min":12.827999999999999,"5min":12.827999999999999,"15min":13.026999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.24},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":5.9160000000000004,"5min":7.0830000000000002,"15min":8.8719999999999999},"last":0.97799999999999998}]},{"osd":3,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2669999999999999,"15min":1.1779999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33100000000000002},"max":{"1min":4.5899999999999999,"5min":10.183999999999999,"15min":10.183999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.282,"15min":1.321},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":10.173,"5min":10.173,"15min":10.677},"last":0.78600000000000003}]},{"osd":5,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28999999999999998},"max":{"1min":5.7560000000000002,"5min":5.7560000000000002,"15min":6.944},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":0.97899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":5.8120000000000003,"5min":10.256,"15min":10.256},"last":0.94999999999999996}]},{"osd":6,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.1200000000000001,"15min":1.052},"min":{"1min":0.47999999999999998,"5min":0.38800000000000001,"15min":0.28399999999999997},"max":{"1min":10.023,"5min":10.023,"15min":10.023},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.88},"min":{"1min":0.375,"5min":0.375,"15min":0.35699999999999998},"max":{"1min":1.931,"5min":3.3940000000000001,"15min":7.0350000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Mon May 22 01:33:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.1990000000000001,"15min":1.1339999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":8.7970000000000006,"5min":10.286,"15min":10.286},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.1240000000000001,"15min":1.0469999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33200000000000002},"max":{"1min":10.106,"5min":10.106,"15min":10.106},"last":1.0049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834581082,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1113076,"kb_used_data":492,"kb_used_omap":6752,"kb_used_meta":1105823,"kb_avail":93258764,"statfs":{"total":96636764160,"available":95496974336,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6914506,"internal_metadata":1132363318},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":1.4430000000000001,"15min":1.296},"min":{"1min":0.28899999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.266,"5min":16.087,"15min":16.087},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2,"15min":1.2090000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.22700000000000001},"max":{"1min":10.127000000000001,"5min":10.127000000000001,"15min":12.468999999999999},"last":1.0660000000000001}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":1.2849999999999999,"15min":1.242},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"max":{"1min":2.169,"5min":8.1029999999999998,"15min":10.978999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.3720000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":6.7290000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":0.63}]},{"osd":2,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.357,"15min":1.3100000000000001},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.27100000000000002},"max":{"1min":3.1850000000000001,"5min":8.5549999999999997,"15min":17.588999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":3.0710000000000002,"5min":1.7529999999999999,"15min":1.601},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.28399999999999997},"max":{"1min":25.882999999999999,"5min":25.882999999999999,"15min":25.882999999999999},"last":0.747}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.258,"15min":1.1970000000000001},"min":{"1min":0.42899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":5.3890000000000002,"5min":9.0340000000000007,"15min":12.401999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":3.0329999999999999,"5min":1.5569999999999999,"15min":1.3029999999999999},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.32000000000000001},"max":{"1min":38.222000000000001,"5min":38.222000000000001,"15min":38.222000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":1.5189999999999999,"15min":1.401},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.35499999999999998},"max":{"1min":25.931000000000001,"5min":25.931000000000001,"15min":25.931000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.6160000000000001,"15min":1.524},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.214,"5min":28.010000000000002,"15min":28.010000000000002},"last":0.89300000000000002}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":1.772,"15min":1.498},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36599999999999999},"max":{"1min":48.582000000000001,"5min":48.582000000000001,"15min":48.582000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":5.3490000000000002,"5min":2.0459999999999998,"15min":1.657},"min":{"1min":0.624,"5min":0.501,"15min":0.40799999999999997},"max":{"1min":68.367000000000004,"5min":68.367000000000004,"15min":68.367000000000004},"last":0.95399999999999996}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.72,"15min":1.552},"min":{"1min":0.44600000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5630000000000002,"5min":8.9730000000000008,"15min":12.48},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.29,"15min":1.4330000000000001},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.4279999999999999,"5min":8.25,"15min":13.292999999999999},"last":1.01}]}]},{"osd":2,"up_from":13,"seq":55834581084,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1011444,"kb_used_data":492,"kb_used_omap":3682,"kb_used_meta":1007261,"kb_avail":93360396,"statfs":{"total":96636764160,"available":95601045504,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3770422,"internal_metadata":1031436234},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.75900000000000001,"15min":1.1299999999999999},"min":{"1min":0.26900000000000002,"5min":0.218,"15min":0.216},"max":{"1min":0.93999999999999995,"5min":8.5359999999999996,"15min":42.659999999999997},"last":0.75},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1859999999999999,"15min":1.7689999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.7300000000000004,"5min":14.984999999999999,"15min":41.613999999999997},"last":0.71899999999999997}]},{"osd":1,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.998,"15min":1.3120000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.8029999999999999,"5min":8.859,"15min":11.391},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.4199999999999999,"15min":1.5649999999999999},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.8970000000000002,"5min":14.401999999999999,"15min":14.401999999999999},"last":0.85699999999999998}]},{"osd":3,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.819,"5min":1.5960000000000001,"15min":1.5660000000000001},"min":{"1min":0.35599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.7270000000000003,"5min":17.779,"15min":41.917000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.306,"5min":1.05,"15min":1.4350000000000001},"min":{"1min":0.33400000000000002,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":7.4039999999999999,"5min":7.4039999999999999,"15min":42.578000000000003},"last":1.1879999999999999}]},{"osd":4,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97799999999999998,"15min":1.0700000000000001},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.32500000000000001},"max":{"1min":5.9790000000000001,"5min":6.5069999999999997,"15min":7.9699999999999998},"last":1.113},{"interface":"front","average":{"1min":0.999,"5min":1.1819999999999999,"15min":1.391},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.8179999999999996,"5min":7.0430000000000001,"15min":10.009},"last":1.266}]},{"osd":5,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.2929999999999999,"15min":1.298},"min":{"1min":0.436,"5min":0.372,"15min":0.372},"max":{"1min":6.0069999999999997,"5min":10.605,"15min":10.605},"last":1.29},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1439999999999999,"15min":1.179},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33000000000000002},"max":{"1min":5.7939999999999996,"5min":6.5449999999999999,"15min":7.9160000000000004},"last":1.3300000000000001}]},{"osd":6,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.264,"15min":1.4730000000000001},"min":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38400000000000001},"max":{"1min":6.8520000000000003,"5min":7.1609999999999996,"15min":9.9819999999999993},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.806,"5min":1.373,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":10.35,"5min":10.645,"15min":13.244999999999999},"last":1.413}]},{"osd":7,"last update":"Mon May 22 01:33:49 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.4650000000000001,"15min":1.5149999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":14.59,"5min":14.59,"15min":14.59},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.599,"5min":1.4350000000000001,"15min":1.4630000000000001},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.438},"max":{"1min":5.9560000000000004,"5min":11.401,"15min":11.401},"last":1.3520000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581087,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088756,"kb_used_data":492,"kb_used_omap":6199,"kb_used_meta":1082056,"kb_avail":93283084,"statfs":{"total":96636764160,"available":95521878016,"internally_reserved":0,"allocated":503808,"data_stored":211548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6348278,"internal_metadata":1108025866},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.0800000000000001,"15min":0.88900000000000001},"min":{"1min":0.253,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":11.808999999999999,"5min":11.808999999999999,"15min":14.096},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.202,"15min":1.5580000000000001},"min":{"1min":0.29399999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":3.073,"5min":7.468,"15min":14.414999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":1.492,"15min":1.2030000000000001},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.23400000000000001},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":2.5070000000000001,"5min":1.6759999999999999,"15min":1.552},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":0.876}]},{"osd":3,"last update":"Mon May 22 01:33:30 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.3620000000000001,"15min":1.373},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":0.77100000000000002},{"interface":"front","average":{"1min":2.2829999999999999,"5min":1.806,"15min":1.589},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.27500000000000002},"max":{"1min":11.835000000000001,"5min":11.835000000000001,"15min":15.206},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.228,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":12.08,"5min":12.08,"15min":12.08},"last":0.95699999999999996},{"interface":"front","average":{"1min":4.1189999999999998,"5min":1.853,"15min":1.5680000000000001},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":40.874000000000002,"5min":40.874000000000002,"15min":40.874000000000002},"last":0.96799999999999997}]},{"osd":5,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.6759999999999999,"15min":1.452},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.901,"5min":11.901,"15min":15.260999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.5259999999999998,"5min":1.6020000000000001,"15min":1.2989999999999999},"min":{"1min":0.61199999999999999,"5min":0.45700000000000002,"15min":0.375},"max":{"1min":14.613,"5min":14.613,"15min":14.613},"last":1.091}]},{"osd":6,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":1.8919999999999999,"15min":1.7},"min":{"1min":0.46000000000000002,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":11.968999999999999,"5min":11.968999999999999,"15min":15.295999999999999},"last":0.754},{"interface":"front","average":{"1min":2.6030000000000002,"5min":1.581,"15min":1.298},"min":{"1min":0.627,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":12.144,"5min":12.144,"15min":12.144},"last":1.0169999999999999}]},{"osd":7,"last update":"Mon May 22 01:33:39 2023","interfaces":[{"interface":"back","average":{"1min":2.077,"5min":1.631,"15min":1.627},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":1.107},{"interface":"front","average":{"1min":1.9890000000000001,"5min":1.839,"15min":1.7370000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.936999999999999,"5min":12.363,"15min":15.33},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834581083,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660728,"kb_used_data":1072,"kb_used_omap":5377,"kb_used_meta":654270,"kb_avail":93711112,"statfs":{"total":96636764160,"available":95960178688,"internally_reserved":0,"allocated":1097728,"data_stored":801916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5506796,"internal_metadata":669972756},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.91300000000000003,"15min":1.157},"min":{"1min":0.26800000000000002,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":1.7609999999999999,"5min":15.766999999999999,"15min":15.766999999999999},"last":0.624},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.93799999999999994,"15min":1.069},"min":{"1min":0.28999999999999998,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":3.944,"5min":15.926,"15min":15.926},"last":1.2729999999999999}]},{"osd":2,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.1060000000000001,"15min":1.1799999999999999},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":14.32,"5min":14.32,"15min":14.32},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0720000000000001,"15min":1.2849999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":4.7869999999999999,"5min":10.025,"15min":12.134},"last":0.71399999999999997}]},{"osd":3,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.304,"15min":1.4450000000000001},"min":{"1min":0.39100000000000001,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":5.4299999999999997,"5min":9.8330000000000002,"15min":12.185},"last":1.048},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.1819999999999999,"15min":1.45},"min":{"1min":0.30499999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.3780000000000001,"5min":15.707000000000001,"15min":15.707000000000001},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":2.2759999999999998,"5min":1.3560000000000001,"15min":1.284},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":22.163,"5min":22.163,"15min":22.163},"last":1.1519999999999999},{"interface":"front","average":{"1min":2.4009999999999998,"5min":1.127,"15min":1.153},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":23.003,"5min":23.003,"15min":23.003},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.02,"15min":1.2430000000000001},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":3.9849999999999999,"5min":7.7690000000000001,"15min":8.8580000000000005},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.452,"5min":1.276,"15min":1.3420000000000001},"min":{"1min":0.48999999999999999,"5min":0.374,"15min":0.35299999999999998},"max":{"1min":10.597,"5min":10.597,"15min":17.975999999999999},"last":0.88}]},{"osd":6,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":9.1760000000000002,"5min":10.324999999999999,"15min":10.324999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.335},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.39200000000000002},"max":{"1min":5.9199999999999999,"5min":7.8109999999999999,"15min":13.109},"last":1.1830000000000001}]},{"osd":7,"last update":"Mon May 22 01:34:03 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1850000000000001,"15min":1.4079999999999999},"min":{"1min":0.54900000000000004,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":4.0529999999999999,"5min":7.8440000000000003,"15min":8.8309999999999995},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.327,"15min":1.3740000000000001},"min":{"1min":0.52500000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.669,"5min":6.3769999999999998,"15min":18.039000000000001},"last":1.2430000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-22T01:34:27.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-05-22T01:34:28.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.089+0000 7fb286c9d700 1 Processor -- start 2023-05-22T01:34:28.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.089+0000 7fb286c9d700 1 -- start start 2023-05-22T01:34:28.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb2800715e0 0x7fb28015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28015ed60 con 0x7fb2800c9870 2023-05-22T01:34:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800cd6b0 con 0x7fb280143c90 2023-05-22T01:34:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2800cba50 con 0x7fb2800715e0 2023-05-22T01:34:28.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28549a700 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb2800c9870 0x7fb280070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41832/0 (socket says 172.21.15.46:41832) 2023-05-22T01:34:28.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28549a700 1 -- 172.21.15.46:0/1043609363 learned_addr learned my addr 172.21.15.46:0/1043609363 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:28.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28649c700 1 --2- 172.21.15.46:0/1043609363 >> v2:172.21.15.46:3300/0 conn(0x7fb2800715e0 0x7fb28015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb284c99700 1 -- 172.21.15.46:0/1043609363 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502227787 0 0) 0x7fb270001110 con 0x7fb2800c9870 2023-05-22T01:34:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb284c99700 1 -- 172.21.15.46:0/1043609363 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb26c0035d0 con 0x7fb2800c9870 2023-05-22T01:34:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28649c700 1 -- 172.21.15.46:0/1043609363 >> v1:172.21.15.142:6789/0 conn(0x7fb280143c90 legacy=0x7fb280069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28649c700 1 -- 172.21.15.46:0/1043609363 >> v1:172.21.15.46:6789/0 conn(0x7fb2800c9870 legacy=0x7fb280070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28649c700 1 -- 172.21.15.46:0/1043609363 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2800c9d00 con 0x7fb2800715e0 2023-05-22T01:34:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb28649c700 1 --2- 172.21.15.46:0/1043609363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800715e0 0x7fb28015e820 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb278009d90 tx=0x7fb27800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb017cc7b14beb5c server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb284c99700 1 -- 172.21.15.46:0/1043609363 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800e070 con 0x7fb2800715e0 2023-05-22T01:34:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb284c99700 1 -- 172.21.15.46:0/1043609363 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800bb20 con 0x7fb2800715e0 2023-05-22T01:34:28.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb284c99700 1 -- 172.21.15.46:0/1043609363 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278012430 con 0x7fb2800715e0 2023-05-22T01:34:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- 172.21.15.46:0/1043609363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800715e0 msgr2=0x7fb28015e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 --2- 172.21.15.46:0/1043609363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800715e0 0x7fb28015e820 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb278009d90 tx=0x7fb27800b330 comp rx=0 tx=0).stop 2023-05-22T01:34:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- 172.21.15.46:0/1043609363 shutdown_connections 2023-05-22T01:34:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 --2- 172.21.15.46:0/1043609363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800715e0 0x7fb28015e820 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- 172.21.15.46:0/1043609363 >> 172.21.15.46:0/1043609363 conn(0x7fb2800cfeb0 msgr2=0x7fb2800cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- 172.21.15.46:0/1043609363 shutdown_connections 2023-05-22T01:34:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- 172.21.15.46:0/1043609363 wait complete. 2023-05-22T01:34:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 Processor -- start 2023-05-22T01:34:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 -- start start 2023-05-22T01:34:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.093+0000 7fb286c9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2800715e0 0x7fb28015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 0x7fb28006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb280143c90 0x7fb28006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801f2da0 con 0x7fb2800c9870 2023-05-22T01:34:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801f0530 con 0x7fb2800715e0 2023-05-22T01:34:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801f2fb0 con 0x7fb280143c90 2023-05-22T01:34:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 0x7fb28006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 0x7fb28006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57796/0 (socket says 172.21.15.46:57796) 2023-05-22T01:34:28.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 -- 172.21.15.46:0/3144254813 learned_addr learned my addr 172.21.15.46:0/3144254813 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:28.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb285c9b700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2800715e0 0x7fb28015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28649c700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb280143c90 0x7fb28006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 -- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb280143c90 msgr2=0x7fb28006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb280143c90 0x7fb28006e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 -- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2800715e0 msgr2=0x7fb28015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2800715e0 0x7fb28015ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 -- 172.21.15.46:0/3144254813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278009a70 con 0x7fb2800c9870 2023-05-22T01:34:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb28549a700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 0x7fb28006e3b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb270001270 tx=0x7fb27000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270005d90 con 0x7fb2800c9870 2023-05-22T01:34:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2700070d0 con 0x7fb2800c9870 2023-05-22T01:34:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2800cd340 con 0x7fb2800c9870 2023-05-22T01:34:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270007480 con 0x7fb2800c9870 2023-05-22T01:34:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2800c9fe0 con 0x7fb2800c9870 2023-05-22T01:34:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb280144060 con 0x7fb2800c9870 2023-05-22T01:34:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2700075e0 con 0x7fb2800c9870 2023-05-22T01:34:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.097+0000 7fb2767fc700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2640662f0 0x7fb2640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.101+0000 7fb285c9b700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2640662f0 0x7fb2640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.101+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb270082dd0 con 0x7fb2800c9870 2023-05-22T01:34:28.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.101+0000 7fb285c9b700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2640662f0 0x7fb2640687a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb28006c040 tx=0x7fb27c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:28.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.105+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb270050550 con 0x7fb2800c9870 2023-05-22T01:34:28.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.269+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb28015ed60 con 0x7fb2800c9870 2023-05-22T01:34:28.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.281+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb270007890 con 0x7fb2800c9870 2023-05-22T01:34:28.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.281+0000 7fb2767fc700 1 -- 172.21.15.46:0/3144254813 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb28015ed60 con 0x7fb2800c9870 2023-05-22T01:34:28.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2640662f0 msgr2=0x7fb2640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2640662f0 0x7fb2640687a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb28006c040 tx=0x7fb27c009040 comp rx=0 tx=0).stop 2023-05-22T01:34:28.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 msgr2=0x7fb28006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 0x7fb28006e3b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb270001270 tx=0x7fb27000c880 comp rx=0 tx=0).stop 2023-05-22T01:34:28.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 shutdown_connections 2023-05-22T01:34:28.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7fb2640662f0 0x7fb2640687a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb280143c90 0x7fb28006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2800c9870 0x7fb28006e3b0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 --2- 172.21.15.46:0/3144254813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2800715e0 0x7fb28015ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 >> 172.21.15.46:0/3144254813 conn(0x7fb2800cfeb0 msgr2=0x7fb280142ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:28.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 shutdown_connections 2023-05-22T01:34:28.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.285+0000 7fb286c9d700 1 -- 172.21.15.46:0/3144254813 wait complete. 2023-05-22T01:34:28.329 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-22T01:34:28.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-22T01:34:28.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.465+0000 7ffb25af5700 1 Processor -- start 2023-05-22T01:34:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.465+0000 7ffb25af5700 1 -- start start 2023-05-22T01:34:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb200cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb2006c040 0x7ffb2006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb200cced0 con 0x7ffb201591a0 2023-05-22T01:34:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb200cee30 con 0x7ffb2006c040 2023-05-22T01:34:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200ce260 con 0x7ffb200cc540 2023-05-22T01:34:28.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb200cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb252f4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb2006c040 0x7ffb2006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb24af3700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ffb201591a0 0x7ffb200ae770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.46:46592/0 (socket says 172.21.15.46:46592) 2023-05-22T01:34:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb24af3700 1 -- 172.21.15.46:0/1106218623 learned_addr learned my addr 172.21.15.46:0/1106218623 (peer_addr_for_me v1:172.21.15.46:0/0) 2023-05-22T01:34:28.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb1ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb200cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.46:39864/0 (socket says 172.21.15.46:39864) 2023-05-22T01:34:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb252f4700 1 -- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 msgr2=0x7ffb200cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-22T01:34:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb252f4700 1 --2- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb200cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb252f4700 1 -- 172.21.15.46:0/1106218623 >> v1:172.21.15.142:6789/0 conn(0x7ffb201591a0 legacy=0x7ffb200ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb252f4700 1 -- 172.21.15.46:0/1106218623 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb200ce500 con 0x7ffb2006c040 2023-05-22T01:34:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb252f4700 1 --2- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2006c040 0x7ffb2006c4c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009d90 tx=0x7ffb1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8e89619580ce8ac server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb1f7fe700 1 -- 172.21.15.46:0/1106218623 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800bd20 con 0x7ffb2006c040 2023-05-22T01:34:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb1f7fe700 1 -- 172.21.15.46:0/1106218623 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffb1800be80 con 0x7ffb2006c040 2023-05-22T01:34:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb1f7fe700 1 -- 172.21.15.46:0/1106218623 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180116c0 con 0x7ffb2006c040 2023-05-22T01:34:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2006c040 msgr2=0x7ffb2006c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2006c040 0x7ffb2006c4c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009d90 tx=0x7ffb1800b330 comp rx=0 tx=0).stop 2023-05-22T01:34:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- 172.21.15.46:0/1106218623 shutdown_connections 2023-05-22T01:34:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb200cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1106218623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb2006c040 0x7ffb2006c4c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- 172.21.15.46:0/1106218623 >> 172.21.15.46:0/1106218623 conn(0x7ffb2006d8f0 msgr2=0x7ffb2006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:28.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- 172.21.15.46:0/1106218623 shutdown_connections 2023-05-22T01:34:28.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.469+0000 7ffb25af5700 1 -- 172.21.15.46:0/1106218623 wait complete. 2023-05-22T01:34:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 Processor -- start 2023-05-22T01:34:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- start start 2023-05-22T01:34:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 0x7ffb201ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb20151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb201591a0 0x7ffb201521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201eeaf0 con 0x7ffb2006c040 2023-05-22T01:34:28.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb201527a0 con 0x7ffb201591a0 2023-05-22T01:34:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20152a80 con 0x7ffb200cc540 2023-05-22T01:34:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 0x7ffb201ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 0x7ffb201ee5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57812/0 (socket says 172.21.15.46:57812) 2023-05-22T01:34:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 -- 172.21.15.46:0/1012724270 learned_addr learned my addr 172.21.15.46:0/1012724270 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-05-22T01:34:28.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb252f4700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb201591a0 0x7ffb201521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb1ffff700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb20151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 -- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 msgr2=0x7ffb20151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb20151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 -- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb201591a0 msgr2=0x7ffb201521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb201591a0 0x7ffb201521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 -- 172.21.15.46:0/1012724270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb18009a70 con 0x7ffb2006c040 2023-05-22T01:34:28.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb24af3700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 0x7ffb201ee5b0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c700 tx=0x7ffb1400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:28.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14005d90 con 0x7ffb2006c040 2023-05-22T01:34:28.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffb140070d0 con 0x7ffb2006c040 2023-05-22T01:34:28.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb200ceac0 con 0x7ffb2006c040 2023-05-22T01:34:28.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007440 con 0x7ffb2006c040 2023-05-22T01:34:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb200ce7e0 con 0x7ffb2006c040 2023-05-22T01:34:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.473+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2015dce0 con 0x7ffb2006c040 2023-05-22T01:34:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.477+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb140075a0 con 0x7ffb2006c040 2023-05-22T01:34:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.477+0000 7ffb1d7fa700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb04066320 0x7ffb040687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-22T01:34:28.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.477+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffb14083560 con 0x7ffb2006c040 2023-05-22T01:34:28.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.477+0000 7ffb1ffff700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb04066320 0x7ffb040687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-22T01:34:28.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.477+0000 7ffb1ffff700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb04066320 0x7ffb040687d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ffb2006b2f0 tx=0x7ffb0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-22T01:34:28.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.481+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffb14050d00 con 0x7ffb2006c040 2023-05-22T01:34:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.677+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb20067ac0 con 0x7ffb2006c040 2023-05-22T01:34:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb1d7fa700 1 -- 172.21.15.46:0/1012724270 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3529 (secure 0 0 0) 0x7ffb14021de0 con 0x7ffb2006c040 2023-05-22T01:34:28.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-05-22T01:34:28.709 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1901031089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1901031089},{"type":"v1","addr":"172.21.15.142:6835","nonce":1901031089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3423726595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3423726595},{"type":"v1","addr":"172.21.15.46:6835","nonce":3423726595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/41556268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":41556268},{"type":"v1","addr":"172.21.15.142:6834","nonce":41556268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":8564,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/3559079466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3559079466},{"type":"v1","addr":"172.21.15.46:6837","nonce":3559079466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-05-22T01:34:28.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb04066320 msgr2=0x7ffb040687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb04066320 0x7ffb040687d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ffb2006b2f0 tx=0x7ffb0c008040 comp rx=0 tx=0).stop 2023-05-22T01:34:28.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 msgr2=0x7ffb201ee5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-22T01:34:28.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 0x7ffb201ee5b0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c700 tx=0x7ffb1400ca10 comp rx=0 tx=0).stop 2023-05-22T01:34:28.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 shutdown_connections 2023-05-22T01:34:28.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:6832/1217485649,v1:172.21.15.46:6833/1217485649] conn(0x7ffb04066320 0x7ffb040687d0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb201591a0 0x7ffb201521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb200cc540 0x7ffb20151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 --2- 172.21.15.46:0/1012724270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2006c040 0x7ffb201ee5b0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-22T01:34:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 >> 172.21.15.46:0/1012724270 conn(0x7ffb2006d8f0 msgr2=0x7ffb200cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-22T01:34:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 shutdown_connections 2023-05-22T01:34:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-05-22T01:34:28.681+0000 7ffb25af5700 1 -- 172.21.15.46:0/1012724270 wait complete. 2023-05-22T01:34:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2023-05-22T01:34:28.715 DEBUG:tasks.cephfs.filesystem:already dead... 2023-05-22T01:34:28.735 INFO:teuthology.misc:Shutting down mds daemons... 2023-05-22T01:34:28.774 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-22T01:34:28.791 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:28.794 INFO:tasks.ceph.mds.a:Stopped 2023-05-22T01:34:28.796 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-22T01:34:28.797 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:28.864 INFO:tasks.ceph.mds.c:Stopped 2023-05-22T01:34:28.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-22T01:34:28.875 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:28.889 INFO:tasks.ceph.mds.b:Stopped 2023-05-22T01:34:28.893 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-22T01:34:28.894 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:28.936 INFO:tasks.ceph.mds.d:Stopped 2023-05-22T01:34:28.956 INFO:teuthology.misc:Shutting down osd daemons... 2023-05-22T01:34:28.957 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-05-22T01:34:28.957 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:32.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-05-22T01:34:35.063 INFO:tasks.ceph.osd.0:Stopped 2023-05-22T01:34:35.067 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-05-22T01:34:35.068 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:39.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-05-22T01:34:39.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-05-22T01:34:41.172 INFO:tasks.ceph.osd.1:Stopped 2023-05-22T01:34:41.173 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-05-22T01:34:41.174 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:45.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-05-22T01:34:45.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-05-22T01:34:47.277 INFO:tasks.ceph.osd.2:Stopped 2023-05-22T01:34:47.278 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-05-22T01:34:47.278 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:47.379 INFO:tasks.ceph.osd.3:Stopped 2023-05-22T01:34:47.380 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-05-22T01:34:47.381 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:50.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-05-22T01:34:50.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-05-22T01:34:53.484 INFO:tasks.ceph.osd.4:Stopped 2023-05-22T01:34:53.485 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-05-22T01:34:53.486 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:53.599 INFO:tasks.ceph.osd.5:Stopped 2023-05-22T01:34:53.599 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-05-22T01:34:53.600 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:53.699 INFO:tasks.ceph.osd.6:Stopped 2023-05-22T01:34:53.700 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-05-22T01:34:53.700 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-05-22T01:34:56.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-05-22T01:34:59.802 INFO:tasks.ceph.osd.7:Stopped 2023-05-22T01:34:59.803 INFO:teuthology.misc:Shutting down mgr daemons... 2023-05-22T01:34:59.804 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-05-22T01:34:59.805 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:59.833 INFO:tasks.ceph.mgr.y:Stopped 2023-05-22T01:34:59.834 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-05-22T01:34:59.835 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:59.882 INFO:tasks.ceph.mgr.x:Stopped 2023-05-22T01:34:59.883 INFO:teuthology.misc:Shutting down mon daemons... 2023-05-22T01:34:59.886 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-05-22T01:34:59.887 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:59.925 INFO:tasks.ceph.mon.a:Stopped 2023-05-22T01:34:59.926 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-05-22T01:34:59.927 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:59.958 INFO:tasks.ceph.mon.b:Stopped 2023-05-22T01:34:59.958 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-05-22T01:34:59.959 INFO:teuthology.orchestra.run:waiting for 300 2023-05-22T01:34:59.980 INFO:tasks.ceph.mon.c:Stopped 2023-05-22T01:34:59.981 INFO:tasks.ceph:Checking cluster log for badness... 2023-05-22T01:35:00.001 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-05-22T01:35:00.387 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T01:35:00.388 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-05-22T01:35:01.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-05-22T01:35:01.996 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T01:35:01.997 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-05-22T01:35:02.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T01:35:02.482 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-05-22T01:35:02.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T01:35:02.822 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-05-22T01:35:03.177 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T01:35:03.178 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-05-22T01:35:04.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T01:35:04.464 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-05-22T01:35:04.779 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T01:35:04.780 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-05-22T01:35:05.031 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T01:35:05.032 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-05-22T01:35:05.307 INFO:tasks.ceph:Archiving mon data... 2023-05-22T01:35:05.332 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/data/mon.a.tgz 2023-05-22T01:35:05.353 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-05-22T01:35:05.381 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.AueK01C9AO 2023-05-22T01:35:05.382 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AueK01C9AO 2023-05-22T01:35:05.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.AueK01C9AO 2023-05-22T01:35:05.997 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.AueK01C9AO is 593KB 2023-05-22T01:35:06.154 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.AueK01C9AO 2023-05-22T01:35:06.161 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/data/mon.b.tgz 2023-05-22T01:35:06.162 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-05-22T01:35:06.184 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.LDJsLRo3ju 2023-05-22T01:35:06.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LDJsLRo3ju 2023-05-22T01:35:06.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.LDJsLRo3ju 2023-05-22T01:35:06.493 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.LDJsLRo3ju is 608KB 2023-05-22T01:35:06.567 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.LDJsLRo3ju 2023-05-22T01:35:06.577 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/data/mon.c.tgz 2023-05-22T01:35:06.578 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-05-22T01:35:06.585 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.GmjNLeD4qH 2023-05-22T01:35:06.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.GmjNLeD4qH 2023-05-22T01:35:06.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.GmjNLeD4qH 2023-05-22T01:35:06.774 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.GmjNLeD4qH is 608KB 2023-05-22T01:35:06.846 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.GmjNLeD4qH 2023-05-22T01:35:06.854 INFO:tasks.ceph:Cleaning ceph cluster... 2023-05-22T01:35:06.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-22T01:35:06.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-05-22T01:35:07.041 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-05-22T01:35:07.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-22T01:35:07.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-05-22T01:35:07.078 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-22T01:35:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-05-22T01:35:07.117 INFO:tasks.ceph:Archiving crash dumps... 2023-05-22T01:35:07.127 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/remote/smithi046/crash 2023-05-22T01:35:07.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-22T01:35:07.340 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/remote/smithi142/crash 2023-05-22T01:35:07.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-05-22T01:35:07.363 INFO:tasks.ceph:Shutting down logrotate 2023-05-22T01:36:17.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-22T01:36:17.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-05-22T01:36:17.359 INFO:tasks.ceph:Compressing logs... 2023-05-22T01:36:17.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-22T01:36:17.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-22T02:15:12.212 INFO:tasks.ceph:Archiving logs... 2023-05-22T02:15:12.295 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/remote/smithi046/log 2023-05-22T02:15:12.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-22T02:24:11.021 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/remote/smithi142/log 2023-05-22T02:24:11.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-05-22T02:26:27.068 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-05-22T02:26:27.267 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-05-22T02:26:27.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-05-22T02:26:27.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-05-22T02:26:44.012 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-05-22T02:26:44.051 INFO:teuthology.task.clock:Checking final clock skew... 2023-05-22T02:26:44.086 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-22T02:26:44.089 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-22T02:26:44.192 INFO:teuthology.orchestra.run.smithi046.stdout: remote refid st t when poll reach delay offset jitter 2023-05-22T02:26:44.192 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================== 2023-05-22T02:26:44.193 INFO:teuthology.orchestra.run.smithi046.stdout:*hv01.front.sepi 44.4.53.2 2 u 632 1024 377 0.233 2.595 0.468 2023-05-22T02:26:44.193 INFO:teuthology.orchestra.run.smithi046.stdout:+hv02.front.sepi 155.248.196.28 3 u 596 1024 377 0.209 2.576 0.951 2023-05-22T02:26:44.193 INFO:teuthology.orchestra.run.smithi046.stdout:+hv03.front.sepi 74.6.168.72 3 u 598 1024 377 0.205 -1.243 0.525 2023-05-22T02:26:44.193 INFO:teuthology.orchestra.run.smithi046.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-05-22T02:26:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2023-05-22T02:26:44.261 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2023-05-22T02:26:44.261 INFO:teuthology.orchestra.run.smithi142.stdout:*hv01.front.sepi 44.4.53.2 2 u 726 1024 377 0.204 1.239 1.774 2023-05-22T02:26:44.261 INFO:teuthology.orchestra.run.smithi142.stdout:+hv02.front.sepi 155.248.196.28 3 u 580 1024 377 0.226 1.737 1.845 2023-05-22T02:26:44.262 INFO:teuthology.orchestra.run.smithi142.stdout:+hv03.front.sepi 74.6.168.72 3 u 657 1024 377 0.191 -1.212 0.806 2023-05-22T02:26:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-05-22T02:26:44.263 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-05-22T02:26:44.301 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-05-22T02:26:44.561 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-05-22T02:26:44.684 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-05-22T02:26:44.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-05-22T02:26:44.739 INFO:teuthology.task.internal:Duration was 34918.969744 seconds 2023-05-22T02:26:44.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-05-22T02:26:44.776 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-05-22T02:26:44.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-22T02:26:44.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-05-22T02:26:44.995 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-05-22T02:26:44.996 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2023-05-22T02:26:44.996 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-22T02:26:45.051 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-05-22T02:26:45.052 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-05-22T02:26:45.068 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-05-22T02:26:45.069 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-22T02:26:45.072 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-05-22T02:26:45.218 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-05-22T02:26:45.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-22T02:26:45.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-05-22T02:26:45.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-05-22T02:26:45.786 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-05-22T02:26:45.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-22T02:26:45.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-05-22T02:26:45.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-05-22T02:26:45.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-22T02:26:45.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-05-22T02:26:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2023-05-22T02:26:45.924 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-05-22T02:26:45.966 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-22T02:26:46.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-22T02:26:46.067 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-05-22T02:26:46.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-22T02:26:46.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-05-22T02:26:46.096 INFO:teuthology.task.internal:Transferring archived files... 2023-05-22T02:26:46.268 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/remote/smithi046 2023-05-22T02:26:46.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-22T02:26:46.337 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887/remote/smithi142 2023-05-22T02:26:46.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-05-22T02:26:46.362 INFO:teuthology.task.internal:Removing archive directory... 2023-05-22T02:26:46.362 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-22T02:26:46.365 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-05-22T02:26:46.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-05-22T02:26:46.385 INFO:teuthology.task.internal:Not uploading archives. 2023-05-22T02:26:46.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-05-22T02:26:46.398 INFO:teuthology.task.internal:Tidying up after the test... 2023-05-22T02:26:46.399 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-22T02:26:46.414 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-05-22T02:26:46.419 INFO:teuthology.orchestra.run.smithi046.stdout: 924115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 22 02:26 /home/ubuntu/cephtest 2023-05-22T02:26:46.422 INFO:teuthology.orchestra.run.smithi142.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 22 02:26 /home/ubuntu/cephtest 2023-05-22T02:26:46.446 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-05-22T02:26:46.484 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-05-22T02:26:46.915 INFO:teuthology.nuke:Checking targets against current locks 2023-05-22T02:26:47.067 DEBUG:teuthology.nuke:shortname: smithi046 2023-05-22T02:26:47.212 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-22T02:26:47.273 DEBUG:teuthology.nuke:shortname: smithi142 2023-05-22T02:26:47.274 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-22T02:26:47.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-21 16:35:30.320329', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-05-22T02:26:47.379 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-21_14:52:38-fs-wip-yuri7-testing-2023-05-18-0655-distro-default-smithi/7281887', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-21 16:35:30.318400', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-05-22T02:26:47.483 INFO:teuthology.orchestra.console:Power off smithi046 2023-05-22T02:26:47.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-22T02:26:48.140 INFO:teuthology.orchestra.console:Power off smithi142 2023-05-22T02:26:48.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-05-22T02:26:48.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:26:48.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:26:52.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:26:52.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:26:56.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:26:56.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:26:56.835 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-05-22T02:27:00.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-05-22T02:27:01.066 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-05-22T02:27:01.176 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 34918.96974372864 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7c09d0b86e6c49a2b486d74d557ad59b status: fail success: false 2023-05-22T02:27:01.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-22T02:27:01.518 INFO:teuthology.run:FAIL